2'h#NddlZddlZddlmZddlmZddlmZGddeZy) N)AbstractFileSysteminfer_storage_options) MemoryFileceZdZdZdZdZdZdZ dfd Ze dZ e ddZ e d Z e d Ze d Zdd Zdd Ze fdZedZ ddZxZS)GithubFileSystemaInterface to files in github An instance of this class provides the files residing within a remote github repository. You may specify a point in the repos history, by SHA, branch or tag (default is current master). For files less than 1 MB in size, file content is returned directly in a MemoryFile. For larger files, or for files tracked by git-lfs, file content is returned as an HTTPFile wrapping the ``download_url`` provided by the GitHub API. When using fsspec.open, allows URIs of the form: - "github://path/file", in which case you must specify org, repo and may specify sha in the extra args - 'github://org:repo@/precip/catalog.yml', where the org and repo are part of the URI - 'github://org:repo@sha/precip/catalog.yml', where the sha is also included ``sha`` can be the full or abbreviated hex of the commit you want to fetch from, or a branch or tag name (so long as it doesn't contain special characters like "/", "?", which would have to be HTTP-encoded). For authorised access, you must provide username and token, which can be made at https://github.com/settings/tokens z9https://api.github.com/repos/{org}/{repo}/git/trees/{sha}zChttps://api.github.com/repos/{org}/{repo}/contents/{path}?ref={sha}github)<r c t |d i|||_||_|du|duz r t d||_||_|||_|bd}tj|j||fd|ji|j} | j| jd}||_|jd ddlm} | d i||_y#t&$r d|_YywxYw) Nz%Auth required both username and tokenz)https://api.github.com/repos/{org}/{repo}orgrepotimeoutdefault_branchr)HTTPFileSystem)super__init__rr ValueErrorusernametokenrrequestsgetformatkwraise_for_statusjsonrootlshttprhttp_fs ImportError) selfrrsharrrkwargsurr __class__s d/home/kushmeetdev/Regenta/Chatbot/venv/lib/python3.12/site-packages/fsspec/implementations/github.pyrzGithubFileSystem.__init__-s "6"  $ /DE E    "DL ;;A St,6:llFJggA    &&(+,C    ,)3F3DL DL sCC.-C.cR|jrd|j|jfiSiS)Nauth)rrr&s r,rzGithubFileSystem.kwKs& ==T]]DJJ78 8 ctjdddg|d|d|j}|j|j Dcgc]}|d c}Scc}w)avList repo names for given org or user This may become the top level of the FS Parameters ---------- org_or_user: str Name of the github org or user to query is_org: bool (default True) Whether the name is an organisation (True) or user (False) Returns ------- List of string zhttps://api.github.com/usersorgs/z/repos)rname)rrrrr )cls org_or_useris_orgr*rs r,reposzGithubFileSystem.reposQsb" LL%w&7&?%@+f UKK  )*2V 222s Actjd|jd|jdfd|ji|j }|j |jDcgc]}|d c}Scc}w)zNames of tags in the repohttps://api.github.com/repos/r4z/tagsrr5rrrrrrrr r&r*ts r,tagszGithubFileSystem.tagsisr LL+DHH:Qtyyk G LL gg  #$668,a& ,,,* A9ctjd|jd|jdfd|ji|j }|j |jDcgc]}|d c}Scc}w)zNames of branches in the repor;r4z /branchesrr5r<r=s r,brancheszGithubFileSystem.branchestsr LL+DHH:Qtyyk K LL gg  #$668,a& ,,,r@c4|j|jdS)z#Named references, tags and branchesr?rBrDr/s r,refszGithubFileSystem.refss t}}==r0c L|j|}|dk(r|xs |j}||jdjd}d}|xs |j}|D]e}|j |d||} ||rd|zn|z }| D cgc] } | d|k(s | } } | s t || d} | dd k(r |r| gcS|cS| d }g||j vs||jdfvrtj|jj|j|j| fd |ji|j} | jd k(r t || j!d dd} | j#dD cgc]=} | d| vr4|r |dz| dzn| d| d| | d| jdd| d d?} } ||jdfvr| |j |<n|j |} |r| St%| D cgc]} | d c} Scc} wcc} wcc} w)a List files at given path Parameters ---------- path: str Location to list, relative to repo root detail: bool If True, returns list of dicts, one per file; if False, returns list of full filenames only sha: str (optional) List at the given point in the repo history, branch or tag name or commit SHA _sha: str (optional) List this specific tree object (used internally to descend into trees) rNr4T)r'_shar5rtypefiler')rrr'r directory)blobtreerMpathmodesize)r5rOrHrPr')_strip_protocolr!rstripsplitr"FileNotFoundErrordircacherrurlrrrrr status_coderr sorted)r&rNdetailr'rGr(partsso_farpartoutor*typesfs r,r"zGithubFileSystem.lssX ##D) 2:#$))D <KK$**3/EF#$))D "ggfd$g?#*D8"%=Q6f)( $3s HHAH H!c8|jjyN)rUclear)r&rNs r,invalidate_cachez!GithubFileSystem.invalidate_caches r0cht|}d|vrt| |S|djdS)NrrNr4)rrrQlstrip)r6rNoptsr+s r,rQz GithubFileSystem._strip_protocols:$T* T !7*40 0F|""3''r0cXt|}d|vriS|d|dd}|dr|d|d<|S)Nrpasswordrhostr'r)rNrgr]s r,_get_kwargs_from_urlsz&GithubFileSystem._get_kwargs_from_urlssF$T* T !I:&Z0@A <fCJ r0c R|dk7rt|jj|j|j||xs |j }t j|fd|ji|j}|jdk(r t||j|j} | dr6tj| d} | j!ds t#dd| S|j$ t'd|j$j(| df|||d |S) Nrb)rrrNr'rrJcontents#version https://git-lfs.github.com/zRPlease install fsspec[http] to access github files >1 MB or git-lfs tracked files. download_url)rO block_size cache_options)NotImplementedError content_urlrrrr!rrrrrWrTrr base64 b64decode startswithrr$r%open) r&rNrOrprqr'r(rVr* content_jsonrns r,_openzGithubFileSystem._opens0 4<% %%%tyyt9I &  LL >dll >dgg > ==C #D) ) vvx   "&&|I'>?G %%&LM!$g66 << , !t||   ( !'     r0)NNNN)T)FNNrb)rmNNN)__name__ __module__ __qualname____doc__rVrsprotocolrrpropertyr classmethodr9r?rBrEr"rdrQ staticmethodrkry __classcell__)r+s@r,r r s6 FCWKHGGK < 33.---->>@4D((   1 r0r ) rtrspecrutilsrmemoryrr rr0r,rs# %)  ) r0