o i:@shddlZddlZddlZddlZddlmZmZmZddlm Z ddl m Z e e ZGdddZdS)N)ListOptionalUnion)HfFolder)LFS_MULTIPART_UPLOAD_COMMANDc @s$eZdZdZ    d+dedeedeeedfdeedeef dd Zd d Z d,d edeeedffd dZ d-deedeefddZ defddZ defddZ defddZdeeeeffddZddZd.deefdd Zd/d"d#Zd0d%d&Zdefd'd(Zd0defd)d*ZdS)1 Repositoryz Helper class to wrap the git and git-lfs commands. The aim is to facilitate interacting with huggingface.co hosted model or dataset repos, though not a lot here (if any) is actually specific to huggingface.co. N local_dir clone_fromuse_auth_tokengit_user git_emailcCstj|dd||_||dur|j||dntjtj|jdr,t dn t dt d|dus=|durE| ||dSdS)a' Instantiate a local clone of a git repo. If specifying a `clone_from`: will clone an existing remote repository, for instance one that was previously created using ``HfApi().create_repo(token=huggingface_token, name=repo_name)``. ``Repository`` uses the local git credentials by default, but if required, the ``huggingface_token`` as well as the git ``user`` and the ``email`` can be explicitly specified. If `clone_from` is used, and the repository is being instantiated into a non-empty directory, e.g. a directory with your trained model files, it will automatically merge them. Args: local_dir (``str``): path (e.g. ``'my_trained_model/'``) to the local directory, where the ``Repository`` will be initalized. clone_from (``str``, optional): repository url (e.g. ``'https://huggingface.co/philschmid/playground-tests'``). use_auth_token (``str`` or ``bool``, `optional`, defaults ``None``): huggingface_token can be extract from ``HfApi().login(username, password)`` and is used to authenticate against the hub (useful from Google Colab for instance). git_user (``str``, `optional`, defaults ``None``): will override the ``git config user.name`` for committing and pushing files to the hub. git_email (``str``, `optional`, defaults ``None``): will override the ``git config user.email`` for committing and pushing files to the hub. T)exist_okN)repo_urlr z.gitz [Repository] is a valid git repozNIf not specifying `clone_from`, you need to pass Repository a valid git clone.) osmakedirsr check_git_versionsr pathisdirjoinloggerdebugerror ValueErrorgit_config_username_and_email)selfr r r r r rU/var/www/edux/Edux_v2/venv/lib/python3.10/site-packages/huggingface_hub/repository.py__init__s ! zRepository.__init__cCsztjddgtjtjdddj}Wn tytdwztjddgddtjtjdj}Wn ty=td wt|d |d S) zR print git and git-lfs versions, raises if they aren't installed. gitz --versionTutf-8stderrstdoutcheckencodingz9Looks like you do not have git installed, please install.zgit-lfs)r%r$r"r#zLooks like you do not have git-lfs installed, please install. You can install from https://git-lfs.github.com/. Then run `git lfs install` (you only have to do this once). N) subprocessrunPIPEr#stripFileNotFoundErrorEnvironmentErrorrinfo)r git_version lfs_versionrrrrMs>  zRepository.check_git_versionsrc Cst|tr|}n |rt}nd}|dur'd|vr'd|vr'|dd|d}ztjdtjtjddd t t |j d krUtjd d |d gtjtjdd|j dWdSt dtjdtjtjdd|j dtjdtjtjdd|j d}d|jvrtjd ddd|gtjtjdd|j dtjdtjtjdd|j dtjdtjtjdd|j dtjdtjtjdd|j d}d|jvrtjdtjtjdd|j dWdSWdStjy}zt|jd}~ww)z& Clone from a remote. Nzhuggingface.co@https://z https://user:zgit lfs installTr r!rrclone.r"r#r$r%cwdz][Repository] local_dir is not empty, so let's try to pull the remote over a non-empty folder.zgit initz git remote -voriginremoteaddz git fetchzgit reset origin/mainr"r#r%r$r5z git branchmainzgit checkout origin/main -ft) isinstancestrr get_tokenreplacer'r(splitr)lenrlistdirr rwarningr#CalledProcessErrorr,r")rrr huggingface_tokenoutputexcrrrr ns               zRepository.clone_fromc Csz2|durtjddd|gtjtjdd|jd|dur0tjddd|gtjtjdd|jdWdSWdStjyD}zt|jd}~ww) zI sets git user name and email (only in the current repo) Nrconfigz user.nameTr r4z user.emailr'r(r)r rCr,r")rr r rFrrrrs0    z(Repository.git_config_username_and_emailreturnc CsRztjdtjtjdd|jd}|jWStjy(}zt|j d}~ww)z0 Get commit sha on top of HEAD. zgit rev-parse HEADr Tr9N) r'r(r?r)r r#r*rCr,r")rprFrrr git_head_hashs  zRepository.git_head_hashc Cs`ztjdtjtjdd|jd}|j}tdd|WStj y/}zt |j d}~ww)z+ Get URL to origin remote. z"git config --get remote.origin.urlr Tr9z https://.*@r1N) r'r(r?r)r r#r*resubrCr,r")rrJurlrFrrrgit_remote_url s  zRepository.git_remote_urlcCs4|}|}|dr|dd}|d|S)z Get URL to last commit on HEAD We assume it's been pushed, and the url scheme is the same one as for GitHub or HuggingFace. /Nz/commit/)rKrOendswith)rsharNrrrgit_head_commit_urls   zRepository.git_head_commit_urlpatternsc Csjt|tr|g}z|D]}tjddd|gtjtjdd|jdq WdStjy4}zt|jd}~ww)z4 Tell git-lfs to track those files. rlfstrackTr r4N) r;r<r'r(r)r rCr,r")rrUpatternrFrrr lfs_track*s"   zRepository.lfs_trackc Csrz&tjdtjtjdd|jdtjdttjtjdd|jdWdStjy8}zt|jd}~ww)zI HF-specific. This enables upload support of files >5GB. zs