o iC@s2dZddlZddlZddlZddlZddlZddlZddlZddl m Z m Z m Z ddl m Z ddlmZddlmZddlmZmZddlmZdd lmZmZmZmZmZmZdd lmZddl Z dd l!m"Z"dd l#m$Z$m%Z%m&Z&m'Z'm(Z(dd l)m*Z*m+Z+m,Z,m-Z-de.de.de.de/fddZ0Gddde+Z1dS)OExtension manager using pip as package manager and PyPi.org as packages source.N)datetime timedeltatimezone)partial)groupby)Path)CalledProcessErrorrun)TarFile)AnyCallableDictListOptionalTuple)ZipFile) alru_cache)CFloatCIntUnicodeconfigobserve) ActionResultExtensionManagerExtensionManagerMetadataExtensionPackagenamelatest_versionbase_urlreturncsZtj}|j|d|d|dddidIdH}t|jdfddd DS) N//json Content-Typeapplication/jsonheadersinfocsi|]}||qS)get).0kdatar(U/var/www/edux/Edux_v2/venv/lib/python3.10/site-packages/jupyterlab/extensions/pypi.py +s z+_fetch_package_metadata..) author bugtrack_urldocs_url home_pagelicense package_url project_url project_urlssummary)tornado httpclientAsyncHTTPClientfetchjsonloadsbodyr))rrr http_clientresponser(r,r._fetch_package_metadata"s   rBc sheZdZdZeddddZeddddZeddd dZ ed dd dZ d1d e e de e de e jdd ffdd ZedefddZdede efddZdedefddZdededefddZedd d!Zd"ed#ed$edeeeefe effd%d&Z de!eeeffd'd(Z"d2d)ed*e ede#fd+d,Z$dede#fd-d.Z%d)edefd/d0Z&Z'S)3PyPIExtensionManagerrzhttps://pypi.org/pypiTzThe base URL of PyPI index.)rhelpgr@z.PyPI extensions list cache timeout in seconds.iz$The cache size for package metadata.g?zGThrottling time in seconds between PyPI requests using the XML-RPC API.N app_options ext_optionsparentr cst|||t|_|d|jitj|_t j |j |_ tjtjdt|jdd|_d|_|jd|j ddS)Nnewtz)\(?secondsz%Extensions list will be fetched from .)super__init__rB$_observe_package_metadata_cache_sizepackage_metadata_cache_sizer9r:r; _http_clientxmlrpcclient ServerProxyr _rpc_clientrnowrutcr cache_timeout5_PyPIExtensionManager__last_all_packages_request_time)_PyPIExtensionManager__all_packages_cachelogdebug)selfrErFrG __class__r(r.rPNs  zPyPIExtensionManager.__init__cCstddtjS)zExtension manager metadata.PyPIT)rsysprefixr_r(r(r.metadatabszPyPIExtensionManager.metadatapkgcsnz#tj}|j|jd|dddidIdH}t|jd}Wn t y.YdSwt |dS) zReturn the latest available version for a given extension. Args: pkg: The extension to search for Returns: The latest available version r!r"r#r$r%Nr'version) r9r:r;r<rr=r>r?r) Exceptionrget_semver_version)r_rgr@rAr-r(r(r.get_latest_versiongs   z'PyPIExtensionManager.get_latest_version extensioncCs6|jdur|j}|ddkr||dS||jS)aNormalize extension name. Extension have multiple parts, npm package, Python package,... Sub-classes may override this method to ensure the name of an extension from the service provider and the local installed listing is matching. Args: extension: The extension metadata Returns: The normalized name NpackageManagerpython packageName)install_normalize_namer)r_rlinstall_metadatar(r(r.get_normalized_name{s   z(PyPIExtensionManager.get_normalized_name recursivefnc s.tjj}z|jd|g|RIdH}W|Stjjy}zq|jdkr}|j drd}t d|j }|durBt |dp@d}|jd|d t||jd IdH|ri|jd |g|RIdH}n"|jd|g|RIdH}WYd}~|SWYd}~|SWYd}~|SWYd}~|Sd}~ww) a/Throttle XMLRPC API request Args: recursive: Whether to call the throttling recursively once or not. fn: API method to call *args: API method arguments Returns: Result of the method Raises: xmlrpc.client.Fault Ni zHTTPTooManyRequests:rKz!Limit may reset in (\d+) seconds.1z>HTTPTooManyRequests - Perform next call to PyPI XMLRPC API in zs.g{Gz?F)r9ioloopIOLoopcurrentrun_in_executorrTrUFault faultCode faultString startswithresearchintgroupr]r'asynciosleeprpc_request_throttling&_PyPIExtensionManager__throttleRequest) r_rtruargs current_loopr-errdelaymatchr(r(r.__throttleRequests:  $   z&PyPIExtensionManager.__throttleRequestrRcCst|ddt|_dS)NrH)maxsize)rrB)r_changer(r(r.rQsz9PyPIExtensionManager._observe_package_metadata_cache_sizequerypageper_pagecsj|IdH}i}d}|d|}||}ttfdd|ddD]\} } |d7}||ks4||kr5q$t| d\} } || | |jIdH} || }| dpSi}|d}| d pb|d }| d pl|d }| d pv|d}|p| dp| dp|p|p|}t|| d|| d| dt | d||| d|d ||<q$|t |d|fS)awList the available extensions. Note: This will list the packages based on the classifier Framework :: Jupyter :: JupyterLab :: Extensions :: Prebuilt Then it filters it with the query We do not try to check if they are compatible (version wise) Args: query: The search extension query page: The result page per_page: The number of results per page Returns: The available extensions in a mapping {name: metadata} The results last page; None if the manager does not support pagination Nrvcs |dvSNrr()mrr(r.s z4PyPIExtensionManager.list_packages..cSs|dSrr()er(r(r.rr7z Source Coder3Homepager2 Documentationr1z Bug Trackerr6r5r8r0r4prebuilt) r description homepage_urlr0r4rpkg_typebug_tracker_urldocumentation_urlpackage_manager_urlrepository_url) )_PyPIExtensionManager__get_all_extensionsrfilterlistrBrrqr)rrrjmathceil)r_rrrmatches extensionscounter min_index max_indexrr_rr-normalized_name package_urls source_urlrrrbest_guess_home_urlr(rr. list_packagessV $    z"PyPIExtensionManager.list_packagescsj|jdustjtjd|jt|jdkr2|j d| d|j j dgIdH|_tjtjd|_|jS)NrIrLz?Requesting PyPI.org RPC API for prebuilt JupyterLab extensions.Tz"} Args: name: The extension name version: The version to install; default None (i.e. the latest possible) Returns: The action result -mpiprp --no-inputz--quietz--progress-baroffNz==rz --dry-runz--report-T)capture_outputcheckutf-8cs|didddkS)Nrfrrr)r)replace)prr(r.r4sz.PyPIExtensionManager.install..rz!Fail to get installation report: exc_infoz Fail to get installation report.zActions to be executed by pip rN Executing ' 'r return code: stdout: stderr: download_infourlz.whlcSt|jdkSNz package.jsonrrfr(r(r.rS jupyterlabztar.gzcSrrrrr(r(r.r]rzFail to get package.json.frontend discoverykernelserverokstatus needs_restartFailed to installed : code  errorrmessage)+r9rxryrzrc executableappendcopyinsertr{rr r=r>stdoutdecoderrr)r r]r^stderrridumpsjoin returncoderSr<endswithrioBytesIOr?namelistreadr getnamesload extractfile getmemberrr)r_rrhrcmdline pkg_actiontmp_cmdresult action_inforrr jlab_metadata download_urlrAwheelr-sdist follow_upsrr(rr.rps         $                    zPyPIExtensionManager.installc stjj}tjddddd|g}d}zJ|}|d|dt t |ddIdH}t d d t d d |j d }t d d t t|D]}t|} | d}|dur[nqGWntyw} z|jjd| dWYd} ~ nd} ~ ww|jdd|d|dt t |ddIdH}|jd|j|jd|j d |jd } |jdkr|jd| dg} |dur|di} d| vr| dd| vr| dtd| dS|jd|d|jd | td!| d"S)#ajUninstall the required extension. Note: If the user must be notified with a message (like asking to restart the server), the result should be {"status": "warning", "message": ""} Args: extension: The extension name Returns: The action result rr uninstallz--yesrNTrcSs |dSr)rliner(r(r.r z0PyPIExtensionManager.uninstall..cSs|SN)striprr(r(r.rrrcSs |jdkSrrrr(r(r.rrrz%Fail to list files to be uninstalled.rrrrrrrrrrrrrrrrrrr)r9rxryrzrcrrremover{rr rmaprr splitlinesrr=r> read_bytesr)rir]r^rrrrrr)r_rlrrrrrlinesfilepathr-rrrrr(r(r.rvsn              zPyPIExtensionManager.uninstallcCs|ddddddS)zNormalize extension name. Remove `@` from npm scope and replace `/` and `_` by `-`. Args: name: Extension name Returns: Normalized name @r!rr)r)r_rr(r(r.rqs z$PyPIExtensionManager._normalize_name)NNNr)(__name__ __module__ __qualname____doc__rrrrZrrRrrdictr ConfigurablerPpropertyrrfstrrkrrsboolr r rrrQrrrrrrrrprrq __classcell__r(r(r`r.rC;s\"  FnIrC)2rrrr=rrrc xmlrpc.clientrTrrr functoolsr itertoolsrpathlibr subprocessr r tarfiler typingr r rrrrzipfilerr9 async_lrur traitletsrrrrrjupyterlab.extensions.managerrrrrrrrBrCr(r(r(r.s,