o iD@sddlZddlZddlZddlZddlZddlZddlmZddlmZm Z m Z ddl m Z m Z mZmZmZmZmZmZmZmZmZddlmZerzddlmZGdd d e ZeeefZejdd krweeeeeefeeefefZ nej Z d d Z!Gd dde"ddZ#ejdkrej$Z%nGdddZ%dNddZ&dNddZ'ejdkrddZ(nddZ(ddZ)ddZ*dd Z+d!d"eej,DZ-d#d$Z.d%d"eej,DZ/d&d"eej,Dhd'BZ0d(d)Z1d*d+Z2d,d-Z3d.d/Z4d0d1Z5d2d3Z6d4d5Z7e8Z9d6d7Z:d8d9Z;d:d;Zd?Z>nd@d?Z>dAdBZ?dCdDZ@ejdd dEkrOddFlAmBZBeBddGdHdIZCdJdKZDdSdLdIZCdMdKZDdS)ON)ABCMeta)ModuleexprAST) CallableDictIterableIteratorListOptionalTupleUnioncastAny TYPE_CHECKING) iteritems)NodeNGc@seZdZdZdZdZdS) EnhancedASTNr)__name__ __module__ __qualname__ first_token last_tokenlinenorrI/var/www/edux/Edux_v2/venv/lib/python3.10/site-packages/asttokens/util.pyr!srcCsdtj|t|dfS)zRReturns a human-friendly representation of a token with the given type and string.z%s:%su)tokentok_namereprlstrip)tok_typestringrrr token_repr/sr%c@seZdZdZddZdS)Tokena TokenInfo is an 8-tuple containing the same 5 fields as the tokens produced by the tokenize module, and 3 additional ones useful for this module: - [0] .type Token type (see token.py) - [1] .string Token (a string) - [2] .start Starting (row, column) indices of the token (a 2-tuple of ints) - [3] .end Ending (row, column) indices of the token (a 2-tuple of ints) - [4] .line Original line (string) - [5] .index Index of the token in the list of tokens that it belongs to. - [6] .startpos Starting character offset into the input text. - [7] .endpos Ending character offset into the input text. cCst|j|jSN)r%typer$selfrrr__str__Dsz Token.__str__N)rrr__doc__r+rrrrr&6s r&z0type string start end line index startpos endpos)c@seZdZeZdS) AstConstantN)rrrobjectvaluerrrrr/Ls r/cCs|j|ko |dup |j|kS)zVReturns true if token is of the given type and, if a string is given, has that string.N)r(r$rr#tok_strrrr match_tokenPsr4cCs>t|||stdt||t||jd|jddfdS)z Verifies that the given token is of the expected type. If tok_str is given, the token string is verified too. If the token doesn't match, raises an informative ValueError. z+Expected token %s, got %s on line %s col %srrN)r4 ValueErrorr%strstartr2rrr expect_tokenVs r8)r-cCs|tjtjtjfvSzW These are considered non-coding tokens, as they don't affect the syntax tree. )rNLCOMMENTENCODING token_typerrris_non_coding_tokendsr@cCs |tjkSr:)rN_TOKENSr>rrrr@ks cCs tttgtft|jS)z; Generates standard library tokens for the given code. )tokenizegenerate_tokensrrr6ioStringIOreadline)textrrrrCss rCcCst|drtStS)z Returns a function which yields all direct children of a AST node, skipping children that are singleton nodes. The function depends on whether ``node`` is from ``ast`` or from the ``astroid`` module. get_children)hasattriter_children_astroiditer_children_astnoderrriter_children_func~srNcCst|rgS|Sr') is_joined_strrHrLrrrrJsrJc Cs<h|]\}}t|trt|tjtjtjtjtjfr|qSr) isinstancer( issubclassast expr_contextboolopoperatorunaryopcmpop.0ncrrr s r\ccsnt|rdSt|tjr%t|j|jD]\}}|dur|V|VqdSt|D] }|jt vr4|Vq*dSr') rOrPrRrzipkeysvaluesiter_child_nodes __class__ SINGLETONS)rMkeyr1childrrrrKs  rKcC*h|]\}}t|trt|tjr|qSr)rPr(rQrRstmtrXrrrr\   cCrer)rPr(rQrRrrXrrrr\rg>ConstDelAttrDelName AssignAttr AssignNamecC |jjtvS)z+Returns whether node is an expression node.)rarexpr_class_namesrLrrris_expr rocCrm)z)Returns whether node is a statement node.)rarstmt_class_namesrLrrris_stmtrprrcC |jjdkS)z&Returns whether node is a module node.rrarrLrrr is_modulerprucCrs)zFReturns whether node is a JoinedStr node, used to represent f-strings. JoinedStrrtrLrrrrOs rOcCrs)z2Returns whether node is a starred expression node.StarredrtrLrrr is_starredrprxcCs0|jjdvp|jjdkotttttj|jS)z?Returns whether node represents a slice, e.g. `1:2` in `x[1:2]`)SliceExtSlicer ) raranymapis_slicerrRr eltsrLrrrr}s  r}cCsB|jjdko t|tj o |j|juo|juoduSS)Nry)rarrPrRrloweruppersteprLrrris_empty_astroid_slices   rcCs|sdd}t|}t}d}|dtfg}|r^|\}}} | turQ||vs(J|||||\} } |||| ft|} ||D] } || | | tfqDn |||tt t | }|s|S)a5 Scans the tree under the node depth-first using an explicit stack. It avoids implicit recursion via the function call stack to avoid hitting 'maximum recursion depth exceeded' error. It calls ``previsit()`` and ``postvisit()`` as follows: * ``previsit(node, par_value)`` - should return ``(par_value, value)`` ``par_value`` is as returned from ``previsit()`` of the parent. * ``postvisit(node, par_value, value)`` - should return ``value`` ``par_value`` is as returned from ``previsit()`` of the parent, and ``value`` is as returned from ``previsit()`` of this node itself. The return ``value`` is ignored except the one for the root node, which is returned from the overall ``visit_tree()`` call. For the initial node, ``par_value`` is None. ``postvisit`` may be None. cSdSr'r)rMpvaluer1rrrszvisit_tree..N) rNset _PREVISITpopaddappendleninsertrr r&)rMprevisit postvisit iter_childrendoneretstackcurrent par_valuer1r post_valueinsrZrrr visit_trees(    rccslt|}t}|g}|r4|}||vsJ|||Vt|}||D]}|||q'|s dSdS)a Recursively yield all descendant nodes in the tree starting at ``node`` (including ``node`` itself), using depth-first pre-order traversal (yieling parents before their children). This is similar to ``ast.walk()``, but with a different order, and it works for both ``ast`` and ``astroid`` trees. Also, as ``iter_children()``, it skips singleton nodes generated by ``ast``. N)rNrrrrr)rMrrrrrr[rrrwalks     rcCsXd}g}t|D]\}}}|||||||}q|||dd|S)ah Replaces multiple slices of text with new values. This is a convenience method for making code modifications of ranges e.g. as identified by ``ASTTokens.get_text_range(node)``. Replacements is an iterable of ``(start, end, new_text)`` tuples. For example, ``replace("this is a test", [(0, 4, "X"), (8, 9, "THE")])`` produces ``"X is THE test"``. rN)sortedrjoin)rG replacementsppartsr7endnew_textrrrreplace0s   rc@s eZdZdZddZddZdS) NodeMethodsz[ Helper to get `visit_{node_type}` methods given a node's class and cache the results. cCs i|_dSr')_cacher)rrr__init__Hs zNodeMethods.__init__cCs:|j|}|sd|j}t|||j}||j|<|S)z Using the lowercase name of the class as node_type, returns `obj.visit_{node_type}`, or `obj.visit_default` if the type-specific method is not found. visit_)rgetrrgetattr visit_default)r*objclsmethodnamerrrrLs  zNodeMethods.getN)rrrr,rrrrrrrDs rcCst|Sr')iter)original_tokensrrrpatched_generate_tokens]srccs|g}|D],}|jtjtjtjfvr"|r|dj|jkr"||qt|D]}|Vq&g}|Vqt|D]}|Vq6dS)a Fixes tokens yielded by `tokenize.generate_tokens` to handle more non-ASCII characters in identifiers. Workaround for https://github.com/python/cpython/issues/68382. Should only be used when tokenizing a string that is known to be valid syntax, because it assumes that error tokens are not actually errors. Combines groups of consecutive NAME, NUMBER, and/or ERRORTOKEN tokens into a single NAME token. N) r(rBNAME ERRORTOKENNUMBERrr7rcombine_tokens)rgrouptokcombined_tokenrrrras    cCsftdd|Drtdd|Ddkr|Stjtjddd|D|dj|d j|djd gS) Ncss|] }|jtjkVqdSr')r(rBrrYrrrr |sz!combine_tokens..cSsh|]}|jqSr)linerrrrr\|sz!combine_tokens..rrcss|]}|jVqdSr')r$)rYtrrrrsrr)r(r$r7rr) r{rrB TokenInforrr7rr)rrrrrzs(rcCs(ddt|D}|rt|dS|S)zq If the given AST node contains multiple statements, return the last one. Otherwise, just return the node. c Ss,g|]}t|tjtjttddfr|qS) match_caser)rPrRrf excepthandlerr)rYrdrrr s zlast_stmt..r)rRr` last_stmt)rM child_stmtsrrrrs  r)r-) lru_cache)maxsizecsbdt}ddt|D}dd|D}tt|t|k}tfdd|D}|o0|S)a The positions attached to nodes inside f-string FormattedValues have some bugs that were fixed in Python 3.9.7 in https://github.com/python/cpython/pull/27729. This checks for those bugs more concretely without relying on the Python version. Specifically this checks: - Values with a format spec or conversion - Repeated (i.e. identical-looking) expressions - Multiline f-strings implicitly concatenated. z( f"a {b}{b} c {d!r} e {f:g} h {i:{j}} k {l:{m:n}}" f"a {b}{b} c {d!r} e {f:g} h {i:{j}} k {l:{m:n}}" f"{x + y + z} {x} {y} {z} {z} {z!a} {z:z}" )cSsg|] }t|tjr|qSr)rPrRNamerYrMrrrrsz*fstring_positions_work..cSsg|]}|j|jfqSr)r col_offsetrrrrrsc3s"|] }t||jkVqdSr')rRget_source_segmentidrsourcerrrs  z)fstring_positions_work..)rRparserrrall)tree name_nodesname_positionspositions_are_uniquecorrect_source_segmentsrrrfstring_positions_works  rcCst|D];}t|tjs q|jD].}t|ddt|tjr>ts/t|jD]}t|ddq&|j r>t|j ddt |j qqdS)z Add a special attribute `_broken_positions` to nodes inside f-strings if the lineno/col_offset cannot be trusted. _broken_positionsTN) rrPrRrvr_setattrFormattedValuerr1 format_specannotate_fstring_nodes)r joinedstrpartrdrrrrs      rcCsdS)NFrrrrrrcCrr'r)_treerrrrrr')ErR collectionsrDsysrrBabcrrrrtypingrrrr r r r r rrrsixrastroid_compatrrAstNode version_infointr6rr% namedtupler&Constantr/r4r8r@rCrNrJ__dict__rbrKrqrnrorrrurOrxr}rr0rrrrrrrr functoolsrrrrrrrsx 4   $        ,