fndZddlmZededdlZddlZddlZddlZddlZddl Z ddlZddl m Z ddl m Z mZmZmZmZmZmZmZmZmZddl mZmZmZmZmZmZmZmZmZm Z ejBdjEgd Z#ejBd Z$ejBd Z%d Z&e jNZ(e jNd zZ)GddZ*GddZ+dZ,dZ-dZ.ejBdej^Z0ejBdej^Z1dZ2dZ3dZ4Gdde5Z6Gdde6Z7y)a6DEPRECATED: Input handling and transformation machinery. This module was deprecated in IPython 7.0, in favour of inputtransformer2. The first class in this module, :class:`InputSplitter`, is designed to tell when input from a line-oriented frontend is complete and should be executed, and when the user should be prompted for another line of code instead. The name 'input splitter' is largely for historical reasons. A companion, :class:`IPythonInputSplitter`, provides the same functionality but with full support for the extended IPython syntax (magics, system calls, etc). The code to actually do these transformations is in :mod:`IPython.core.inputtransformer`. :class:`IPythonInputSplitter` feeds the raw code to the transformers in order and stores the results. For more details, see the class docstrings below. )warnzeIPython.core.inputsplitter is deprecated since IPython 7 in favor of `IPython.core.inputtransformer2`N)List) leading_indentclassic_prompt ipy_prompt cellmagicassemble_logical_lineshelp_endescaped_commandsassign_from_magicassign_from_systemassemble_python_lines) ESC_SHELL ESC_SH_CAPESC_HELP ESC_HELP2 ESC_MAGIC ESC_MAGIC2 ESC_QUOTE ESC_QUOTE2 ESC_PAREN ESC_SEQUENCES|)z^\s+raise(\s.*)?$z^\s+raise\([^\)]*\).*$z^\s+return(\s.*)?$z^\s+return\([^\)]*\).*$z ^\s+pass\s*$z ^\s+break\s*$z^\s+continue\s*$z^([ \t\r\f\v]+)z^\s*\#cRtj|}|r|jSy)a Return the number of initial spaces in a string. Note that tabs are counted as a single space. For now, we do *not* support mixing of tabs and spaces in the user's input. Parameters ---------- s : string Returns ------- n : int r) ini_spaces_rematchend)s ini_spacess U/var/www/cvtools/html/venv/lib/python3.12/site-packages/IPython/core/inputsplitter.pynum_ini_spacesr!Os'$$Q'J~~ceZdZexZZdZy)IncompleteStringc<||_||_||_||_yNrstartrline)selfrr)rr*s r __init__zIncompleteString.__init__ls  r"N)__name__ __module__ __qualname__INCOMPLETE_STRINGtype exact_typer,r"r r%r%js))D:r"r%ceZdZexZZdZy)InMultilineStatementc<d|_|x|_|_||_yNr()r+posr*s r r,zInMultilineStatement.__init__ts ## TX r"N)r-r.r/IN_MULTILINE_STATEMENTr1r2r,r3r"r r5r5rs..D:r"r5c#jKtj|j}tjtj dddd} tj |D]}|y #tj$r}|jd}t|t|df}d|jdvrE|jx\}}}||dz |d dj||d z}t||||dn)d |jdvrt||dnYd }~y Yd }~y d }~wwxYww) a Iterate over tokens from a possibly-incomplete string of code. This adds two special token types: INCOMPLETE_STRING and IN_MULTILINE_STATEMENT. These can only occur as the last token yielded, and represent the two main ways for code to be incomplete. r8)r#rT)keependszmulti-line stringrr#Nzmulti-line statement)ioStringIOreadlinetokenize TokenInfoNEWLINEgenerate_tokens TokenError splitlineslenargsrjoinr%r5) rr@tokenelinesrlcr)s r partial_tokensrOys${{1~&&H   x//VVR HE--h7 EK      d +%j#eBi.( !&&) + 99 $DAq5ac 12qr!33A"1eS%)< < #qvvay 0&sE"I6 6  7 = s1AD3 A)(D3)D0._add_indents# R    " !r"r#N>passbreakraisereturncontinue)listrOr1rA ENDMARKERpopDEDENTrCCOMMENTr0iterINDENTrNLnextr) StopIterationr:r2LPARLSQBLBRACECOLON enumerateNAMEstringreversed) codetokensrVtokitertok last_indentlast_line_startsilast_line_tokenstnamesindentrUs @r find_next_indentr{sb .& 'F bz(,,,  ":??x0@0@(BRBRS S  ":??x0@0@(BRBRS Sbz++3L#6lG 889 9  #hh(++% DM//23 ""$Kbz00 ": X]]HMM8??$S S? " bz.Q' )FAsxx8+++#$q5  )""2"34#3Oaqvv7NOO U1X!QQ"<0 "K'!M " ?!  0Ps&J0"K<K0 J>=J>c\|sy|jd}|dk(xs|jS)zDetermine if the input source ends in a blank. A blank is either a newline or a line consisting of whitespace. Parameters ---------- src : string A single or multiline string. Fr=r8)rFisspace)srclls r last_blankrs/ u .. 2 B "H %%r"z \n\s*\n\s*$z .+\n\s*\n\s+$c|sydjdg|jddz}ttj |xstt j |S)zDetermine if the input source ends in two blanks. A blank is either a newline or a line consisting of whitespace. Parameters ---------- src : string A single or multiline string. F z### rWN)rIrFboollast_two_blanks_rerlast_two_blanks_re2)r~new_srcs r last_two_blanksrs` uii CNN$4RS$99:G #))'2 3 5 $**73 47r"c0tjdd|S)aRemove all comments from input source. Note: comments are NOT recognized inside of strings! Parameters ---------- src : string A single or multiline input string. Returns ------- String with all Python comments removed. z#.*r8)resub)r~s r remove_commentsrs 66%S !!r"cDttjdd}|d}|S)zcReturn the default standard input encoding. If sys.stdin has no encoding, 'ascii' is returned.encodingNascii)getattrsysstdin)rs r get_input_encodingr s& syy*d3H Or"ceZdZUdZdZdZdZdZee e d<e je d<dZ dZdd Zd Zd Zd Zd e defdZdZdZeeZddZdZy) InputSplittera$An object that can accumulate lines of Python source before execution. This object is designed to be fed python source line-by-line, using :meth:`push`. It will return on each push whether the currently pushed code could be executed already. In addition, it provides a method called :meth:`push_accepts_more` that can be used to query whether more input can be pushed into a single interactive block. This is a simple example of how an interactive terminal-based client can use this tool:: isp = InputSplitter() while isp.push_accepts_more(): indent = ' '*isp.indent_spaces prompt = '>>> ' + indent line = indent + raw_input(prompt) isp.push(line) print 'Input source was:\n', isp.source_reset(), NNr8N_buffer_compileFr\cbg|_tj|_t |_y)z$Create a new InputSplitter instance.N)rcodeopCommandCompilerrrrr+s r r,zInputSplitter.__init__Ls# ..0 *, r"cZg|jddd|_d|_d|_d|_yz,Reset the input buffer and associated state.Nr8F)rsourcerp _is_complete _is_invalidrs r resetzInputSplitter.resetRs- Q  ! r"c>|j}|j|S)z:Return the input source and perform a full reset. )rrr+outs r source_resetzInputSplitter.source_resetZskk  r"cr|j |j||jr |jy|jr"d|j f|jS |jy#t $rY|jywxYw#|jwxYw)akReturn whether a block of code is ready to execute, or should be continued This is a non-stateful API, and will reset the state of this InputSplitter. Parameters ---------- source : string Python input code, which can be multiline. Returns ------- status : str One of 'complete', 'incomplete', or 'invalid' if source is not a prefix of valid code. indent_spaces : int or None The number of spaces by which to indent the next line of code. If status is not 'incomplete', this is None. )invalidN incomplete)completeN)rpushrpush_accepts_moreget_indent_spaces SyntaxError)r+rs r check_completezInputSplitter.check_completeas&   IIf  & JJL '')#T%;%;%== JJL( JJL ## JJL # JJLs.B B$!B$ B!B$ B!!B$$B6rLc*t|tsJ|j||j}d\|_|_d|_|jdry tj5tjdt|j|d|_ddd|jdu|_|j S#1swY(xYw#tttt t"tf$rd|_d|_Y|j SwxYw) aPush one or more lines of input. This stores the given lines and returns a status code indicating whether the code forms a complete Python block or not. Any exceptions generated in compilation are swallowed, but if an exception was produced, the method returns True. Parameters ---------- lines : string One or more lines of Python input. Returns ------- is_complete : boolean True if the current input source (the result of the current input plus prior inputs) forms a complete Python execution block. Note that this value is also stored as a private attribute (``_is_complete``), so it can be queried at any time. rFz\ errorexec)symbolNT) isinstancestr_storerrprrendswithwarningscatch_warnings simplefilter SyntaxWarningrr OverflowError ValueError TypeError MemoryError)r+rLrs r rzInputSplitter.pushs,%%%% E (2$ 4$  ??6 " 6((* A%%g}= MM&M@  A!%  5D    # A A]J ], $ $D #D      $s*C-3C CC C1DDc|jsy|jjd}|r|jry|j dk(rt |jjdkry t jdj|j}t |jdk(rt|jddsyyy#t$rYywxYw)aReturn whether a block of interactive input can accept more input. This method is meant to be used by line-oriented frontends, who need to guess whether a block is complete or not based solely on prior and current input lines. The InputSplitter considers it has a complete interactive block and will not accept more input when either: * A SyntaxError is raised * The code is complete and consists of a single line or a single non-compound statement * The code is complete and has a blank line at the end If the current input produces a syntax error, this method immediately returns False but does *not* raise the syntax error exception, as typically clients will want to send invalid syntax to an execution backend which might convert the invalid syntax into valid Python via one of the dynamic IPython mechanisms. Tr=Frr#r8body) rrrFr}rrGastparserIrrhasattr Exception)r+ last_linecode_asts r rzInputSplitter.push_accepts_mores0  KK**,R0 i//1  ! ! #q (4;;))+,1 !99RWWT\\%:; x}}%*(/ a0@&(I   s9.C C'&C'c|j\}}||jk(r|St|jdd}|j|f|_|SrR)_indent_spaces_cacherr{)r+ sourceforrTs r rzInputSplitter.get_indent_spacessO00 1  #H T[["- .%)[[!$4!r"c| |j}|jdr|j|n|j|dzt|||j |y)zStore one or more lines of input. If input lines are not newline-terminated, a newline is automatically appended.Nr)rrrSsetattr _set_source)r+rLbufferstores r rzInputSplitter._storesQ >\\F >>$  MM% MM%* %eT--f56r"c$dj|Sr7)rI)r+rs r rzInputSplitter._set_sourcesxxr")r\N)Nr)r-r.r/__doc__rrrrprr__annotations__rrrrr,rrrrrrrproperty indent_spacesrrr3r"r rrs2&HF D #Y$$$LK- !"H6!6!6!p5n./M 7 r"rceZdZdZdZdZdZdZ dfd Ze dZ e dZ fdZ d Z d Zd Zfd Zd Zdedeffd ZdZxZS)IPythonInputSplitterzBAn input splitter that recognizes all of IPython's special syntax.r8FNc|tt| g|_d|_|||_n-t ttt|g|_t|_ |||_ n+ttttg|_ t!|_|||_yg|_y)NT)end_on_blank_line)superrr, _buffer_raw _validatephysical_line_transformsrrrrr logical_line_transformsr r r r rpython_line_transforms)r+line_input_checkerrrr __class__s r r,zIPythonInputSplitter.__init__)s "D24 # /,DD ).<-=-;-=-7\-6I[-\ -.D )'=&># " .+BD (-5J,<,>,=,?,>,@ ,-D (&;%<" ! -*@D '+-D 'r"c|j|jgz|jz|jgz|jzS)z!Quick access to all transformers.)rr rrrrs r transformszIPythonInputSplitter.transformsKsS,,  ( ( )*,0,H,HI  ' ' (),0,G,GH Hr"c|jdd}|js||jg|jzz }||jgz|j zS)zTTransformers, excluding logical line transformers if we're in a Python line.N)rwithin_python_liner rrr)r+rxs r transforms_in_usez&IPythonInputSplitter.transforms_in_useRsZ  ) )! ,&& $--.1M1MM MAD..//$2M2MMMr"ctt| g|jddd|_d|_d|_|jD]} |jy#t$rY"wxYwr) rrrr source_rawtransformer_accumulatingrrr)r+rxrs r rzIPythonInputSplitter.reset[so "D/1 (-%"' A     sA A'&A'cd}g}|jD] }|||} t|}|r!|jdj|yy)Nc3K|D]/}|jD]}|j|}||1|j}||yyw)a)yield transformed lines always strings, never None transform: the current transform outs: an iterable of previously transformed inputs. Each may be multiline, which will be passed one line at a time to transform. N)rFrr) transformoutsrr*tmps r _flushz7IPythonInputSplitter.flush_transformers.._flushlsb "NN,"D#...C! " "//#C s ,A Ar)rr^rrI)r+rrrxs r flush_transformersz'IPythonInputSplitter.flush_transformersksU ,'' !AC.C !3i  KK # ' r"c>|j}|j|S)z8Return raw input only and perform a full reset. )rrrs r raw_resetzIPythonInputSplitter.raw_resetsoo  r"c |j|j|jS#|jwxYwr')rrrrs r rz!IPythonInputSplitter.source_resets-   # # %;; JJLDJJLs .AcB|jrytt|SNT)rrrr)r+rs r rz&IPythonInputSplitter.push_accepts_mores  ( (-tFH Hr"c|j |j||j|j|jS#|jwxYw)z/Process and translate a cell of input. )rrrr)r+cells r transform_cellz#IPythonInputSplitter.transform_cellsC   IIdO  # # %;; JJLDJJLs ,AA!rLr\c6t|tsJ|j}|sdg}|j||jdg}|D]'}|j |}||j |)|r$dj|}tt|+|Sy)aJPush one or more lines of IPython input. This stores the given lines and returns a status code indicating whether the code forms a complete Python block or not, after processing all input lines for special IPython syntax. Any exceptions generated in compilation are swallowed, but if an exception was produced, the method returns True. Parameters ---------- lines : string One or more lines of Python input. Returns ------- is_complete : boolean True if the current input source (the result of the current input plus prior inputs) forms a complete Python execution block. Note that this value is also stored as a private attribute (_is_complete), so it can be queried at any time. r8rrF) rrrFrr_transform_linerSrIrrr)r+rL lines_listtransformed_lines_listr* transformedtransformed_linesrs r rzIPythonInputSplitter.pushs.%%%%%%' J E4++\:!# ;D..t4K&&--k: ; " $ *@ A -t9:KL Lr"cfd}jD]}|j|}|||cSjsSjj|}||dSjD]}|j|}|||cSj j|}|d_|dSd_j D]}|j|}|||cSd_|S)zPush a line of input code through the various transformers. Returns any output from the transformers, or None if a transformer is accumulating lines. Sets self.transformer_accumulating as a side effect. cd_yr)r)dbgr+s r _accumulatingz;IPythonInputSplitter._transform_line.._accumulatings,0D )r"zacc logical lineTzacc python lineF)rrrr rrrr)r+r*r transformers` r rz$IPythonInputSplitter._transform_lines#   88 2K##D)D|$[11 2 &&..33D9D|$%788#;; 6 "''-<(55 6 ))..t4 <&*D # !23 3&+D #66 2K##D)D|$[11 2 ).% r")TNNN)r-r.r/rrrrrr,rrrrrrrrrrrrr __classcell__)rs@r rrsLJ % KIMIM -DHH NN (>I ///b*r"r)8rrrDeprecationWarningrrr>rrrAtypingrIPython.core.inputtransformerrrrrr r r r r rrrrrrrrrrrcompilerI dedent_rercomment_line_rer!N_TOKENSr0r:r%r5rOr{r MULTILINErrrrrobjectrrr3r"r r sD$l   - - -YYY BJJsxx!   -. "**Y',%%!**Q.2:z & RZZ = bjj!12<<@7."$ z Fz zn=nr"