@'h6dZddlmZddlZddlmZddlmZmZm Z m Z m Z ddl m Z ddlmZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZmZmZm Z m!Z!m"Z"ddl#m$Z$ddl%m&Z&ddl'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1ddl2m3Z3Gddee"Z4dddd d#dZ5d$dZ6d%dZ7de8ee8e!ddd d&dZ9e dddde8ee8e!ddf d'd Z:de8ee8e!dddd! d(d"Z;y))z@LLM Chain for turning a user text query into a structured query.) annotationsN)Sequence)AnyCallableOptionalUnioncast) deprecated)OutputParserException)BaseLanguageModel)BaseOutputParser)parse_and_check_json_markdown)BasePromptTemplate)FewShotPromptTemplate)Runnable) Comparator ComparisonFilterDirective OperationOperatorStructuredQuery)LLMChain) get_parser) DEFAULT_EXAMPLESDEFAULT_PREFIXDEFAULT_SCHEMA_PROMPTDEFAULT_SUFFIXEXAMPLE_PROMPTEXAMPLES_WITH_LIMITPREFIX_WITH_DATA_SOURCESCHEMA_WITH_LIMIT_PROMPTSUFFIX_WITHOUT_DATA_SOURCEUSER_SPECIFIED_EXAMPLE_PROMPT) AttributeInfocTeZdZUdZded< ddZe d d dZy) StructuredQueryOutputParserz-Output parser that parses a structured query.r ast_parsec  ddg}gd}t||}|dt|ddk(rd|d<|ddk(s|dsd|d<n|j|d|d<|jds|j ddt d i|j Dcic] \}}||vs ||c}}Scc}}w#t$r}td|d |d}~wwxYw) Nqueryfilter)r)r*limitr NO_FILTERr+z Parsing text z raised following error: ) rlenr'getpopritems Exceptionr )selftext expected_keys allowed_keysparsedkves n/home/kushmeetdev/Regenta/Chatbot/venv/lib/python3.12/site-packages/langchain/chains/query_constructor/base.pyparsez!StructuredQueryOutputParser.parse1s $h/M7L24GFg&#fWo*>!*C"%wh;.fX6F#'x #'>>&2B#Cx ::g& 7D)"$*LLNHDAqa<6G1a4H H ' &B1#F  s0BB6 B0%B0*B60B66 C?CCNc`|r dfd }ntj}||S)z Create a structured query output parser from components. Args: allowed_comparators: allowed comparators allowed_operators: allowed operators Returns: a structured query output parser cttttj |}t |}|S)Nallowed_comparatorsallowed_operatorsallowed_attributes)r rrrr=fix_filter_directive) raw_filterr*fixedrCrArBs r<r'z>StructuredQueryOutputParser.from_components..ast_parse[s>h79K9KJ9WX,(;&7'9   r@)r')rEstrreturnOptional[FilterDirective])rr=)clsrArBrC fix_invalidr's ``` r<from_componentsz+StructuredQueryOutputParser.from_componentsFs>&   #$7"3#5e  Y''rG)r5rHrIr)NNNF) rAOptional[Sequence[Comparator]]rBOptional[Sequence[Operator]]rCOptional[Sequence[str]]rLboolrIr&)__name__ __module__ __qualname____doc____annotations__r= classmethodrMr.rGr<r&r&+sf7S*?C:>6:! $(;$(8$(4 $(  $( % $($(rGr&r@c |s|s|r|s|St|tr$|r|j|vry|r|j|vry|St|tr|r|j |vry|j Dcgc]!}|ttt||||#}}|syt|dk(r1|j tjtjfvr|dSt |j |S|Scc}w)ahFix invalid filter directive. Args: filter: Filter directive to fix. allowed_comparators: allowed comparators. Defaults to all comparators. allowed_operators: allowed operators. Defaults to all operators. allowed_attributes: allowed attributes. Defaults to all attributes. Returns: Fixed filter directive. Nr@r)operator arguments) isinstancer comparator attributerrZr[r rrDr/rANDOR)r*rArBrCargargss r<rDrDns&!$59K  FJ ' 6#4#4 F FsD QQrGcg}t|D]Y\}\}}tj|djddjdd}|dz||d}|j |[|S) zConstruct examples from input-output pairs. Args: input_output_pairs: Sequence of input-output pairs. Returns: List of examples. rerfrhrirjrkrY)rr user_querystructured_request) enumeratermrnroappend)input_output_pairsexamplesrr_inputoutputrwexamples r<construct_examplesrsH();< ! FF JJva ( 0 0d ; C CC N Q "4    ! OrGFr{rArB enable_limit schema_promptc >|rtnt}|xs|}t|} |jdj |dj |} |r_t |dt rLt|}t} tj| || } tjt|dz} nR|xs|rtnt}t} tj| } t!jt|dz|| } t#d t%|| d g| | d |S) a#Create query construction prompt. Args: document_contents: The contents of the document to be queried. attribute_info: A list of AttributeInfo objects describing the attributes of the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. allowed_operators: Sequence of allowed operators. enable_limit: Whether to enable the limit operator. Defaults to False. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. kwargs: Additional named params to pass to FewShotPromptTemplate init. Returns: A prompt template that can be used to construct queries. z | )rArBr)schemacontent attributesrY)rr)r)rrrrr))r{example_promptinput_variablessuffixprefixr.)r!rrtformatjoinr\tuplerr#r r"r/rrrrrrlist)document_contentsattribute_infor{rArBrrkwargsdefault_schema_prompt attribute_strrrrrs r<get_query_constructor_promptrs-:%1 6K":%:M*>:M  ! !!JJ':;**%67"FJx{E2%h/6(//#4 ,22S]Q5FG #/ 5E (&&f5&&(ma):}  ! h%      rGz0.2.13load_query_constructor_runnablez1.0)since alternativeremovalc t|||||||} g} |D]2} | jt| tr | jn| d4t j ||| } | | _td|| | d|S)aSLoad a query constructor chain. Args: llm: BaseLanguageModel to use for the chain. document_contents: The contents of the document to be queried. attribute_info: Sequence of attributes in the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. Defaults to all Comparators. allowed_operators: Sequence of allowed operators. Defaults to all Operators. enable_limit: Whether to enable the limit operator. Defaults to False. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. **kwargs: Arbitrary named params to pass to LLMChain. Returns: A LLMChain that can be used to construct queries. rrdr@)llmprompt output_parserr.) rryr\r$rdr&rMrr) rrrr{rArBrrrrrCainfors r<load_query_constructor_chainrsD*/+!#F !!$UM:EJJf   0??/+-@M )F  RF- R6 RRrG)r{rArBrrrLc t||f|||||d| } g} |D]2} | jt| tr | jn| d4t j ||| |} | |z| zS)aLoad a query constructor runnable chain. Args: llm: BaseLanguageModel to use for the chain. document_contents: Description of the page contents of the document to be queried. attribute_info: Sequence of attributes in the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. Defaults to all Comparators. allowed_operators: Sequence of allowed operators. Defaults to all Operators. enable_limit: Whether to enable the limit operator. Defaults to False. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. fix_invalid: Whether to fix invalid filter directives by ignoring invalid operators, comparators and attributes. kwargs: Additional named params to pass to FewShotPromptTemplate init. Returns: A Runnable that can be used to construct queries. rrd)rArBrCrL)rryr\r$rdr&rM)rrrr{rArBrrrLrrrCrrs r<rr@sD* /+!#   F !!$UM:EJJf   0??/+- @M C<- ''rG) r*rJrArNrBrOrCrPrIrJ)rp$Sequence[Union[AttributeInfo, dict]]rIrH)rzzSequence[tuple[str, dict]]rIz list[dict])rrHrrr{Optional[Sequence]rASequence[Comparator]rBSequence[Operator]rrQrOptional[BasePromptTemplate]rrrIr)rr rrHrrr{zOptional[list]rArrBrrrQrrrrrIr)rr rrHrrr{rrArrBrrrQrrrLrQrrrIr)rsbF" $77*;<:L5A-*@   D@("2?"C@(L;?6:26 7 %7874 7 0 7  7tR6$(05j0A,1(O26<<8<! < . < * <<0<<<~ 1  $05j0A,1(O262S 2S2S92S 2S . 2S * 2S2S02S2S2S  2St$(05j0A,1(O267( 7(7(97( ! 7( . 7(*7(7(07(7(7(7(rG