Lj`UddlZddlmZmZddlmZmZddlmZm Z m Z ddl Z gdZ ejeZe dZe dZeee j&efefZeeefZeezZeGdd ZeeeeegeefZeGd d ZeZeed <iaee eefe jBjDfed <ee eefeefZ#ia$e#ed<eeee eeffZ%ia&e%ed<ia'e%ed<ia(e%ed<deeezdzdeeezdzdeeezdzde)e eeffdZ*ddde+ddfdZ,dedede jBjDfdZ-de jBjDdededdfd Z.d!eeezdzdeefd"Z/dddd#d$eeezdzd%eeezdzd&eeezdzddfd'Z0dddd(d)eeezdzd*eeezdzd+eeezdzddfd,Z1d-edeefd.Z2d-ededed/e eefddf d0Z3ddd1d2ed3ededed4eezd5e+d6e+ddfd7Z4dd8d9eed:eed;e+de+fd<Z5dd=deded>eed?edzddf d@Z6ddddAdBedCe)e eefdzdDe+d?edzddf dEZ7dd=deded>eed?edzddf dFZ8dPdGZ9ddHdIedDe+ddfdJZ:ddHdKeeeege+fdDe+ddfdLZ;ddHdMeeege+fdNedDe+ddfdOZ>T-- -    3 3 3r# dsl_namesN op_symbols dispatch_keys remove_keysc|rv|xjtt|zc_|xjtt|zc_|xjtt|zc_y|xjtt|zc_|xjtt|zc_|xjtt|zc_y)a Update filter sets as (current | new) or (current ~ new). Args: dsl_names: DSL names to add/remove from filter op_symbols: Operation symbols to add/remove from filter dispatch_keys: Dispatch keys to add/remove from filter remove_keys: If True, remove keys from filter; if False, add them Note: Uses set.discard as it doesn't raise an exception if the element wasn't in the set to begin with. N)r(set_resolve_iterabler)r*)r.r0r1r2r3s r$updatez_FilterState.updateIs(  OOs#4Y#?@ @O   $5j$A B B    3'8'G#H H  OOs#4Y#?@ @O   $5j$A B B    3'8'G#H H r#cXt|j|j|jS)z Build a set of dictionary keys based on the current filter state. Returns: set[tuple[str, str]]: Set of (op_symbol, dispatch_key) tuples )_build_key_setr(r)r*)r.s r$build_disable_key_setz"_FilterState.build_disable_key_setfs* OO        r#c(d}|dz }|dz }t|jD]\}}|d|d|dz }|dz }t|jD]\}}|d|d|dz }|dz }t|jD]\}}|d|d|dz }|S) z-Return string representation of filter state.zFilter State: z === DSL: ===  z:  z === OP SYMBOL: === z === DISPATCH KEYS: === ) enumerater(r)r*)r.sidslopkeys r$__str__z_FilterState.__str__ss   0 %FAs 4s"SE$ $A % %%t//0 $EAr 4s"RD# #A $ )) 3 34 %FAs 4s"SE$ $A %r#)F)rrrrrr5r(rrr)r*rr!r/rr7tupler:rEr"r#r$r&r&,s5 5JC5!#6KS6$S9NCH9-D4" I#&-I(3-'$.IXc]*T1 I  I  I:  s5c?';  r#r& _filter_state_libs_graphs_dsl_name_to_lib_graph_dispatch_key_to_lib_graph_op_symbol_to_lib_graphr0r1r2r,ctdtttzdzdtddffd }||t||t ||t S)aK Build a set of dictionary keys based on filter criteria. Args: dsl_names: DSL names to include in key set op_symbols: Operation symbols to include in key set dispatch_keys: Dispatch keys to include in key set Returns: set[tuple[str, str]]: Set of (op_symbol, dispatch_key) tuples entriesNgraph_lib_dictr,cjt|}|D]"}||vs||D]}j|$y)z;Helper to add matching keys from graph_lib_dict to key_set.N)r6add)rNrOresolved_entriesentryrDkey_sets r$_append_to_setz&_build_key_set.._append_to_setsG-W5% %E&)%0%CKK$% %r#)r5rr _MappingTyperJrLrK)r0r1r2rUrTs @r$r9r9s_ %(EG %x}$t+ %=I %  %945:67="<= Nr#F)print_inactiverWc$tjD]y\\}}}td|d|t|D]R\}}|js|sd|d|j d|j }|r|d|jz }t|T{y)z~ Print all override graphs for debugging purposes. Args: print_inactive: Whether to print inactive nodes zop=z, key=r=z: node.dsl_name=z, node.unconditional_override=z node.active=N)rIitemsprintr?rrr)rWrCrD node_listrAr+r@s r$_print_override_graphsr\s!(   S9 Wv + GAt{{ns"3T]]$44St7R7R6TU!>T[[N++Aa   r#rrc|||f}|tvr(tjjdd|t|<t|S)z Get or create a torch.library.Library instance for the given key. Args: op_symbol: The operation symbol dispatch_key: The dispatch key Returns: torch.library.Library: The library instance atenIMPL)rHtorchlibraryLibrary)rrrDs r$_get_or_create_libraryrcs< l #C %]]**66<Hc :r#libr+cn|j|j|j||j dy)z Register a single node implementation with the library. Args: lib: The torch.library.Library instance node: The override node to register dispatch_key: The dispatch key for registration T) with_keysetallow_overrideN)implrrr)rdr+rs r$_register_node_implris7HH  333  r#iterablecT|gSt|trt|tr|fS|S)z Resolve various input types to a consistent iterable of strings. Args: iterable: String, iterable of strings, or None Returns: Iterable[str]: Consistent iterable output ) isinstancerr)rjs r$r6r6s/ h )Z#-F{ Or#)enable_dsl_namesenable_op_symbolsenable_dispatch_keysrmrnroctjd|||tj|||dt |||}|D]*}|\}}|t vst ||t |t,y)as Re-enable overrides by removing them from filter state and reregistering. Args: enable_dsl_names: DSL names to re-enable enable_op_symbols: Operation symbols to re-enable enable_dispatch_keys: Dispatch keys to re-enable Note: This function uses reverse filter state management (removing from filters to enable). z>Re-registering ops by dsl: %s, op_symbol: %s, dispatch_key: %sT)r3 filter_stateN)loginforGr7r9rI_register_overrides_from_graph)rmrnrorTrDrrs r$r r s$HHH  %3%G"% < '> +<M  r#)disable_dsl_namesdisable_op_symbolsdisable_dispatch_keysrvrwrxctjd|||tj|||tj }|D]*}|\}}|t vst ||t |t,y)ag De-register overrides by updating filter state and reregistering graphs. Args: disable_dsl_names: DSL names to disable disable_op_symbols: Operation symbols to disable disable_dispatch_keys: Dispatch keys to disable Note: This function uses filter state management to selectively disable operations. z>De-registering ops by dsl: %s, op_symbol: %s, dispatch_key: %srqN)rsrtrGr7r:rI_cleanup_and_reregister_graph)rvrwrxrTrDrrs r$rr=s}$HHH *,>@UV%2$G$G$IG "% < '> ) *   r#rct}tjD]1\\}}}|D]$}|j|k(s|j |13t |S)zGet list of operations registered by a specific DSL. Args: dsl_name: Name of the DSL to query. Returns: Sorted list of operation names registered by the DSL. )r5rIrYrrQsorted)r operationsr_nodesr+s r$rris`J!(A D}}(y)  * r#rDcdttttttffdtdtttfddfd}|t|||t |||t ||y)z Update the registration mapping dictionaries. Args: dsl_name: The DSL name op_symbol: The operation symbol dispatch_key: The dispatch key key: The dictionary key tuple registrationsymbolrDr,Nc^|j|}| |g}|||<y|j|y)z;Helper to add key to registration list or create new entry.N)getappend)rrrD entry_lists r$_get_new_entry_or_appendz;_update_registration_maps.._get_new_entry_or_appends9 "%%f-  J#-L   c "r#)dictrlistrFrJrLrK)rrrrDrs r$_update_registration_mapsr{ss& #3U38_ 556 # #38_ #  #3XsC4iE7sKr#)allow_multiple_overriderbackend lib_symbolrhrrc |dk7rtd|d||f}tj|g}|jt ||||||t|<t ||||y)a Register a passed override function to the dispatcher. Actually a graph-building operation; real registration happens later. Args: backend: The backend name (DSL name) lib_symbol: Library you're overriding symbols in (must be "aten") op_symbol: Name of the operation you're overriding dispatch_key: Dispatch key to override impl: Implementation function for the override allow_multiple_override: Allow overriding an existing override unconditional_override: Implementation doesn't have a fallback and doesn't require torch.DispatchKeySet as the first argument Raises: ValueError: If lib_symbol is not "aten" r^z.Unsupported lib_symbol (must be "aten", got: "")rrrrr)rDN) ValueErrorrIrrrr) rrrrrhrrrDop_graphs r$r r sz8VI*UVWXX l #C{{3#H OO%#9  GCLgy,CHr#force_reregisteroriginal_graph new_graphrc|ry||k7S)aG Determine if a graph needs reregistration based on changes. Args: original_graph: The original graph before modification new_graph: The graph after modification force_reregister: If True, always reregister regardless of changes Returns: bool: True if reregistration is needed Tr")rrrs r$_should_reregister_graphrs" Y &&r#rqgraphrrcN||f}|tvrt|=|rt||||yy)a] Clean up existing library and reregister a graph. This is the common pattern used across reorder, deregister, and reenable operations. Args: op_symbol: The operation symbol dispatch_key: The dispatch key graph: The graph to register filter_state: Optional filter state for conditional registration rqN)rHru)rrrrrrDs r$rzrzs<$ l #C e| #J &   %   r#)keys_to_processreregister_overridesrrtransformation_fnrrcB||nttj}t|D]\}}||ftvrtt||f} ||||}t|ts,tjdt|j||l|t||f<|szt||dst!|||| y#tt t tf$rtjd||dYt$rtjd||YwxYw) a Apply a transformation function to graphs and optionally reregister. This is the core pattern used by reorder_graphs_from_user_function and can be reused for other graph transformation operations. Args: transformation_fn: Function to transform each graph keys_to_process: Keys to process, or None for all graphs reregister_overrides: Whether to reregister changed graphs filter_state: Optional filter state for conditional registration Note: If transformation_fn raises an exception for a specific graph, that graph will be skipped and processing will continue with remaining graphs. NAGraph transformation failed for %s/%s. Preserving original graph.Texc_infoNUnexpected error in graph transformation for %s/%s. Preserving original graph.zbGraph transformation returned invalid type %s for %s/%s. Expected list. Preserving original graph.Frrq)r5rIkeysr TypeErrorrAttributeError RuntimeErrorrswarning Exception exceptionrltyperrrz) rrrrr target_keysrrrrs r$_apply_graph_transformationrs=6+6C RI$)T* KKtY((   .7L)* $< I%  *)  U/:~|D  KKS     MM`    s C2D<DDc||f}t|}|D]5}d}|r|j|}|rt|||d|_/d|_7y)a Register all overrides in a single graph. Args: op_symbol: The operation symbol dispatch_key: The dispatch key graph: List of override nodes to register filter_state: Optional filter state for conditional registration TFN)rcr/rir)rrrrrrDrdr+enables r$ruru_s\ l #C # &C   !//5F  T< 8DKDK  r#c`tjD]\}}|\}}t|||y)zO Perform all registration calls from previously-built override graphs. N)rIrYru)rDrrrs r$_register_all_overridesr~s8mmo U"% <&     r#)rfnct||y)a Reorder override graphs using a user-provided ordering function. Args: fn: User-provided function that takes (op_symbol, dispatch_key, graph) and returns a reordered graph reregister_overrides: Whether to reregister graphs that have changed Note: This function uses the common graph transformation pattern and can serve as an example for other graph manipulation operations. rrN)r)rrs r$r r s" 1r# filter_fnc xdtdtdttdttffd }t||y)a Apply a filter function to remove nodes from graphs. This is a convenience function that uses the graph transformation pattern to filter out unwanted nodes. Args: filter_fn: Function that takes (op_symbol, dispatch_key, node) and returns True to keep the node, False to remove it reregister_overrides: Whether to reregister modified graphs Example: # Remove all nodes with "deprecated" in the DSL name _apply_graph_filter( lambda op, dk, node: "deprecated" not in node.dsl_name, reregister_overrides=True ) Note: If filter_fn raises an exception for a specific graph, the original graph will be preserved and processing will continue. rrrr,c |Dcgc]}|||s|c}Scc}w#ttttf$rtj d||d|cYSt $rtjd|||cYSwxYw)z-Apply filter_fn to graph with error handling.rTrrrrrrrsrrr)rrrr+rs r$filtering_transformationz5_apply_graph_filter..filtering_transformations %*WTi .conditional_transformations ))\BN"  "9lEBB" G:~|D  KKS   L  MM`  L  z><H  W !     d    s,  A84A5!A54A584C.!CCrNr)rrrrs`` r$_apply_selective_reorderingrsC<))&))26}2E) m )V 41r#)r,N)=loggingcollections.abcrr dataclassesrrtypingrrr torch.libraryr`__all__ getLoggerrrsrrDispatchKeySet _OpOverrideFn _OpReplaceFnr rrrr r&rGrrHrrFrarb _GraphsTyperIrVrJrKrLr5r9r!r\rcrir6r rrrr rrzrrurr rrr"r#r$rs.(22 g! cN CLU%9%91%<=q@A 1~  $  3T-%894 ;NNO TT Tp+n |,79tE#s(OU]]22 2385c?D$778 CeCHo../ (* )+-L-(**!Xc]"T)!hsm#d*!#&-! sCx !H6;dt&cAVAV(   &3CF (hsm 3d :x}*040437 2DIo,2T#Y-2S /D0 2  2n151548 )T#Y-)d3i$.)c?T1 )  )Xc$#L#L#L#L sCx #L  #LZ%*#(/I /I/I/I /I , & /I"/I!/I /Il# '''M"' '  ':)-          %    L48!&(, N%NsCx)D0N N % N  Nl)-       %    >  ""' 4"'5c=147855 5x"' LC:t+,LL L  Lr#