Sj"ddlmZddlmZmZmZddlmZddlZddl m Z m Z gdZ ede d ed efd Zd ed efd Zed eeeZe ddej*deeej.zded eej*dffdZe ddedeeej.zded eefdZddZ ddeedfdeeefdzdeeej.zded eeedfeeeefdfff dZddedeej.zded efdZy))Sequence)AnyoverloadTypeVar) deprecatedN)GatherScatter)scatterscatter_kwargsgatherzC`is_namedtuple` is deprecated, please use the python checks instead)categoryobjreturnct|SN)_is_namedtuplers _/var/www/html/ia-enhanced/venv/lib/python3.12/site-packages/torch/nn/parallel/scatter_gather.py is_namedtupler s # cZt|txrt|dxr t|dS)N_asdict_fields) isinstancetuplehasattrrs rrrs+ 3V73 #:VwsI?VrT.inputs target_gpusdimcyrrrr s rr r !s #rcyrr"r#s rr r )s rc>fd |}d|S#dwxYw)zSlice tensors into approximately equal chunks and distributes them across given GPUs. Duplicates references to objects that are not tensors. ct|tjrtjd|St |r/t t|ddiDcgc]}t||c}St|tr,t|dkDrtt t|ddiSt|tr:t|dkDr,t t|ddiDcgc] }t|c}St|trNt|dkDr@t t|jddiDcgc]}t||c}SDcgc]}|c}Scc}wcc}wcc}wcc}w)NstrictFr)rtorchTensorr applyrzipmaptyperlenlistdictitems)rargsi_r scatter_maprs rr5zscatter..scatter_map7sQ c5<< (==dC= = #  [#!6EuES 4   c5 !c#hlSc2A5AB B c4 SX\%(#k3*?%N%NODGO O c4 SX\c+syy{;JEJS !   ))))#P *sE"E'7E, E1Nr")rrr resr5s `` @rr r 1s* *8&! J kwargsc |r t|||ng}|r t|||ng}t|t|kr7|jdtt|t|z DnMt|t|kr6|jdtt|t|z Dt |t |fS)z+Scatter with support for kwargs dictionary.c3 K|]}dyw)r"Nr".0r4s r z!scatter_kwargs..d B  c3 K|]}iywrr"r;s rr=z!scatter_kwargs..hr>r?)r r.extendranger)rr8rr scattered_inputsscattered_kwargss rr r Zs=Cwv{C8fd |}d|S#dwxYw)aGather tensors from different GPUs on a specified device. This function is useful for gathering the results of a distributed computation. It takes a sequence of objects, one for each GPU, and returns a single object on the specified device. Args: outputs (Any): A sequence of objects (potentially tensors) to gather. target_device (Union[int, torch.device]): The device to gather the tensors to. Use 'cpu' for CPU to avoid a deprecation warning. dim (int, optional): The dimension along which to gather. Default: 0. Returns: Any: A gathered object (potentially tensor) on the specified device. c dttjrtjgSytt r:t fdDs tdtfdDStr-tjttddiStttddiS)Nrc3LK|]}tt|k(ywr)r.)r<douts rr=z-gather..gather_map..s;as3x3q6);s!$z+All dicts must have the same number of keysc 3^K|]}|Dcgc]}|| c}f!ycc}wwrr")r<krJ gather_maprEs rr=z-gather..gather_map..s-S!a7,CaQqT,C!DES,Cs - ( -r'T) rr(r)rr*r0all ValueErrorr-r_maker,r+)rErKr rNrFs`@rrNzgather..gather_mapsaj c5<< (<< s=W= = ; c4 ;7;; !NOO49SsSS S # 9??3z33M3M#NO OtCyZg)Cd)CDEErNr")rErFr r6rNs `` @rr r ns+"F&! J r7).)r)collections.abcrtypingrrrtyping_extensionsrr(torch.nn.parallel._functionsrr __all__ FutureWarningboolrrr0r/rrr)intdevicer strr r r"rrr\s$))( 8 2 I st   CtU# # LL## ,-# # 5<<  # #  # ,-  !W  &Z < #s(O< cNT !<# ,-< <  5c?E$sCx.#"56 67 <((C(ell(:((S(r