Zj dZddlmZddlmZddlmZddlmZddl m Z  ddl m Z d ZGd de Zy#e$r& ddlm Z d Zn#e$rGd d ZeZ d ZYnwxYwY6wxYw)zFContains a logger to push training logs to the Hub, using Tensorboard.)Path)CommitScheduler)EntryNotFoundError) ModelCard) experimental) SummaryWriterTc eZdZy)_DummySummaryWriterN)__name__ __module__ __qualname__b/var/www/html/ia-enhanced/venv/lib/python3.12/site-packages/huggingface_hub/_tensorboard_logger.pyr r &s rr FceZdZdZedfd Zddddddddddd d ed edzd eezd e d edzdedzde dzdedzde eezdzde eezdzdedzffdZ fdZ xZ S)HFSummaryWritera Wrapper around the tensorboard's `SummaryWriter` to push training logs to the Hub. Data is logged locally and then pushed to the Hub asynchronously. Pushing data to the Hub is done in a separate thread to avoid blocking the training script. In particular, if the upload fails for any reason (e.g. a connection issue), the main script will not be interrupted. Data is automatically pushed to the Hub every `commit_every` minutes (default to every 5 minutes). > [!WARNING] > `HFSummaryWriter` is experimental. Its API is subject to change in the future without prior notice. Args: repo_id (`str`): The id of the repo to which the logs will be pushed. logdir (`str`, *optional*): The directory where the logs will be written. If not specified, a local directory will be created by the underlying `SummaryWriter` object. commit_every (`int` or `float`, *optional*): The frequency (in minutes) at which the logs will be pushed to the Hub. Defaults to 5 minutes. squash_history (`bool`, *optional*): Whether to squash the history of the repo after each commit. Defaults to `False`. Squashing commits is useful to avoid degraded performances on the repo when it grows too large. repo_type (`str`, *optional*): The type of the repo to which the logs will be pushed. Defaults to "model". repo_revision (`str`, *optional*): The revision of the repo to which the logs will be pushed. Defaults to "main". repo_private (`bool`, *optional*): Whether to make the repo private. If `None` (default), the repo will be public unless the organization's default is private. This value is ignored if the repo already exists. path_in_repo (`str`, *optional*): The path to the folder in the repo where the logs will be pushed. Defaults to "tensorboard/". repo_allow_patterns (`list[str]` or `str`, *optional*): A list of patterns to include in the upload. Defaults to `"*.tfevents.*"`. Check out the [upload guide](https://huggingface.co/docs/huggingface_hub/guides/upload#upload-a-folder) for more details. repo_ignore_patterns (`list[str]` or `str`, *optional*): A list of patterns to exclude in the upload. Check out the [upload guide](https://huggingface.co/docs/huggingface_hub/guides/upload#upload-a-folder) for more details. token (`str`, *optional*): Authentication token. Will default to the stored token. See https://huggingface.co/settings/token for more details kwargs: Additional keyword arguments passed to `SummaryWriter`. Examples: ```diff # Taken from https://pytorch.org/docs/stable/tensorboard.html - from torch.utils.tensorboard import SummaryWriter + from huggingface_hub import HFSummaryWriter import numpy as np - writer = SummaryWriter() + writer = HFSummaryWriter(repo_id="username/my-trained-model") for n_iter in range(100): writer.add_scalar('Loss/train', np.random.random(), n_iter) writer.add_scalar('Loss/test', np.random.random(), n_iter) writer.add_scalar('Accuracy/train', np.random.random(), n_iter) writer.add_scalar('Accuracy/test', np.random.random(), n_iter) ``` ```py >>> from huggingface_hub import HFSummaryWriter # Logs are automatically pushed every 15 minutes (5 by default) + when exiting the context manager >>> with HFSummaryWriter(repo_id="test_hf_logger", commit_every=15) as logger: ... logger.add_scalar("a", 1) ... logger.add_scalar("b", 2) ``` cDts tdt| |S)NzvYou must have `tensorboard` installed to use `HFSummaryWriter`. Please run `pip install --upgrade tensorboardX` first.)is_summary_writer_available ImportErrorsuper__new__)clsargskwargs __class__s rrzHFSummaryWriter.__new__ts)*( ws##rNF tensorboardz *.tfevents.*) logdir commit_everysquash_history repo_type repo_revision repo_private path_in_reporepo_allow_patternsrepo_ignore_patternstokenrepo_idrr r!r"r#r$r%r&r'r(c t|d d|i| t|jts/t d|jdt |jd||dk(r t|jj}n4|jddzt|jjz}t|j|||||| | | || |_ |jj|_ |jj|_ |jj|_ t!j"|j|j} | j&j)d g}d |vrH|j+d || j&d <| j-|j|j yy#t$$rt!d} YwxYw) Nrz%`self.logdir` must be a string. Got 'z ' of type ./) folder_pathr%r)r"revisionprivater(allow_patternsignore_patternseveryr!)repo_id_or_pathr"tagszhf-summary-writer)r)r"r)r__init__ isinstancerstr ValueErrortypernamestripr schedulerr)r"r/r#rloadrdatagetappend push_to_hub)selfr)rr r!r"r#r$r%r&r'r(rcardr5rs rr6zHFSummaryWriter.__init__}s" 11&1$++s+DT[[MQ[\`aealal\m[nnopq q  <2#5 ,11L'--c2S84 ;L;Q;QQL) %" .0)  ~~-- 11!^^44 !>>$,,$..YDyy}}VR( d * KK+ , $DIIf    T\\T^^  L +" !R=D !s.+GGGc|t|||||jj}|j y)zLPush to hub in a non-blocking way when exiting the logger's context manager.N)r__exit__r=triggerresult)rCexc_typeexc_valexc_tbfuturers rrFzHFSummaryWriter.__exit__s/ 7F3'') r)returnr)r r r__doc__rrr8intfloatboollistr6rF __classcell__)rs@rrr-sDL$$"$%$ $$($(#06D7; :M:Md :M Ek :M  :M::MTz:MTk:MDj:M"#Y_t3:M#3i#o4:MTz:MxrrN)rNpathlibr_commit_schedulerrerrorsrrepocardrutilsr tensorboardXr _RuntimeSummaryWriterrrtorch.utils.tensorboardr rrrrr\s}M.& ,C"&P+P , ,R&*# ,  !4&+# , ,s26A!AA!AA!AA! A!