Bj& dZddlZddlmZddlmZddlmZddl m Z dd giZ gd Z Gd d Z eddZdZdZdddd eddddd dZdZdZdddZy)z, Thin wrappers around `concurrent.futures`. N)contextmanager length_hint)tqdm) TqdmWarningz github.com/ casperdcl) thread_map process_mapinterpreter_mapcHeZdZdZddlmZddlmZdZ d dZ dZ dZ d Z y ) _InterpreterLockz3Reentrant lock backed by a cross-interpreter queue.r) get_ident) monotoniccRddlm}||_||_d|_d|_y)Nr)RLock) threadingr_queue_lock_owner_depth)selfqueuers U/root/workspace/ytshorts/venv/lib/python3.12/site-packages/tqdm/contrib/concurrent.py__init__z_InterpreterLock.__init__s## W   cjddlm}|j}|dk(r|jj |}n|jj ||}|sy|j r|xj dz c_y |s|j jn\|dk(r|j jnget (create if necessary) and then restore `tqdm_class`'s lockrN)getattrget_lockset_lockr) tqdm_class lock_namelockold_locks r ensure_lockrEGsiz7D1H |0:..0 4D )D J  H%sAAc dtjd|jd|jj dd|d }t |ffS)zGReturn an initializer which bootstraps the parent import path and lock.zimport sys sys.path[:] = z from concurrent import interpreters from importlib import import_module from tqdm.contrib.concurrent import _InterpreterLock tqdm_class = import_module(z) for name in .z: tqdm_class = getattr(tqdm_class, name) tqdm_class.monitor_interval = 0 tqdm_class.set_lock(_InterpreterLock(interpreters.Queue(z))))syspathr7r8splitexec)rA lock_queue_idcodes r_get_interpreter_initrNVsk  %&'1&;&;%>?!..44S9<=CDQBSSV X  $=rc0tfd|DdS)z+min(map(length_hint, iterables), default=0)c3FK|]}t|dxdk\syw)rrNr).0itns r z_min_map_len..hs$Ib{2r/B*B!q)HIs!!r)default)min) iterablesrSs @r _min_map_lenrXfs IIIST UUrr g) max_workersr! chunksizerBrA smoothingr _initializer _initargsc | j} d| vrt| | d<i}d| vr| jd|d<i}dD]}|| vs| j|||<d}| dr6d| vr2 ddlm}|xstd |xsd d z}| d|kDr|| d<d }t||| 5}| |j} |f} |d|| | d|5}|dd|i| 5|d _ |jfd}||_ t|j|g| ||d|cdddcdddcdddS#t $r ddlm}YwxYw#1swYnxYw dddn #1swYnxYwdddy#1swYyxYw)a Implementation of `thread_map`, `process_map` and `interpreter_map`. Parameters ---------- max_workers : int timeout : int buffersize : int Requires Python>=3.14. thread_name_prefix : str max_tasks_per_child : int mp_context : str total buffersize)thread_name_prefixmax_tasks_per_child mp_contextNminitersr)process_cpu_count) cpu_count r T)rBrC)rY initializerinitargsr[c@|i|}|jfd|S)Nc$jSr1)update)_pbars rz4_executor_map..patchsubmit..s DKKMr)add_done_callback)argskwargsfut orisubmitros r patchsubmitz"_executor_map..patchsubmits&#T4V4C))*ABJr)r!rZr;)copyrXpoposre ImportErrorrfrVrEr@dynamic_miniterssubmitlistmap) PoolExecutorfnrYr!rZrBrAr[rr\r]rW tqdm_kwargsrs map_kwargs pool_kwargskr{rf rough_maxlkexrvruros @@r _executor_maprks$   Ff&y1wJv#)::l#; < K H+ ;#ZZ]KN+ g:V3 % 9 B3rIK,<1+A#B '?Y &!*F: #  Z95 AYR  %..LI )k|V_)') Y,.:i:6: Yd#/,0D)II ( FBFFX"X,3yXLVXY Y Y Y Y YY % $ % Y Y Y Y Y Y YYYsU-D5,E5 E AE  E " E55EE E E  E5 E) %E55E>c.ddlm}t||g|i|S)a Equivalent of `list(map(fn, *iterables))` driven by `concurrent.futures.ThreadPoolExecutor`. Parameters ---------- max_workers : int, optional Maximum number of workers to spawn; passed to `concurrent.futures.ThreadPoolExecutor`. thread_name_prefix : str, optional Passed to `concurrent.futures.ThreadPoolExecutor` [default: '']. timeout : int or float, optional Seconds to wait before raising `TimeoutError` if `__next__` is called and the result isn't available. [default: None]. buffersize : int, optional Requires Python>=3.14 [default: None]. tqdm_class : optional `tqdm` class to use for bars [default: tqdm.auto.tqdm]. smoothing : float, optional Passed to `tqdm_class`; the [default: 0] is average (due to erratic update frequency). lock_name : str, optional Member of `tqdm_class.get_lock()` to use [default: '']. r)ThreadPoolExecutor)concurrent.futuresrr)rrWrrs rr r s.6 +R K) K{ KKrcddlm}ddlm}|j }|j d|j dt}t||j\}}t||g|t|||d|S)aj Equivalent of `list(map(fn, *iterables))` driven by `concurrent.futures.InterpreterPoolExecutor` (Python 3.14+). Parameters ---------- Same as `thread_map`. Notes ----- `fn`, its arguments, and its return values must be pickleable. Worker progress bars using the same `tqdm_class` share a cross-interpreter write lock. r) interpreters)InterpreterPoolExecutorNrA)rr\r]) concurrentrrr create_queuer.r% tqdm_autorNidrr) rrWrrr lock_queuerArirjs rr r s(:**,JNN4y9J1*jmmLK  E&/ E7G 7S H E8C EErmp_lock)rBcddlm}|r,d|vr(t|}|dkDrddlm}|d|zt dt ||g|d |i|S) aI Equivalent of `list(map(fn, *iterables))` driven by `concurrent.futures.ProcessPoolExecutor`. Parameters ---------- max_workers : int, optional Maximum number of workers to spawn; passed to `concurrent.futures.ProcessPoolExecutor`. timeout : int or float, optional Seconds to wait before raising `TimeoutError` if `__next__` is called and the result isn't available. [default: None]. chunksize : int, optional Approximate size of chunks sent to worker processes; passed to `concurrent.futures.ProcessPoolExecutor.map`. [default: 1]. buffersize : int, optional Requires Python>=3.14 [default: None]. max_tasks_per_child : int, optional Maximum number of tasks a worker process can complete before being replaced with a new process; passed to `concurrent.futures.ProcessPoolExecutor`. mp_context : multiprocessing.BaseContext, optional Multiprocessing context to use, e.g. `multiprocessing.get_context('fork')`. lock_name : str, optional Member of `tqdm_class.get_lock()` to use [default: mp_lock]. tqdm_class : optional `tqdm` class to use for bars [default: tqdm.auto.tqdm]. smoothing : float, optional Passed to `tqdm_class`; the [default: 0] is average (due to erratic update frequency). r)ProcessPoolExecutorrZi)warnzIterable length %d > 1000 but `chunksize` is not set. This may seriously degrade multiprocess performance. Set `chunksize=1` or more.r) stacklevelrB)rrrXwarningsrrr)rrBrWrrshortest_iterable_lenrs rr r sf:7[ 3!-Y 7 4 ' % /1FG , ,b a9 a aU` aar)r<N)r9rH contextlibroperatorrautorrstdr __author____all__rrErNrXrr r r r;rrrs % $k] + :55p & &  V /3DAY[Ct$RV9YxL6E2+4(br