B }d @sdZdZddlZddlZddlmZddlmZddlm Z m Z ddl m Z m Z mZed Zed Zd&d dZddZddZddZd'ddZed(ddZd)ddZed*ddZddZdefdd Zd+d"d#Zd,d$d%ZdS)-zGWDataFind UI for FFL cache files. This module is used to replace the proper GWDataFind interface on-the-fly when FFL data access is inferred. As such this module is required to emulate those functions from `gwdatafind` used in :mod:`gwpy.io.datafind`. z(Duncan Macleod N)warn) lru_cache)segment segmentlist) _iter_cachecache_segmentsread_cache_entryz\A(\w+)-z^(?!lastfile|spectro|\.).*utf-8c Cst|d|}|| tjxV|ddkrry|| tjWqtk rn||krh|dPYqXqW| |SQRXdS)z"Read the last line of a file. rbr rN) openseekosSEEK_ENDreadSEEK_CUROSErrortellreadlinerstripdecode)pathbufsizeencodingfobjr`/work/yifan.wang/ringdown/master-ringdown-env/lib/python3.7/site-packages/gwpy/io/ffldatafind.py_read_last_line3s    rcCs>dtjkrtjdSdtjkr2tjtjddStddS)zReturn the base directory in which to find FFL files Raises ------ KeyError If neither the ``FFLPATH`` or ``VIRGODATA`` environment variables are set. ZFFLPATHZ VIRGODATAfflzkfailed to parse FFLPATH from environment, please set FFLPATH to point to the directory containing FFL filesN)renvironrjoinKeyErrorrrrr_get_ffl_basedirLs   r$cCst|dS)zAReturn `True` if this file looks (naively) like an FFL file. z.ffl)strendswith)rrrr _is_ffl_file_sr'cCsJtjtj|d}t|d}ttj|d}||fS)z5Return the ``(site, tag)`` for a given FFL file. r) rrsplitextbasenamersplit _SITE_REGEXmatchgroups)rtaglastsiterrr _get_site_tagesr1ccsHxBt|ptD].\}}}x"tt|D]}tj||Vq(WqWdS)z5Find all FFL files under a given base directory. N)rwalkr$filterr'rr")basedirroot_filesnamerrr_find_ffl_filesrsr9c CsHi}x>t|dD]0}y||t|<Wqttfk r>wYqXqW|S)z!Find all readable FFL files. )r4)r9r1rAttributeError)r4fflsrrrr _find_fflszs r<c CsByt|d||fStk r<td|d|dYnXdS)z>Return the path of the FFL file for a given site and tag. )r4zno FFL file found for ('z', 'z')N)r<r# ValueError)r0r.r4rrr _ffl_paths r>c s@t|d}t|d}fddt|tdDSQRXdS)z7Read an FFL file as a list of `CacheEntry` objects )r4rcs"g|]}t||j|jqSr)typerr).0entry)r0r.rr sz_read_ffl..)gpstypeN)r>rrfloat)r0r.r4r rr)r0r.r _read_ffls  rFcCs0|dkr dS|dkr$t|dddSt|dS)aHandle error, warn, or ignore for the given state. Parameters ---------- action : `str` The action to perform, one of ``'warn'`` (emit a `UserWarning`, default), ``'ignore'`` (do nothing), or anything else (raise a `RuntimeError`). message : `str` The message to emit with warnings or errors. Raises ------ RuntimeError If action is not ``'warn'`` or ``'ignore'``. ignoreNrr ) stacklevel)r RuntimeError)actionmessagerrr _handle_errors  rLcs>t}fdd|D}|dk r:t|}tt|j|S|S)aReturn the list of known data types. Parameters ---------- site : `str`, optional Observatory ID (e.g. ``'A'`)) to retrict types, if `None` (default) is given, all types are returned. match : `str`, optional Regular expression to use to restrict types. Returns ------- types : `list` of `str` The list of data types matching the criteria. cs g|]\}}d|fkr|qS)Nr)rAZsite_r.)r0rrrCszfind_types..N)r<recompilelistr3search)r0r,r;typesr)r0r find_typess  rRrc sxrtt||fddtD}dd|D}tgt|}|rtt|ddtt ||S)aReturn the list of all files of the given type in the [start, end) GPS interval. Parameters ---------- site : `str` Observatory ID to search for. tag : `str` Data type tag to search for. gpsstart : `int` GPS start time of query. gpsend : `int` GPS end time of query. match : `str`, optional Regular expression to use to retrict returned data URLs. on_gaps : `str`, optional What to do if the full GPS interval is not covered, one of ``'warn'`` (emit a `UserWarning`, default), ``'ignore'`` (do nothing), anything else (raise a `RuntimeError`). Returns ------- urls : `list` of `str` A list of URLs representing discovered data. csBg|]:}|jkr|jkr|jrr:|jrn|qS)T)Z observatory descriptionrZ intersectsrPr)rAe)r,r0spanr.rrrCs    zfind_urls..cSsg|] }|jqSr)r)rArTrrrrCszMissing segments:  ) rMrNrrFrrrLr"mapr%) r0r.ZgpsstartZgpsendr,Zon_gapscacheurlsmissingr)r,r0rUr.r find_urlss'  r[cCsLyt||}Wntk r&g}YnXtt|tdg}|sHt|d|S)aWReturn the most recent file of a given type. Parameters ---------- site : `str` Observatory ID to search for. tag : `str` Data type tag to search for. on_missing : `str`, optional What to do if a URL is not found for the given site and tag, one of ``'warn'`` (emit a `UserWarning`, default), ``'ignore'`` (do nothing), anything else (raise a `RuntimeError`). Returns ------- urls : `list` of `str` A list (typically of one item) of URLs representing the latest data for a specific site and tag. )rDzNo files found)r>r=r rrErL)r0r.Z on_missingZfflfilerYrrr find_latests  r\)r r )N)N)N)N)Nr)r)__doc__ __author__rrMwarningsr functoolsrZ ligo.segmentsrrrXrrr rNr+Z_DEFAULT_TYPE_MATCHrr$r'r1r9r<r>rFrLrRr[r\rrrrs0         ! ;