B dDG@sdZddlZddlmZddlmZddlmZddlm Z dZ e fdd Z e fd d Z e d fd dZd e fddZefddZe fddZddZddZe fddZd&ddZddZd d!Zd"d#Zd$d%ZdS)'zG This module provides additional utilities for use with ligo.segments. N) LIGOTimeGPS) CacheEntry)segments) __version__z"Kipp Cannon cCsdtd}t}xL|D]D}||d\\}}||}||}|t|||qW|S)a Return a segmentlist describing the intervals spanned by the files whose names are given in the list filenames. The segmentlist is constructed by parsing the file names, and the boundaries of each segment are coerced to type coltype. The file names are parsed using a generalization of the format described in Technical Note LIGO-T010150-00-E, which allows the start time and duration appearing in the file name to be non-integers. NOTE: the output is a segmentlist as described by the file names; if the file names are not in time order, or describe overlaping segments, then thusly shall be the output of this function. It is recommended that this function's output be coalesced before use. z-([\d.]+)-([\d.]+)\.[\w_+#]+\Zz.gz) recompiler segmentlistfindallstriprstripappendsegment) filenamescoltypepatternlnamesdr`/work/yifan.wang/ringdown/master-ringdown-env/lib/python3.7/site-packages/ligo/segments/utils.py fromfilenames:s  rcstfdd|DS)a Construct a segmentlist representing the times spanned by the files named in the LAL cache contained in the file object cachefile. The segmentlist will be created with segments whose boundaries are of type coltype, which should raise ValueError if it cannot convert its string argument. Example: >>> from lal import LIGOTimeGPS >>> cache_seglists = fromlalcache(open(filename), coltype = LIGOTimeGPS).coalesce() See also: lal.utils.CacheEntry c3s|]}t|djVqdS))rN)rr ).0r)rrr kszfromlalcache..)rr)Z cachefilerr)rr fromlalcacheZsrTcCstdtj}td}td}td}d}t}xv|D]l} |d| } | sXq@yH|| \} t| d} tt t || dd } || d } d }Wnt k r\y<|| \} tt t || dd } || d } d }Wnht k rVy8|| \} tt t || dd } t | } d }Wnt k rPPYnXYnXYnX|rt | | kr~t d | |dkr|}n||krt d | | | q@W|S)a Read a segmentlist from the file object fileobj containing a segwizard compatible segment list. Parsing stops on the first line that cannot be parsed (which is consumed). The segmentlist will be created with segment whose boundaries are of type coltype, which should raise ValueError if it cannot convert its string argument. Two-column, three-column, and four-column segwizard files are recognized, but the entire file must be in the same format, which is decided by the first parsed line. If strict is True and the file is in three- or four-column format, then each segment's duration is checked against that column in the input file. NOTE: the output is a segmentlist as described by the file; if the segments in the input file are not coalesced or out of order, then thusly shall be the output of this function. It is recommended that this function's output be coalesced before use. z\s*([#;].*)?\Zz%\A\s*([\d.+-eE]+)\s+([\d.+-eE]+)\s*\Zz4\A\s*([\d.+-eE]+)\s+([\d.+-eE]+)\s+([\d.+-eE]+)\s*\Zz>\A\s*([\d]+)\s+([\d.+-eE]+)\s+([\d.+-eE]+)\s+([\d.+-eE]+)\s*\ZNrz#segment '%s' has incorrect durationzsegment '%s' format mismatch)rrDOTALLrrsubr intr listmap ValueErrorabsr )fileobjrstrictZ commentpatZ twocolsegpatZthreecolsegpatZ fourcolsegpatformatrlinetokensnumsegdurationZthis_line_formatrrr fromsegwizardssN              r/c Csb|r|dxNt|D]B\}}|d|t||dt||dt|t|fqWdS)a Write the segmentlist seglist to the file object fileobj in a segwizard compatible format. If header is True, then the output will begin with a comment line containing column names. The segment boundaries will be coerced to type coltype and then passed to str() before output. z## seg start stop duration z %d %s %s %s rrN)write enumeratestrr&)r'seglistheaderrnr-rrr tosegwizards r6c Csntd}t}xV|D]N}y2||\}|ttt||ddWqt k rdPYqXqW|S)a Read a segmentlist from the file object fileobj containing TAMA locked-segments data. Parsing stops on the first line that cannot be parsed (which is consumed). The segmentlist will be created with segments whose boundaries are of type coltype, which should raise ValueError if it cannot convert its string argument. NOTE: TAMA locked-segments files contain non-integer start and end times, so the default column type is set to LIGOTimeGPS. NOTE: the output is a segmentlist as described by the file; if the segments in the input file are not coalesced or out of order, then thusly shall be the output of this function. It is recommended that this function's output be coalesced before use. z2\A\s*\S+\s+\S+\s+\S+\s+([\d.+-eE]+)\s+([\d.+-eE]+)rr) rrrrr r r r#r$r%)r'rZ segmentpatrr*r+rrrfromtamas   & r7cCstdgt|}xt|D]\}}|d}t|dkrZ||d}t||||<qt|dkrnt||ddkrtj|d<n||d|d<|ddkrtj|d<n||d|d<t|d|d||<qW|S)a Parse a list of ranges expressed as strings in the form "value" or "first:last" into an equivalent ligo.segments.segmentlist. In the latter case, an empty string for "first" and(or) "last" indicates a (semi)infinite range. A typical use for this function is in parsing command line options or entries in configuration files. NOTE: the output is a segmentlist as described by the strings; if the segments in the input file are not coalesced or out of order, then thusly shall be the output of this function. It is recommended that this function's output be coalesced before use. Example: >>> text = "0:10,35,100:" >>> from_range_strings(text.split(",")) [segment(0, 10), segment(35, 35), segment(100, infinity)] N:rrrr) rrlenr1splitr r% NegInfinity PosInfinity)ranges boundtypeZsegsirangepartsrrrfrom_range_stringss"        rBcCsdgt|}xt|D]\}}|s6t|d||<q|dtjkr\|dtjkr\d||<q|dtjkr|dtjk rdt|d||<q|dtjk r|dtjkrdt|d||<q|dtjk r|dtjk rdt|dt|df||<qt|qW|S)a Turn a segment list into a list of range strings as could be parsed by from_range_strings(). A typical use for this function is in machine-generating configuration files or command lines for other programs. Example: >>> from ligo.segments import * >>> segs = segmentlist([segment(0, 10), segment(35, 35), segment(100, infinity())]) >>> ",".join(to_range_strings(segs)) '0:10,35,100:' Nrrr8z:%sz%s:z%s:%s)r9r1r2rr;r<r%)r3r=r?r-rrrto_range_stringss " rCcCsddd|DS)a Return a string representation of a segmentlistdict object. Each segmentlist in the dictionary is encoded using to_range_strings() with "," used to delimit segments. The keys are converted to strings and paired with the string representations of their segmentlists using "=" as a delimiter. Finally the key=value strings are combined using "/" to delimit them. Example: >>> from ligo.segments import * >>> segs = segmentlistdict({"H1": segmentlist([segment(0, 10), segment(35, 35), segment(100, infinity())]), "L1": segmentlist([segment(5, 15), segment(45, 60)])}) >>> segmentlistdict_to_short_string(segs) 'H1=0:10,35,100:/L1=5:15,45:60' This function, and its inverse segmentlistdict_from_short_string(), are intended to be used to allow small segmentlistdict objects to be encoded in command line options and config files. For large segmentlistdict objects or when multiple sets of segmentlists are required, the LIGO Light Weight XML encoding available through the ligo.lw library should be used. /cSs*g|]"\}}dt|dt|fqS)z%s=%s,)r2joinrC)rkeyvaluerrr Ksz3segmentlistdict_to_short_string..)rFitems)seglistsrrrsegmentlistdict_to_short_string4srLcCsTt}xF|dD]4}|d\}}t|d|d||<qW|S)a^ Parse a string representation of a set of named segmentlists into a segmentlistdict object. The string encoding is that generated by segmentlistdict_to_short_string(). The optional boundtype argument will be passed to from_range_strings() when parsing the segmentlist objects from the string. Example: >>> segmentlistdict_from_short_string("H1=0:10,35,100:/L1=5:15,45:60") {'H1': [segment(0, 10), segment(35, 35), segment(100, infinity)], 'L1': [segment(5, 15), segment(45, 60)]} This function, and its inverse segmentlistdict_to_short_string(), are intended to be used to allow small segmentlistdict objects to be encoded in command line options and config files. For large segmentlistdict objects or when multiple sets of segmentlists are required, the LIGO Light Weight XML encoding available through the ligo.lw library should be used. rD=rE)r>)rZsegmentlistdictr r:rB)rr>rtokenrGr=rrr!segmentlistdict_from_short_stringNs "rOrc cszt|}d}xht|rj|d}zxt|r4|d7}q"WWd|||krdt||||||VX|}|d7}qWdS)a Convert consecutive True values in a bit stream (boolean-castable iterable) to a stream of segments. Require minlen consecutive True samples to comprise a segment. Example: >>> list(from_bitstream((True, True, False, True, False), 0, 1)) [segment(0, 2), segment(3, 4)] >>> list(from_bitstream([[], [[]], [[]], [], []], 1013968613, 0.125)) [segment(1013968613.125, 1013968613.375)] rrN)iternextrr )Z bitstreamstartdtZminlenr?jrrrfrom_bitstreamis    rUcCsTt|d}||dd8}t|dd}tddt||dDt|g@S)a Return a segmentlist identifying the S2 playground times within the interval defined by the segment extent. Example: >>> from ligo import segments >>> S2playground(segments.segment(874000000, 874010000)) [segment(874000013, 874000613), segment(874006383, 874006983)] ri w+ircss|]}t||dVqdS)iXN)rr )rtrrrrszS2playground..)r"rrr@)Zextentlohirrr S2playgrounds rYccsDd}|}x6||||}}||kr&Pt||V|d7}q WdS)a Analogous to Python's range() builtin, this generator yields a sequence of continuous adjacent segments each of length "period" with the first starting at "start" and the last ending not after "stop". Note that the segments generated do not form a coalesced list (they are not disjoint). start, stop, and period can be any objects which support basic arithmetic operations. Example: >>> from ligo.segments import * >>> segmentlist(segmentlist_range(0, 15, 5)) [segment(0, 5), segment(5, 10), segment(10, 15)] >>> segmentlist(segmentlist_range('', 'xxx', 'x')) [segment('', 'x'), segment('x', 'xx'), segment('xx', 'xxx')] rN)rr )rRstopZperiodr5barrrsegmentlist_rangesr]ccs0x*|D]"}|t|g@|d VqWdS)a An iterator that generates the results of taking the intersection of seglist1 with each segment in seglist2 in turn. In each result, the segment start and stop values are adjusted to be with respect to the start of the corresponding segment in seglist2. See also the segmentlist_range() function. This has use in applications that wish to convert ranges of values to ranges relative to epoch boundaries. Below, a list of time intervals in hours is converted to a sequence of daily interval lists with times relative to midnight. Example: >>> from ligo.segments import * >>> x = segmentlist([segment(0, 13), segment(14, 20), segment(22, 36)]) >>> for y in Fold(x, segmentlist_range(0, 48, 24)): print y ... [segment(0, 13), segment(14, 20), segment(22, 24)] [segment(0, 12)] rN)rrshift)Zseglist1Zseglist2r-rrrFolds r_cs|dkrtSddfdd}t}d}x~||D]r\}}|dkrl|||krb|krlnn|}n8|dkr||kr||krnn|t||~||7}q:W|dkst|S)a Given a sequence of segmentlists, returns the intervals during which at least n of them intersect. The input segmentlists must be coalesced, the output is coalesced. Example: >>> from ligo.segments import * >>> w = segmentlist([segment(0, 15)]) >>> x = segmentlist([segment(5, 20)]) >>> y = segmentlist([segment(10, 25)]) >>> z = segmentlist([segment(15, 30)]) >>> vote((w, x, y, z), 3) [segment(10, 20)] The sequence of segmentlists is only iterated over once, and the segmentlists within it are only iterated over once; they can all be generators. If there are a total of N segments in M segment lists and the final result has L segments the algorithm is O(N M) + O(L). rcSs`t|ddd}xBtt|dddD]*}||dd|ddkr&||Sq&Wds\tdS)NcSs |ddS)Nrr)_rrrz'vote..pop_min..)rGrrF)minr@r9popAssertionError)rvalr?rrrpop_mins zvote..pop_minc 3s0g}x`|D]X}t|}y t|}Wntk r8w YnX||dd|f||dddfq W|sndS|jdddd|dd}d}x|r |\}}}||kr||7}n||fV|}|}|dk ry t|}Wntk rwYnX||dd|f||dddfqW||fVdS)NrrcrTcSs |ddS)Nrr)r`rrrrarbz.vote..vote_generator..)reverserG)rPrQ StopIterationr sort) rKqueuer3Zsegiterr-boundvotesZ this_bounddelta)rhrrvote_generators:      zvote..vote_generatorr)rrr r rf)rKr5rpresultrnrmrorRr)rhrvotes &$$  rr)r)__doc__rZlalrZ lal.utilsrZligorZ ligo.segmentsr __author__r"rrr/r6r7rBrCrLrOrUrYr]r_rrrrrrs(     = -$  &$