B }dK @sdZddlZddlZddlZddlZddlZddlmZddlm Z m Z ddl m Z ddl mZdd lmZd Zed Zed d ddddddgZdddddddddZddddd d!d"d#d$Zy ddlZWnek rYn.Xd%d&Zeed'ejjZeed(ejjZGd)d*d*ejZed+eZ Gd,d-d-eeZ!e!d.eZ"Gd/d0d0e#Z$e%d1e$d2d3Z&d4d5Z'dSd7d8Z(dTd;d<Z)dUd=d>Z*dVd?d@Z+dAdBZ,dCdDZ-dEdFZ.e,e.e-dddde /e"/dGdHfdIdJZ0dWdKdLZ1dXdMdNZ2e,e.dYdOdPZ3dQdRZ4dS)ZzKWrapper to the nds2-client package, providing network access to LIGO data. N) OrderedDict)reducewraps)to_gps) NumpyTypeEnum)kinitz(Duncan Macleod z[a-z]1nds[0-9]\Z)N)znds.ligo.caltech.eduiy)ZH1)znds.ligo-wa.caltech.eduiy)ZH0)znds.ligo-wa.caltech.eduiy)ZL1)znds.ligo-la.caltech.eduiy)ZL0)znds.ligo-la.caltech.eduiy)ZV1)znds.ligo.caltech.eduiy)ZC1)znds40.ligo.caltech.eduiy)ZC0)znds40.ligo.caltech.eduiy)rUNKNOWN)rZonline)rraw)Zreduced)zs-trend)zm-trend) ztest-pt)@Zstatic)r ONLINEZRAWZRDSSTRENDMTRENDZ TEST_POINTZSTATIC)rZint_2)rZint_4)r Zint_8)r Zreal_2)rZreal_4)rZ complex_8)rZuint_4)r ZINT16ZINT32ZINT64ZFLOAT32ZFLOAT64Z COMPLEX32ZUINT32ccsPtj}xDttd||jD],}t||}|t|d|||ffVqWdS)zJRegenerate the relevant nds2 type dict from `nds2.channel` itself startswithN)nds2channelfilteroperator methodcaller__dict__getattrlen)prefixZ to_stringZchannameattrr Y/work/yifan.wang/ringdown/master-ringdown-env/lib/python3.7/site-packages/gwpy/io/nds2.py_nds2_attr_dictTs    r"Z CHANNEL_TYPE_Z DATA_TYPE_c@sJeZdZdZd ddZeddZeddZed d Zed d Z dS) _Nds2EnumzBase class for NDS2 enums NcCst||}||_||_|S)N)int__new___value_nds2name)clsvaluer'objr r r!r%ns z_Nds2Enum.__new__cCsttj|jS)z3The logical OR of all members in this enum )rror_r))r(r r r!anytsz _Nds2Enum.anycCsdd|DS)z~sz'_Nds2Enum.nds2names..r )r(r r r! nds2nameszsz_Nds2Enum.nds2namescCs$t|jd|jdt|S)z)DEPRECATED: see ``.nds2names()`` z.names has been renamed z .nds2names)warningswarn__name__DeprecationWarningr0)r(r r r!namessz_Nds2Enum.namescCs|t|}|r|t|Sy ||Stk r`x"|D]}||jkr>|Sq>WYnXtd|d|jdS)z>Returns the NDS2 type corresponding to the given name 'z' is not a valid N) strisdigitr$upperKeyErrorlowerr' ValueErrorr3)r(ritemr r r!finds   z_Nds2Enum.find)N) r3 __module__ __qualname____doc__r% classmethodr,r0r5r>r r r r!r#ks     r#Nds2ChannelTypec@s eZdZdS) _Nds2DataTypeN)r3r?r@r r r r!rDsrD Nds2DataTypec@seZdZdZdS) NDSWarningz=Warning about communicating with the Network Data Server N)r3r?r@rAr r r r!rFsrFalwayscCs:t|dr|jSt|dr2d|j||jfSt|S)zReturns the NDS2-formatted name for a channel Understands how to format NDS name strings from `gwpy.detector.Channel` and `nds2.channel` objects ndsname channel_type,)hasattrrHjoinrchannel_type_to_stringrIr7)rr r r!_get_nds2_names  rNcCs tt|S)z7Maps `_get_nds2_name` for a list of input channels )maprN)channelsr r r!_get_nds2_namessrQ NDSSERVERc Csrg}xht|dD]T}y|dd\}}Wntk rFd}Yn Xt|}||f|kr|||fqW|S)aParse the NDSSERVER environment variable into a list of hosts Parameters ---------- env : `str`, optional environment variable name to use for server order, default ``'NDSSERVER'``. The contents of this variable should be a comma-separated list of `host:port` strings, e.g. ``'nds1.server.com:80,nds2.server.com:80'`` Returns ------- hostiter : `list` of `tuple` a list of (unique) ``(str, int)`` tuples for each host:port pair rJ:rN)osgetenvsplitrsplitr<r$append)envhostshostportr r r! parse_nds_envs  r]nowuc Csg}|rt|rt|}tdt||kr8d|g}n|dg}xb|D]Z}yt|\}}Wn*tk r|std|dYqFX||f|krF|||fqFWt |S)aGenerate a logical ordering of NDS (host, port) tuples for this IFO Parameters ---------- ifo : `str` prefix for IFO of interest env : `str`, optional environment variable name to use for server order, default ``'NDSSERVER'``. The contents of this variable should be a comma-separated list of `host:port` strings, e.g. ``'nds1.server.com:80,nds2.server.com:80'`` epoch : `~gwpy.time.LIGOTimeGPS`, `float`, `str` GPS epoch of data requested lookback : `float` duration of spinning-disk cache. This value triggers defaulting to the CIT NDS2 server over those at the LIGO sites Returns ------- hro : `list` of `2-tuples ` ordered `list` of ``(host, port)`` tuples r^NzNo default host found for ifo 'r6) rTrUr]r DEFAULT_HOSTSr:r1r2rXlist) ZiforYepochZlookbackrZZifolistZdifor[r\r r r!host_resolution_orders   rccCs<ddl}|dkrt|rd}|dkr0||S|||S)a8Open an `nds2.connection` to a given host and port Parameters ---------- host : `str` name of server with which to connect port : `int`, optional connection port Returns ------- connection : `nds2.connection` a new open connection to the given NDS host rNi)r NDS1_HOSTNAMEmatch connection)r[r\rr r r!connect$s  rgc Csdy t||Stk r:}zdt|kr*Wdd}~XYnXtd|d|ttt||S)aOpen an `nds2.connection` handling simple authentication errors This method will catch exceptions related to kerberos authentication, and execute a kinit() for the user before attempting to connect again. Parameters ---------- host : `str` name of server with which to connect port : `int`, optional connection port Returns ------- connection : `nds2.connection` a new open connection to the given NDS host zRequest SASL authenticationNzError authenticating against rS)rg RuntimeErrorr7r1r2rFr )r[r\excr r r! auth_connect@s  rjcstfdd}|S)zBDecorate a function to create a `nds2.connection` if required cs\|dddkrRy|d}Wntk r:tdYnXt||dd|d<||S)Nrfr[z>one of `connection` or `host` is required to query NDS2 serverr\)getpopr: TypeErrorrj)argskwargsr[)funcr r! wrapped_func`sz%open_connection..wrapped_func)r)rprqr )rpr!open_connection]s rrcstfdd}|S)zCDecorate a function to translate a type string into an integer cshx\dtfdtffD]H\}}||ddkr8|||<qt||ts|||j||<qW||S)Ntypedtype)rCrErkr, isinstancer$r>r))rnroZkwdZenum_)rpr r!rqpsz&parse_nds2_enums..wrapped_func)r)rprqr )rpr!parse_nds2_enumsms rvcstfdd}|S)zWrap a function to reset the epoch when finished This is useful for functions that wish to use `connection.set_epoch`. c sF|dd}|r|nd}z ||S|dk r@||j|jXdS)Nrf)rkZ current_epoch set_epoch gps_startgps_stop)rnrorfrb)rpr r!rqs   z!reset_epoch..wrapped_func)r)rprqr )rpr! reset_epoch|s rzFALLc Csxt|ts|pdf}|j|t|ttfr6||f}n|dkrDt}g} x*t|D]} | t|| ||||dqRW| S)aQuery an NDS2 server for channel information Parameters ---------- channels : `list` of `str` list of channel names to query, each can include bash-style globs connection : `nds2.connection`, optional open NDS2 connection to use for query host : `str`, optional name of NDS2 server to query, required if ``connection`` is not given port : `int`, optional port number on host to use for NDS2 connection sample_rate : `int`, `float`, `tuple`, optional a single number, representing a specific sample rate to match, or a tuple representing a ``(low, high)` interval to match type : `int`, optional the NDS2 channel type to match dtype : `int`, optional the NDS2 data type to match unique : `bool`, optional, default: `False` require one (and only one) match per channel epoch : `str`, `tuple` of `int`, optional the NDS epoch to restrict to, either the name of a known epoch, or a 2-tuple of GPS ``[start, stop)`` times Returns ------- channels : `list` of `nds2.channel` list of NDS2 channel objects See also -------- nds2.connection.find_channels for documentation on the underlying query method Examples -------- >>> from gwpy.io.nds2 import find_channels >>> find_channels(['G1:DER_DATA_H'], host='nds.ligo.caltech.edu') [] r{N)unique)rutuplerwr$floatrQextend _find_channel) rPrfr[r\ sample_ratersrtr|rboutrr r r! find_channelss:    rcCsjt|||\}}|j|||f|}|s0|St|dkrJdd|D}t|dkrftd|d|S)a<Internal method to find a single channel Parameters ---------- connection : `nds2.connection`, optional open NDS2 connection to use for query name : `str` the name of the channel to find ctype : `int` the NDS2 channel type to match dtype : `int` the NDS2 data type to match sample_rate : `tuple` a pre-formatted rate tuple (see `find_channels`) unique : `bool`, optional, default: `False` require one (and only one) match per channel Returns ------- channels : `list` of `nds2.channel` list of NDS2 channel objects, if `unique=True` is given the list is guaranteed to have only one element. See also -------- nds2.connection.find_channels for documentation on the underlying query method rcSsg|]}|jtjjkr|qSr )rIrCrr))r-cr r r!r/ sz!_find_channel..rz)unique NDS2 channel match not found for 'r6) _strip_ctype get_protocolrrr<)rfrctypertrr|foundr r r!rs$  rcCshy|dd\}}Wntk r(Yn8Xt|j}|dkr`|tjjtjjfkr`|d|7}||fS)zStrip the ctype from a channel name for the given nds server version This is needed because NDS1 servers store trend channels _including_ the suffix, but not raw channels, and NDS2 doesn't do this. rJr)rWr<rCr>r)rr)rrprotocolZctypestrr r r!rs   rc sddlmm}m}|||tttt|||f|dd}| |} |} x4t || D]&\} } |fdd| D| | <qZW| S)aQuery an NDS2 server for data availability Parameters ---------- channels : `list` of `str` list of channel names to query; this list is mapped to NDS channel names using :func:`find_channels`. start : `int` GPS start time of query end : `int` GPS end time of query connection : `nds2.connection`, optional open NDS2 connection to use for query host : `str`, optional name of NDS2 server to query, required if ``connection`` is not given port : `int`, optional port number on host to use for NDS2 connection Returns ------- segdict : `~gwpy.segments.SegmentListDict` dict of ``(name, SegmentList)`` pairs Raises ------ ValueError if the given channel name cannot be mapped uniquely to a name in the NDS server database. See also -------- nds2.connection.get_availability for documentation on the underlying query method r)Segment SegmentListSegmentListDictT)rbrfr|csg|]}|j|jqSr )rxry)r-s)rr r!r/dsz$get_availability..) segmentsrrrrwrarOrNrget_availabilityzipZ simple_list) rPstartendrfr[r\rrr5resultrrr )rr!r+s-    rcCsD|drt|dd}|dr4t|ddd}t|t|fS)aYExpand a [start, end) interval for use in querying for minute trends NDS2 requires start and end times for minute trends to be a multiple of 60 (to exactly match the time of a minute-trend sample), so this function expands the given ``[start, end)`` interval to the nearest multiples. Parameters ---------- start : `int` GPS start time of query end : `int` GPS end time of query Returns ------- mstart : `int` ``start`` rounded down to nearest multiple of 60 mend : `int` ``end`` rounded up to nearest multiple of 60 <)r$)rrr r r!minute_trend_timesis r)rR)rRr^r_)N)N)F)r)NNN)5rAenumrrTrer1 collectionsr functoolsrrtimerZ utils.enumrZkerberosr __author__compilerdr`Z_NDS2_CHANNEL_TYPEZ_NDS2_DATA_TYPErModuleNotFoundErrorr"dictrrMZdata_type_to_stringIntFlagr#rCrDrE UserWarningrF simplefilterrNrQr]rcrgrjrrrvrzr,rrrrrr r r r!s         5   0  G : ;