date: dim. 06 juil. 2025 07:45:01 CEST ===================================================== name=CFHT (obscore), dir=cfht, script=update ===================================================== 05:45:05:debug:https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/argus//availability 05:45:05:debug:lastmodified: update(cadc) 2023-04-30 03:38:10, delete(local) 736141091 05:45:06:debug:copy ReadMe to v143 05:45:06:debug:copy .Summary to v143 05:45:06:debug:copy obscore.dump to v143 05:45:16:debug:get data 05:45:16:debug:TAP(GET): https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/argus///sync?request=doQuery&phase=RUN&lang=ADQL&format=csv&query=SELECT+TOP+250000+obs_publisher_did,obs_collection,facility_name,instrument_name,obs_id,dataproduct_type,calib_level,obs_release_date,target_name,s_ra,s_dec,s_fov,s_region,s_resolution,s_xel1,s_xel2,t_min,t_max,t_exptime,t_resolution,t_xel,em_min,em_max,em_res_power,em_xel,em_ucd,pol_states,pol_xel,o_ucd,access_format,access_estsize,core_id,lastModified+FROM+ivoa.obscore+WHERE+obs_collection=%27CFHT%27+AND+lastModified%3E=%272023-04-30+03:38:10%27+ORDER+BY+lastModified+ASC 05:45:16:error:b'validateColumnNonAlias: Column: [core_id] does not exist.\n' [debug] close cursor [debug] SQL:select max(lastModified)-7200 as maxdate from b_extern.c102005obscore [debug] begin! [debug] ['736141090'] [debug] close cursor [debug] close cursor [debug] SQL:SELECT t.dbname, d.login FROM METAtab t JOIN METAdba d ON t.dbaid=d.dbaid WHERE t.name='B/cfht/obscore' [debug] begin! [debug] ['dbname', 'login'] [debug] ['c102005obscore', 'B_extern@VIZIR'] [debug] close cursor Traceback (most recent call last): File "/data/too/pyreadme/getCADC.py", line 203, in nrec = obstapManager.update("obscore", adql, vizdb, getdatafn=csv_to_dat) File "/home/cds/pythonlib/cds.pyreadme/catb.py", line 778, in update filetsv = getdatafn(self.__tap, adql, fm.tmpdirectory+"/"+filename+"."+TAP_CSV) File "/data/too/pyreadme/getCADC.py", line 178, in csv_to_dat filename = catb.default__getTAP(tap, adql, filename, fmt=catb.TAP_CSV) File "/home/cds/pythonlib/cds.pyreadme/catb.py", line 581, in default__getTAP tap.sync(adql, out) File "/home/cds/pythonlib/cds.pyreadme/catb.py", line 447, in sync raise Exception("Error connection to {0}: response={1}".format(self.__server, resp)) Exception: Error connection to https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/argus/: response={'server': 'OpenCADC/cadc-rest', 'www-authenticate': 'ivoa_cookie, ivoa_x509 standard_id="ivo://ivoa.net/sso#cookie", access_url="https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/cred/generate", ivoa_x509 standard_id="ivo://ivoa.net/sso#BasicAA", access_url="https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/cred/generate", ivoa_x509 standard_id="ivo://ivoa.net/sso#token", access_url="https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/cred/generate", ivoa_x509, ivoa_bearer standard_id="ivo://ivoa.net/sso#tls-with-password", access_url="https://ws-cadc.canfar.net/ac/login", HACK=temporary, Bearer', 'content-disposition': 'inline; filename="error_ibikv5sfw1kvozhy.csv"', 'content-type': 'text/plain', 'content-length': '58', 'date': 'Sun, 06 Jul 2025 05:45:16 GMT', 'strict-transport-security': 'max-age=63072000', 'status': '400'} error= vizaqbox -Ucds -P@cds4Viz -SVIZDB 102005 ++++vc_coo can't change epoch ++++increase the precision for computed column 15 ++++increase the precision for computed column 15 #...CooCompute fk5(Eq=2000, Ep=2000) from: fk5(Eq=2000, Ep=2000) [x1] ++++vc_coo can't change epoch ++++increase the precision for computed column 7 ++++increase the precision for computed column 7 #...CooCompute fk5(Eq=2000, Ep=2000) from: fk5(Eq=2000, Ep=2000) [x2] ---- Copied 77863 records in METAcell ....Insert into metaviz.METAcell00 select 102005, c.qb1, c.ns => 166 ....Insert into metaviz.METAcell02 select 102005, c.qb1, c.ns => 2425 ....Insert into metaviz.METAcell03 select 102005, c.qb1, c.ns => 1200 ....Insert into metaviz.METAcell09 select 102005, c.qb1, c.ns => 17393 ....Insert into metaviz.METAcell0a select 102005, c.qb1, c.ns => 11079 ....Insert into metaviz.METAcell0b select 102005, c.qb1, c.ns => 16681 ....Insert into metaviz.METAcell0c select 102005, c.qb1, c.ns => 14985 ....Insert into metaviz.METAcell0d select 102005, c.qb1, c.ns => 13564 ....Insert into metaviz.METAcell0e select 102005, c.qb1, c.ns => 370 ====Total counts: 3511554 ====Total non-empty qboxes: 77863 #===Items in list: 9 #===Items in list: 9 ===================================================== name=HST (obscore), dir=hst, script=update ===================================================== 05:46:33:debug:https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/argus//availability [debug] close cursor [debug] SQL:select max(lastModified)-7200 as maxdate from b_extern.c102004obscore Traceback (most recent call last): File "/home/cds/pythonlib/vizier.ingestion/tools/CDSdb.py", line 336, in execute raise Exception(err) Exception: b"ERREUR: la relation \xc2\xab b_extern.c102004obscore \xc2\xbb n'existe pas\n" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/data/too/pyreadme/getCADC.py", line 167, in lastModified = getLastModifiedDate(dbconn, cat["catid"], __schema) File "/data/too/pyreadme/getCADC.py", line 65, in getLastModifiedDate curs.execute("select max(lastModified)-{0} as maxdate from {1}.c{2}obscore".format(SECOND_BEFORE_LAST_MODIFIED, schema, catid)) File "/home/cds/pythonlib/vizier.ingestion/tools/CDSdb.py", line 344, in execute raise CDSdbException("error in execution: "+str(msg)) CDSdb.CDSdbException: (CDSdbException) error in execution: b"ERREUR: la relation \xc2\xab b_extern.c102004obscore \xc2\xbb n'existe pas\n" error= vizaqbox -Ucds -P@cds4Viz -SVIZDB 102004 ++++vc_coo can't change epoch ++++increase the precision for computed column 15 ++++increase the precision for computed column 15 #...CooCompute fk5(Eq=2000, Ep=2000) from: fk5(Eq=2000, Ep=2000) [x1] ++++vc_coo can't change epoch ++++increase the precision for computed column 8 ++++increase the precision for computed column 8 #...CooCompute fk5(Eq=2000, Ep=2000) from: fk5(Eq=2000, Ep=2000) [x2] **** **** -- no connection **** Report from: stdb_pg, Status: STDB_ERR ****Postgres connect error **** **** -- no connection **** Report from: stdb_pg_conn, Status: STDB_ERR ****Couldn't connect with server **** **** -- no connection **** Report from: stdb_conn_dbms, Status: STDB_ERR ****No server is available for connection ****Error #===Items in list: 9 #===Items in list: 9 ===================================================== name=GEMINI (obscore), dir=gemini, script=update ===================================================== 05:49:08:debug:https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/argus//availability 05:49:08:debug:lastmodified: update(cadc) 2024-03-09 14:25:08, delete(local) 763309509 05:49:08:debug:copy ReadMe to v119 05:49:08:debug:copy .Summary to v119 05:49:08:debug:copy obscore.dump to v119 05:49:11:debug:get data 05:49:12:debug:TAP(GET): https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/argus///sync?request=doQuery&phase=RUN&lang=ADQL&format=csv&query=SELECT+TOP+200000+obs_publisher_did,obs_collection,facility_name,instrument_name,obs_id,dataproduct_type,calib_level,obs_release_date,target_name,s_ra,s_dec,s_fov,s_region,s_resolution,s_xel1,s_xel2,t_min,t_max,t_exptime,t_resolution,t_xel,em_min,em_max,em_res_power,em_xel,em_ucd,pol_states,pol_xel,o_ucd,access_format,access_estsize,core_id,lastModified+FROM+ivoa.obscore+WHERE+obs_collection=%27GEMINI%27+AND+lastModified%3E=%272024-03-09+14:25:08%27+ORDER+BY+lastModified+ASC 05:49:12:error:b'validateColumnNonAlias: Column: [core_id] does not exist.\n' [debug] close cursor [debug] SQL:select max(lastModified)-7200 as maxdate from b_extern.c102037obscore [debug] begin! [debug] ['763309508'] [debug] close cursor [debug] close cursor [debug] SQL:SELECT t.dbname, d.login FROM METAtab t JOIN METAdba d ON t.dbaid=d.dbaid WHERE t.name='B/gemini/obscore' [debug] begin! [debug] ['dbname', 'login'] [debug] ['c102037obscore', 'B_extern@VIZIR'] [debug] close cursor Traceback (most recent call last): File "/data/too/pyreadme/getCADC.py", line 203, in nrec = obstapManager.update("obscore", adql, vizdb, getdatafn=csv_to_dat) File "/home/cds/pythonlib/cds.pyreadme/catb.py", line 778, in update filetsv = getdatafn(self.__tap, adql, fm.tmpdirectory+"/"+filename+"."+TAP_CSV) File "/data/too/pyreadme/getCADC.py", line 178, in csv_to_dat filename = catb.default__getTAP(tap, adql, filename, fmt=catb.TAP_CSV) File "/home/cds/pythonlib/cds.pyreadme/catb.py", line 581, in default__getTAP tap.sync(adql, out) File "/home/cds/pythonlib/cds.pyreadme/catb.py", line 447, in sync raise Exception("Error connection to {0}: response={1}".format(self.__server, resp)) Exception: Error connection to https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/argus/: response={'server': 'OpenCADC/cadc-rest', 'www-authenticate': 'ivoa_cookie, ivoa_x509 standard_id="ivo://ivoa.net/sso#cookie", access_url="https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/cred/generate", ivoa_x509 standard_id="ivo://ivoa.net/sso#BasicAA", access_url="https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/cred/generate", ivoa_x509 standard_id="ivo://ivoa.net/sso#token", access_url="https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/cred/generate", ivoa_x509, ivoa_bearer standard_id="ivo://ivoa.net/sso#tls-with-password", access_url="https://ws-cadc.canfar.net/ac/login", HACK=temporary, Bearer', 'content-disposition': 'inline; filename="error_i7hl9wk1r7i6adw0.csv"', 'content-type': 'text/plain', 'content-length': '58', 'date': 'Sun, 06 Jul 2025 05:49:12 GMT', 'strict-transport-security': 'max-age=63072000', 'status': '400'} error= ****vizier name is not resolved ===================================================== name=JCMT (obscore), dir=jcmt, script=update ===================================================== 05:49:14:debug:https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/argus//availability [debug] close cursor [debug] SQL:select max(lastModified)-7200 as maxdate from B_extern.c102038obscore Traceback (most recent call last): File "/home/cds/pythonlib/vizier.ingestion/tools/CDSdb.py", line 336, in execute raise Exception(err) Exception: b'psql: erreur : la connexion au serveur sur \xc2\xab 130.79.128.5 \xc2\xbb, port 5432 a \xc3\xa9chou\xc3\xa9 : FATAL: les emplacements de connexions restants sont r\xc3\xa9serv\xc3\xa9s pour les connexions\n' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/data/too/pyreadme/getCADC.py", line 167, in lastModified = getLastModifiedDate(dbconn, cat["catid"], __schema) File "/data/too/pyreadme/getCADC.py", line 65, in getLastModifiedDate curs.execute("select max(lastModified)-{0} as maxdate from {1}.c{2}obscore".format(SECOND_BEFORE_LAST_MODIFIED, schema, catid)) File "/home/cds/pythonlib/vizier.ingestion/tools/CDSdb.py", line 344, in execute raise CDSdbException("error in execution: "+str(msg)) CDSdb.CDSdbException: (CDSdbException) error in execution: b'psql: erreur : la connexion au serveur sur \xc2\xab 130.79.128.5 \xc2\xbb, port 5432 a \xc3\xa9chou\xc3\xa9 : FATAL: les emplacements de connexions restants sont r\xc3\xa9serv\xc3\xa9s pour les connexions\n' error= vizaqbox -Ucds -P@cds4Viz -SVIZDB 102038 ++++vc_coo can't change epoch ++++increase the precision for computed column 13 ++++increase the precision for computed column 13 #...CooCompute fk5(Eq=2000, Ep=2000) from: fk5(Eq=2000, Ep=2000) [x1] ---- Copied 44 records in METAcell ....Insert into metaviz.METAcell00 select 102038, c.qb1, c.ns => 0 ....Insert into metaviz.METAcell02 select 102038, c.qb1, c.ns => 0 ....Insert into metaviz.METAcell03 select 102038, c.qb1, c.ns => 0 ....Insert into metaviz.METAcell09 select 102038, c.qb1, c.ns => 15 ....Insert into metaviz.METAcell0a select 102038, c.qb1, c.ns => 10 ....Insert into metaviz.METAcell0b select 102038, c.qb1, c.ns => 1 ....Insert into metaviz.METAcell0c select 102038, c.qb1, c.ns => 6 ....Insert into metaviz.METAcell0d select 102038, c.qb1, c.ns => 12 ....Insert into metaviz.METAcell0e select 102038, c.qb1, c.ns => 0 ====Total counts: 115 ====Total non-empty qboxes: 44 #===Items in list: 9 #===Items in list: 9 ===================================================== name=DAO (obscore), dir=dao, script=update ===================================================== 05:49:18:debug:https://ws.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/argus//availability [debug] close cursor [debug] SQL:select max(lastModified)-7200 as maxdate from b_extern.c102041obscore Traceback (most recent call last): File "/home/cds/pythonlib/vizier.ingestion/tools/CDSdb.py", line 336, in execute raise Exception(err) Exception: b'psql: erreur : la connexion au serveur sur \xc2\xab 130.79.128.5 \xc2\xbb, port 5432 a \xc3\xa9chou\xc3\xa9 : FATAL: les emplacements de connexions restants sont r\xc3\xa9serv\xc3\xa9s pour les connexions\n' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/data/too/pyreadme/getCADC.py", line 167, in lastModified = getLastModifiedDate(dbconn, cat["catid"], __schema) File "/data/too/pyreadme/getCADC.py", line 65, in getLastModifiedDate curs.execute("select max(lastModified)-{0} as maxdate from {1}.c{2}obscore".format(SECOND_BEFORE_LAST_MODIFIED, schema, catid)) File "/home/cds/pythonlib/vizier.ingestion/tools/CDSdb.py", line 344, in execute raise CDSdbException("error in execution: "+str(msg)) CDSdb.CDSdbException: (CDSdbException) error in execution: b'psql: erreur : la connexion au serveur sur \xc2\xab 130.79.128.5 \xc2\xbb, port 5432 a \xc3\xa9chou\xc3\xa9 : FATAL: les emplacements de connexions restants sont r\xc3\xa9serv\xc3\xa9s pour les connexions\n' error= vizaqbox -Ucds -P@cds4Viz -SVIZDB 102041 ++++vc_coo can't change epoch ++++increase the precision for computed column 14 ++++increase the precision for computed column 14 #...CooCompute fk5(Eq=2000, Ep=2000) from: fk5(Eq=2000, Ep=2000) [x1] ---- Copied 149 records in METAcell ....Insert into metaviz.METAcell00 select 102041, c.qb1, c.ns => 0 ....Insert into metaviz.METAcell02 select 102041, c.qb1, c.ns => 0 ....Insert into metaviz.METAcell03 select 102041, c.qb1, c.ns => 0 ....Insert into metaviz.METAcell09 select 102041, c.qb1, c.ns => 48 ....Insert into metaviz.METAcell0a select 102041, c.qb1, c.ns => 40 ....Insert into metaviz.METAcell0b select 102041, c.qb1, c.ns => 29 ....Insert into metaviz.METAcell0c select 102041, c.qb1, c.ns => 10 ....Insert into metaviz.METAcell0d select 102041, c.qb1, c.ns => 22 ....Insert into metaviz.METAcell0e select 102041, c.qb1, c.ns => 0 ====Total counts: 1000 ====Total non-empty qboxes: 149 #===Items in list: 9 #===Items in list: 9 ===================================================== name=SWIFT, dir=swift, script=update ===================================================== [debug] export PGPASSWORD=@cds4Viz;psql -U cds -d vizier -h 130.79.128.5 -p 5432 [debug] close cursor [debug] SQL:SELECT t.dbname, d.login FROM METAtab t JOIN METAdba d ON t.dbaid=d.dbaid WHERE t.name='B/swift/swiftlog' Traceback (most recent call last): File "/home/cds/pythonlib/CDSdb.py", line 336, in execute raise Exception(err) Exception: b'psql: erreur : la connexion au serveur sur \xc2\xab 130.79.128.5 \xc2\xbb, port 5432 a \xc3\xa9chou\xc3\xa9 : FATAL: les emplacements de connexions restants sont r\xc3\xa9serv\xc3\xa9s pour les connexions\n' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "./getswift", line 171, in nrec = updateSwift() File "./getswift", line 108, in updateSwift vizdb = catb.VizieRDBObject(cnx, "B/swift/"+NAME) File "/data/too/pyreadme/catb.py", line 490, in __init__ dbinfo = self.__getSchema(tablename) File "/data/too/pyreadme/catb.py", line 504, in __getSchema curs.execute("SELECT t.dbname, d.login FROM METAtab t JOIN METAdba d ON t.dbaid=d.dbaid WHERE t.name='"+self.__tablename+"'") File "/home/cds/pythonlib/CDSdb.py", line 344, in execute raise CDSdbException("error in execution: "+str(msg)) CDSdb.CDSdbException: (CDSdbException) error in execution: b'psql: erreur : la connexion au serveur sur \xc2\xab 130.79.128.5 \xc2\xbb, port 5432 a \xc3\xa9chou\xc3\xa9 : FATAL: les emplacements de connexions restants sont r\xc3\xa9serv\xc3\xa9s pour les connexions\n' ===================================================== name=ASSOCDATA (obscore), dir=assocdata, script=update ===================================================== number of records: 8363097 1 update qboxes... >>>>>>>>>>>> begin vizin program **** **** -- no connection **** Report from: stdb_pg, Status: STDB_ERR ****Postgres connect error **** **** -- no connection **** Report from: stdb_pg_conn, Status: STDB_ERR ****Couldn't connect with server **** **** -- no connection **** Report from: stdb_conn_dbms, Status: STDB_ERR ****No server is available for connection ****Can't connect to ReferenceDirectory 'metaviz@VIZIR' **** **** -- no connection **** Report from: stdb_pg, Status: STDB_ERR ****Postgres connect error **** **** -- no connection **** Report from: stdb_pg_conn, Status: STDB_ERR ****Couldn't connect with server **** **** -- no connection **** Report from: stdb_conn_dbms, Status: STDB_ERR ****No server is available for connection Segmentation fault (core dumped) cat: /tmp/viz3300671.foot: No such file or directory #...qfoot catid=102036 => 1327 boxes. gawk: cmd. line:8: (FILENAME=- FNR=143) fatal: division by zero attempted cat: /tmp/viz3300671.foot: No such file or directory #...qfootimage catid=102036 -gal -z 5 -swing 1 => ./+footg5.gif #===Items in list: 9 #...qfootimage catid=102036 -gal -z 8 -swing 1 => ./+footg8.gif #===Items in list: 9 ===================================================== name=IAU27 (archives), dir=/ftp/catx/iau27, script=update ===================================================== ###################################################################### # IAU27 (Archives) ###################################################################### #...Getting IBVS#2246 /tmp/IBVS-2246: File exists. URL transformed to HTTPS due to an HSTS policy --2025-07-06 07:49:33-- https://www.konkoly.hu/cgi-bin/IBVS?2246 Resolving www.konkoly.hu (www.konkoly.hu)... 217.144.56.57 Connecting to www.konkoly.hu (www.konkoly.hu)|217.144.56.57|:443... connected. HTTP request sent, awaiting response... 301 Moved Permanently Location: https://konkoly.hu/cgi-bin/IBVS?2246 [following] --2025-07-06 07:49:34-- https://konkoly.hu/cgi-bin/IBVS?2246 Resolving konkoly.hu (konkoly.hu)... 217.144.56.57 Connecting to konkoly.hu (konkoly.hu)|217.144.56.57|:443... connected. HTTP request sent, awaiting response... 404 Not Found 2025-07-06 07:49:34 ERROR 404: Not Found. cmp: EOF on /tmp/IBVS-2246 which is empty #***New version of /ftp/catx/iau27/.IBVS-2246: wc: /tmp/IBVS2246.txt: No such file or directory 432 2785 28041 /ftp/catx/iau27/.IBVS-2246 432 2785 28041 total #===Replace /ftp/catx/iau27/.IBVS-2246 ===================================================== name=FIRST data (alert only if new HTML page), dir=/ftp/cats/VIII/92, script=update ===================================================== ###################################################################### # FIRST data ###################################################################### #...Verify FIRST --2025-07-06 07:49:34-- http://sundog.stsci.edu/first/catalogs/ Resolving sundog.stsci.edu (sundog.stsci.edu)... 130.167.201.60 Connecting to sundog.stsci.edu (sundog.stsci.edu)|130.167.201.60|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 20773 (20K) [text/html] Saving to: 'STDOUT' 0K .......... .......... 100% 191K=0.1s 2025-07-06 07:49:35 (191 KB/s) - written to stdout [20773/20773] #===No change in FIRST (/ftp/cats/VIII/92) ===================================================== name=GAMA (alert only if new HTML page), dir=/ftp/cats/J/MNRAS/413/971, script=update ===================================================== ###################################################################### # GAMA ###################################################################### #...Verify GAMA (J/MNRAS/413/971) --2025-07-06 07:49:35-- http://www.gama-survey.org/ Resolving www.gama-survey.org (www.gama-survey.org)... 134.100.28.116 Connecting to www.gama-survey.org (www.gama-survey.org)|134.100.28.116|:80... connected. HTTP request sent, awaiting response... 302 Found Location: https://www.gama-survey.org/ [following] --2025-07-06 07:49:35-- https://www.gama-survey.org/ Connecting to www.gama-survey.org (www.gama-survey.org)|134.100.28.116|:443... connected. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/html] Saving to: 'index.html.302' 0K .......... .......... .... 1.21M=0.02s 2025-07-06 07:49:35 (1.21 MB/s) - 'index.html.302' saved [25012] cmp: EOF on /tmp/gama.html which is empty #***GAMA (J/MNRAS/413/971) description modified? 0 0 0 /tmp/gama.html 599 1513 21498 /ftp/cats/J/MNRAS/413/971/gama.html 599 1513 21498 total