国家重点研发计划“SKA前期数据处理系统建设和相关科学预研”简介

在继承平方公里阵列(Square Kilometre Array,SKA)望远镜的中国低频探路者——"宇宙第一缕曙光"探测项目21CMA在十年间所积累的经验和广泛国际合作的基础上,计划小规模改造现有设备,迅速掌握数字多波束合成、高动态大视场成像、前景去除等SKA低频成像的关键核心技术。同时,与SKA低频阵(SKA-low)先导设备MWA(Murchison Widefield Array)开展深层次合作,预选未来用于SKA1-low宇宙再电离深度成像的观测候选区域,为最终利用SKA第一阶段(SKA1)低频阵列,对选定观测候选区域进行深度定点观测做好充分准备,最终实现SKA1既定的首要科学目标。该项目还将建设中国SKA区域中心数据处理原型样机,并以21CMA和MWA实测数据为基础,完成低频射电干涉成像的数据处理流程,为建设中国SKA区域数据中心打下基础。     

面向宇宙再电离探测的基本数据处理方法

宇宙再电离时期(epoch of reionization, Eo R)的探测是SKA的重要科学目标之一,也是目前许多SKA探路者阵列的首要科学目标。由于宇宙再电离信号非常微弱,因此在数据处理的过程中存在许多难点,如高精度校准、大视场高动态成像等。对默奇森宽场阵列(Murchison Widefield Array, MWA)、低频阵列(Low Frequency Array, LOFAR)、21CMA阵列(21 Centimeter Array, 21CMA)等SKA低频先导干涉阵列的基本数据处理方法进行了综述,如干扰的识别与去除、数据校准、可视度研究以及成像研究等,并对数据处理时用到的一些常用技术与软件作了相应的介绍与总结。     

基于NGAS的多点观测数据存储与同步方法

平方千米阵列(Square Kilometre Array, SKA)望远镜建成后将具有超高的灵敏度、超快的巡天速度以及宽视场,进而产生超海量的观测数据。SKA天文台与各国区域数据中心间的海量数据同步传输是当前SKA建设中的一个难点。SKA先导项目使用的下一代归档存储系统(Next Generation Archive System, NGAS)在应用测试中存在效率低下,性能不足等问题。提出了一种基于ZeroMQ的数据存储与同步方法,通过采用更加高效的异步消息机制实现同步传输数据,回避了NGAS原有的采用HTTP协议的局限。实验结果表明,新方法在平均数据归档存储效率方面比原有方法快了近40倍,能够基本满足10 GB带宽的全速传输需要,取得了较好的使用效果。     

基于图像的天体搜索研究与自动化集成软件开发

天体搜索是天文数据处理流程的一个重要环节,也是以平方公里阵列射电望远镜(Square Kilometre Array, SKA)为代表的下一代射电望远镜在面向海量数据处理中的挑战之一.现今天体自动搜索算法、软件已日趋成熟并投入应用,不过在自动化、兼容性等方面仍具有提升空间.以更自动化、更适应海量数据需求的天体搜索算法研究为宗旨,以现有算法为研究基础,天体自动搜索软件系统得到设计和开发.该系统包含友好的交互式用户操作界面,具备可视化输出数据显示、兼容不同数据输入和输出并包含为实际应用服务的文件管理功能.该系统对于大天区图以及图像集,均能够很好地进行自动化处理.测试结果显示,上述方法对于天体搜索的改进有一定成效.后续将在此基础上对该集成系统做进一步的改进开发,以适应更多的需求.     

大质量星系团弥散辐射研究

星系团中的弥散辐射通常以位于中心区域的射电晕或周围区域的射电遗迹形式存在。根据星系团弥散辐射的陡谱特性,通过宽带低频射电波段的观测,能够得到其中射电晕及射电遗迹的频谱特征,从而帮助理解星系团的形成与演化过程。通过分析默奇森宽场阵列(Murchison Widefield Array,MWA)、澳大利亚望远镜阵列(Australia Telescope Compact Array,ATCA)在射电波段对位于红移z=0.098的星系团SPT J2201-5956和位于z=0.232的星系团SPT J2023-5535的观测数据,得到了对应两个星系团的弥散辐射特性。分析结果表明SPT J2201-5956中弥散辐射的谱指数为-1.68_(-0.27)~(+0.27),其来源可能为星系团中的死亡星系;SPT J2023-5535中弥散辐射的谱指数为-1.21_(-0.02)~(+0.02),且其辐射位于星系团的中心区域,因此可以认为该星系团中的弥散源是射电晕候选体。     

30m级光学/红外望远镜的宽视场多目标光谱仪

宽视场多目标光谱仪具有宽波段、多分辨率模式和高通光效率的特点,是极大望远镜终端仪器使用率最高的通用型仪器. 30 m级望远镜的宽视场多目标光谱仪因体量和成本急剧增加而面临重要挑战,同时天文学的不断发展对天文新技术的发展提出了更高的要求,尤其是多个巡天项目对于多目标光谱后随观测的迫切需求.综述了几类宽视场多目标光谱仪的发展现状,介绍了国际3架30 m望远镜宽视场多目标光谱仪概念设计的最新进展和仪器特点,着重介绍了中国参与研制的30 m望远镜(TMT)中的宽视场多目标光谱仪的相关进展.     

中等质量黑洞活动星系核的射电连续谱研究:总结与展望

中等质量黑洞活动星系核(intermediate mass black hole active galactic nuclei, IMBH AGN)是指中心黑洞大约在10~2M⊙~10~6M⊙质量范围的活动星系核。关于近邻宇宙中IMBH AGN的研究,对于理解高红移类星体中的超大质量黑洞起源(即"种子黑洞问题")、低频引力波源等基本问题有着重要意义。得益于近20年来大规模光学光谱巡天的发展,已发现近邻宇宙中的宽线IMBH AGN的数目超过500个。对于这些光学选IMBH AGN,基于VLA FIRST巡天数据,针对小样本或个源的专门射电连续谱观测,已取得不少结果。从射电形态、连续谱谱型、射电功率和射电噪度、黑洞吸积基本面这四个方面,详细地介绍了目前IMBH AGN射电连续谱研究的进展。并且,分别面向当前正在开展的几个SKA探路者大规模连续谱巡天项目,以及大约10年后运行的SKA (至少是SKA一期),展望了IMBH AGN领域将来可以进行研究的科学目标。     

低频射电望远镜阵列宽视场成像技术研究

低频射电望远镜阵列宽视场成像正面临着一系列难点问题,其中最关键的问题是非共面基线效应.它的存在使得忽略w项将导致最终图像出现畸变,且随着视场的增大而加重.综述并剖析了几种w项改正算法及其技术原理,并分析了它们的计算成本和计算复杂度,进而分析比较了它们的优缺点.以平方公里阵(Square Kilometre Array,SKA)射电望远镜第1阶段低频阵列为研究对象,选取faceting和w-projection成像算法进行了仿真实验.与传统的二维傅立叶变换成像算法进行对比,分析了它们的成像质量和正确性,结果表明这两种算法在宽视场成像方面均明显优于二维傅立叶变换方法.还具体分析了分面(facet)的数目对faceting成像质量和运行时间的影响,以及w步数对w-projection成像质量和运行时间的影响,表明facet数目和w步数的选择必须合理.最后,分析了数据量大小对这两种成像算法运行时间的影响,表明这两种算法在进行海量数据处理前,需要作算法优化改进.研究结果为后续进一步综合分析宽视场成像技术以及这些技术的实用性研究提供了有价值的参考.     

基于小波变换的射频干扰消除方法的研究

在射电天文观测中,射频干扰(Radio Frequency Interference, RFI)会以多种形式混入望远镜接收系统,给观测带来误判或者降低观测信噪比.近年来国内国际射电天文快速发展,国内国际大型射电望远镜和阵列先后建设,观测灵敏度大为提高,射频干扰的影响尤为突出.随着科技发展和人类活动的加剧,射频干扰日益严重且不可逆转.提出利用2维离散小波变换的方法分析射电天文观测的数据,对望远镜系统输出的时间频率序列进行小波变换,根据小波系数分离出原始信号中各分量,每个分量统计得到相应的阈值,将各分量与阈值相比较识别干扰成分并标记去除.利用该方法对实际观测数据进行了处理,结果表明该方法能够很好地标记并消减干扰信号,且提高了观测的信噪比.     

伽马天文观测技术综述

伽马射线作为宇宙中极端事件的独特探针,探测伽马射线是人们了解宇宙构成、星体演化和宇宙线起源等的重要途经.伽马天文涉及了宇宙中的各种前沿科学问题并且观测所需能谱跨度极宽(102 keV–102 TeV),针对不同的科学目标和细分谱段,必须利用不同的伽马望远镜探测技术.总结了空间和地面的共5大类伽马射线观测技术,分别是编码孔径望远镜、康普顿望远镜、电子对望远镜、成像大气切伦科夫望远镜和广延大气簇射阵列;回顾了70 yr来在观测设备和技术进步的推动下伽马射线天文学领域的巨大进展,其中包含高能和甚高能谱段取得的大量成就,中低能段由于已有观测任务有限以及灵敏度低,超高能和极高能段由于观测难度大、起步时间晚,数据和成果相对其他谱段产出较少;展望了未来已经规划的伽马望远镜任务、能力及预期科学产出,其中,中低能段空间望远镜增强型ASTROGAM望远镜(e-ASTROGAM)、全天区中能伽马射线观测站(AMEGO)和甚高能段地面望远镜阵列高海拔宇宙线观测站(LHAASO)、切伦科夫望远镜阵列(CTA),由于灵敏度较同谱段已有任务灵敏度有大幅提升,极有可能在20 yr内从不同角度再度扩展人类对伽马宇宙的认知.     

Optimising NGAS for the MWA Archive

The Murchison Widefield Array (MWA) is a next-generation radio telescope, generating visibility data products continuously at about 400 MB/s. Efficiently managing and archiving this data is a challenge. The MWA Archive consists of dataflows and storage sub-systems distributed across three tiers. At its core is the open source software—the Next-Generation Archive System (NGAS)—that was initially developed in ESO. However, to meet the MWA data challenge, we have tailored and optimised NGAS to achieve high-throughput data ingestion, efficient data flow management, multi-tiered data storage and processing-aware data staging.     

Remote Sensing of the Heliosphere with the Murchison Widefield Array

The Murchison Widefield Array (MWA) is one of the new technology low frequency radio interferometers currently under construction at an extremely radio-quiet location in Western Australia. The MWA design brings to bear the recent availability of powerful high-speed computational and digital signal processing capabilities on the problem of low frequency high-fidelity imaging with a rapid cadence and high spectral resolution. Solar and heliosphere science are among the key science objectives of the MWA and have guided the array design from its very conception. We present here a brief overview of the design and capabilities of the MWA with emphasis on its suitability for solar physics and remote-sensing of the heliosphere. We discuss the solar imaging and interplanetary scintillation (IPS) science capabilities of the MWA and also describe a new software framework. This software, referred to as Haystack InterPlanetary Software System (HIPSS), aims to provide a common data repository, interface, and analysis tools for IPS data from all observatories across the world.     

A generalized measurement equation and van Cittert-Zernike theorem for wide-field radio astronomical interferometry

We derive a generalized van Cittert-Zernike (vC-Z) theorem for radio astronomy that is valid for partially polarized sources over an arbitrarily wide field of view (FoV). The classical vC-Z theorem is the theoretical foundation of radio astronomical interferometry, and its application is the basis of interferometric imaging. Existing generalized vC-Z theorems in radio astronomy assume, however, either paraxiality (narrow FoV) or scalar (unpolarized) sources. Our theorem uses neither of these assumptions, which are seldom fulfiled in practice in radio astronomy, and treats the full electromagnetic field. To handle wide, partially polarized fields, we extend the two-dimensional (2D) electric field (Jones vector) formalism of the standard 'Measurement Equation' (ME) of radio astronomical interferometry to the full three-dimensional (3D) formalism developed in optical coherence theory. The resulting vC-Z theorem enables full-sky imaging in a single telescope pointing, and imaging based not only on standard dual-polarized interferometers (that measure 2D electric fields) but also electric tripoles and electromagnetic vector-sensor interferometers. We show that the standard 2D ME is easily obtained from our formalism in the case of dual-polarized antenna element interferometers. We also exploit an extended 2D ME to determine that dual-polarized interferometers can have polarimetric aberrations at the edges of a wide FoV. Our vC-Z theorem is particularly relevant to proposed, and recently developed, wide FoV interferometers such as Low Frequency Array (LOFAR) and Square Kilometer Array (SKA), for which direction-dependent effects will be important.     

Australian research effort for the SKA

The next generation radio telescope being planned is the Square Kilometer Array (SKA): an international project which is currently in the research and development phase. Australia is one of the partner countries in the SKA consortium; here I describe some of the SKA research being undertaken in Australia. This revised version was published online in July 2006 with corrections to the Cover Date.     

The Square Kilometre Array: An International Engineering Perspective

The pace of the international Square Kilometre Array (SKA) project is accelerating, with major concept reviews recently completed and a number of technology demonstrators well underway. First-round submissions to host the telescope were lodged by six countries. The SKA timeline currently shows a site decision in 2006, and one or more technology concepts chosen in 2008. The telescope is expected to be operational, in various phases, in the period 2015–2020. This paper gives a status review of the project, and outlines engineering concept development and demonstration projects.     

Adaptive scale model reconstruction for radio synthesis imaging

A sky model from CLEAN deconvolution is a particularly effective high dynamic range reconstruction in radio astronomy,which can effectively model the sky and remove the sidelobes of the point spread function(PSF)caused by incomplete sampling in the spatial frequency domain.Compared to scale-free and multi-scale sky models,adaptive-scale sky modeling,which can model both compact and diffuse features,has been proven to have better sky modeling capabilities in narrowband simulated data,especially for large-scale features in high-sensitivity observations which are exactly one of the challenges of data processing for the Square Kilometre Array(SKA).However,adaptive scale CLEAN algorithms have not been verified by real observation data and allow negative components in the model.In this paper,we propose an adaptive scale model algorithm with non-negative constraint and wideband imaging capacities,and it is applied to simulated SKA data and real observation data from the Karl G.Jansky Very Large Array(JVLA),an SKA precursor.Experiments show that the new algorithm can reconstruct more physical models with rich details.This work is a step forward for future SKA image reconstruction and developing SKA imaging pipelines.     

Research on Parallel Algorithms for uv-faceting Imaging

The uv-faceting imaging is one of the widely used large field of view imaging technologies, and will be adopted for the data processing of the low-frequency array in the first stage of the Square Kilometre Array (SKA1). Due to the scale of the raw data of SKA1 is unprecedentedly large, the efficiency of data processing directly using the original uv-faceting imaging will be very low. Therefore, a uv-faceting imaging algorithm based on the MPI (Message Passing Interface)+OpenMP (Open Multi-Processing) and a uv-faceting imaging algorithm based on the MPI+CUDA (Compute Unified Device Architecture) are proposed. The most time-consuming data reading and gridding in the algorithm are optimized in parallel. The verification results show that the results of the proposed two algorithms are basically consistent with that obtained by the current mainstream data processing software CASA (Common Astronomy Software Applications), which indicates that the proposed two algorithms are basically correct. Further analysis of the accuracy and total running time shows that the MPI+CUDA method is better than the MPI+OpenMP method in both the correctness rate and running speed. The performance test results show that the proposed algorithms are effective and have certain extensibility.     

Fine-grained distributed averaging for large-scale radio interferometric measurement sets

The Square Kilometre Array(SKA) would be the world's largest radio telescope with eventually over a square kilometre of collecting area.However,there are enormous challenges in its data processing.The use of modern distributed computing techniques to solve the problem of massive data processing in the SKA is one of the most important challenges.In this study,basing on the Dask distribution computational framework,and taking the visibility function integral processing as an example,we adopt a multi-level parallelism method to implement distributed averaging over time and channel.Dask Array was used to implement super large matrix or arrays with supported parallelism.To maximize the usage of memory,we further exploit the data parallelism provided by Dask that intelligently distributes the computational load across a network of computer agents and has a built-in fault tolerance mechanism.The validity of the proposed pattern was also verified by using the Common Astronomy Software Application(CASA),wherein we analyze the smearing effects on images reconstructed from different resolution visibilities.     

Enhanced remote astronomical archive system based on the file-level Unlimited Sliding-Window technique

Data archiving is one of the most critical issues for modern astronomical observations. With the development of a new generation of radio telescopes, the transfer and archiving of massive remote data have become urgent problems to be solved. Herein, we present a practical and robust file-level flow-control approach, called the Unlimited Sliding-Window(USW), by referring to the classic flow-control method in the TCP protocol. Based on the USW and the Next Generation Archive System(NGAS) developed for the Murchison Widefield Array telescope, we further implemented an enhanced archive system(ENGAS)using ZeroMQ middleware. The ENGAS substantially improves the transfer performance and ensures the integrity of transferred files. In the tests, the ENGAS is approximately three to twelve times faster than the NGAS and can fully utilize the bandwidth of network links. Thus, for archiving radio observation data, the ENGAS reduces the communication time, improves the bandwidth utilization, and solves the remote synchronous archiving of data from observatories such as Mingantu spectral radioheliograph. It also provides a better reference for the future construction of the Square Kilometer Array(SKA) Science Regional Center.