Nature Communications

Nat Commun. 9: 210

An equation-of-state-meter of quantum chromodynamics transition from deep learning

http://orcid.org/0000-0002-1279-7008Long-Gang Pang

lgpang.1984@berkeley.edu

¹²³, http://orcid.org/0000-0001-9859-1758Kai Zhou

zhou@fias.uni-frankfurt.de

¹⁴, Nan Su

nansu@fias.uni-frankfurt.de

¹, http://orcid.org/0000-0002-6213-3613Hannah Petersen¹⁴⁵, Horst Stöcker¹⁴⁵, http://orcid.org/0000-0002-9734-9967Xin-Nian Wang³⁶

1. 0000 0004 1936 9721grid.7839.5Frankfurt Institute for Advanced Studies, 60438 Frankfurt am Main, Germany

2. 0000 0001 2181 7878grid.47840.3fDepartment of Physics, University of California, Berkeley, CA 94720 USA

3. 0000 0001 2231 4551grid.184769.5Nuclear Science Division, Lawrence Berkeley National Laboratory, Berkeley, CA 94720 USA

4. 0000 0004 1936 9721grid.7839.5Institut für Theoretische Physik, Goethe Universität, 60438 Frankfurt am Main, Germany

5. 0000 0000 9127 4365grid.159791.2GSI Helmholtzzentrum für Schwerionenforschung, 64291 Darmstadt, Germany

6. 0000 0004 1760 2614grid.411407.7Key Laboratory of Quark and Lepton Physics (MOE) and Institute of Particle Physics, Central China Normal University, Wuhan, 430079 China

© The Author(s) 2018

DOI: 10.1038/s41467-017-02726-3

Published online: 15 January 2018

Abstract

A primordial state of matter consisting of free quarks and gluons that existed in the early universe a few microseconds after the Big Bang is also expected to form in high-energy heavy-ion collisions. Determining the equation of state (EoS) of such a primordial matter is the ultimate goal of high-energy heavy-ion experiments. Here we use supervised learning with a deep convolutional neural network to identify the EoS employed in the relativistic hydrodynamic simulations of heavy ion collisions. High-level correlations of particle spectra in transverse momentum and azimuthal angle learned by the network act as an effective EoS-meter in deciphering the nature of the phase transition in quantum chromodynamics. Such EoS-meter is model-independent and insensitive to other simulation inputs including the initial conditions for hydrodynamic simulations.

Abstract

The large data generated in heavy-ion collision experiments require careful analysis to understand the physics. Here the authors use the deep-learning method to sort equation of states in QCD transition and analyze the simulated data sets mimicking the heavy-ion collision experiments.

Introduction

Deep learning (DL) is a branch of machine learning that learns multiple levels of representations from data¹,². DL has been successfully applied in pattern recognition and classification tasks, such as image recognition and language processing. Recently, the application of DL to physics research is rapidly growing, such as in particle physics³–⁷, nuclear physics⁸, and condensed matter physics⁹–¹⁴. DL is shown to be very powerful in extracting pertinent features especially for complex non-linear systems with high-order correlations that conventional techniques are unable to tackle. This suggests that it could be utilized to unveil hidden information from the highly implicit data of heavy-ion experiments.

Strong interaction in nuclear matter is governed by the theory of quantum chromodynamics (QCD). It predicts a transition from the normal nuclear matter, in which the more fundamental constituents, quarks and gluons, are confined within the domains of nucleons, to a new form of matter with freely roaming quarks and gluons as one increases the temperature or density. The QCD transition is conjectured to be a crossover at small density (and moderately high temperature), and first order at moderate density (and lower temperature), with a critical point separating the two, see Fig. 1 for a schematic QCD phase diagram and¹⁵–¹⁷ for some reviews. One primary goal of ultra-relativistic heavy-ion collisions is to study the QCD transition.

Fig. 1View larger versionFig. 1. The conjectured phase diagram in quantum chromodynamics. In the region with high temperature and small baryon chemical potential, the phase transition between hadronic matter and quark–gluon plasma is a cross over according to lattice QCD calculations (blue dashed line in the small insert). In the region with low temperature and moderately high baryon chemical potential, the phase transition is first order (red line in the small insert). At low temperature and high baryon chemical potential, there might exist other phases, such as color superconductor

Though it is believed that strongly coupled QCD matter can be formed in heavy-ion collisions at the Relativistic Heavy Ion Collider (RHIC, Brookhaven National Laboratory, USA)¹⁸, Large Hadron Collider (LHC, European Organization for Nuclear Research, Switzerland)¹⁹, and at the forthcoming Facility for Anti-proton and Ion Research (FAIR, GSI Helmholtz Centre for Heavy Ion Research, Germany)²⁰,²¹, a direct access to the bulk properties of the matter such as the equation of state (EoS) and transport coefficients is impossible due to the highly dynamical nature of the collisions. In heavy-ion collisions where two high-energy nuclei collide along the longitudinal (z) direction, what experiments measure directly are the final-state particle distributions in longitudinal momentum (rapidity), transverse momentum pT and azimuthal angle ϕ.

Current efforts to extract physical properties of the QCD matter from experimental data are through direct comparisons with model calculations of event-averaged and predefined observables, such as anisotropic flow²² or global fitting of a set of observables with Bayesian method²³,²⁴. However, event-by-event raw data on ρ(pT, ϕ) at different rapidities provide much more information that contains hidden correlations. These hidden correlations can be sensitive to physical properties of the system but independent of other model parameters.

The aim of the present exploratory study is a first step in directly connecting QCD bulk properties and raw data of heavy-ion collisions using state-of-the-art deep-learning techniques. We use the relativistic hydrodynamic model which has been very successful in simulating heavy-ion collisions and connecting experiments with theory²⁵–²⁹. We find unique encoders of bulk properties (here we focus on the EoS) inside ρ(pT, ϕ) in terms of high-level representations using deep-learning techniques, which are not captured by conventional observables. This is achieved by constructing a convolutional neural network (CNN) and training it with labeled ρ(pT, ϕ) of charged pions generated from the relativistic hydrodynamic program CLVisc³⁰,³¹ with two different EoSs as input: crossover³² and first order³³. The CNN is then trained with supervision in identifying different EoSs. The performance is surprisingly robust against other simulation parameters such as the initial conditions, equilibrium time τ₀, transport coefficients and freeze out temperature. The supervised learning with deep CNN identifies the hydrodynamic response which is much more tolerant to uncertainties in the initial conditions. ρ(pT, ϕ) as generated by independent simulations (CLVisc with different setup parameters and another hydrodynamic package iEBE-VISHNU³⁴ which implements a different numerical solver for partial differential equations) are used for testing—on average a larger than 95% testing accuracy is obtained. It has been recently pointed out that model-dependent features (features in the training data that depends on the simulation model and parameters) may generate large uncertainties in the network performance⁶. The network we develop below is, however, not sensitive to these model-dependent features.

Results

Training and testing data sets

The evolution of strongly coupled QCD matter can be well described by second-order dissipative hydrodynamics governed by ∂μTμν = 0, with Tμν the energy–momentum tensor containing viscous corrections governed by the Israel–Stewart equations²⁵,²⁶. In order to close the hydrodynamic equations, one must supply the EoS of the medium as one crucial input. The nature of the QCD transition in the EoS strongly affects the hydrodynamic evolution³⁵, since different transitions are associated with different pressure gradients which consequently induce different expansion rates, see the small chart in Fig. 1. Final ρ(pT, ϕ) are obtained from the Cooper–Frye formula for particle i at mid-rapidity

1. ρpT,ϕ≡dNidYpTdpTdϕ=gi∫σpμdσμfi,[Image: 41467_2017_2726_Article_Equ1.gif]

Here Ni is the particle number density, Y is the rapidity, gi is the degeneracy, dσμ is the freeze-out hypersurface element, fi is the thermal distribution. In the following, we employ the lattice-EoS parametrization³² (dubbed as EOSL) for the crossover transition and Maxwell construction³³ (dubbed as EOSQ) for the first-order phase transition.

The training data set of ρ(pT, ϕ) (labeled with EOSL or EOSQ) is generated by event-by-event hydrodynamic package CLVisc³⁰,³¹ with fluctuating AMPT initial conditions³⁶. The simulation generated about 22,000 ρ(pT, ϕ) for different types of collisions. Then the size of the training data set is doubled by label-preserving left-right flipping along the ϕ direction. In Table 1 we list the details of the training data set.

See full tableTable 1. The training data set

The testing data set contains two groups of samples. In the first group, we generate 7343 ρ(pT, ϕ) events using the second-order event-by-event hydrodynamic package iEBE-VISHNU³⁴ with MC-Glauber initial condition. In the second group, we generate 10953 ρ(pT, ϕ) events using the CLVisc package with the IP-Glasma-like initial condition²⁴,³⁷. The testing data sets are constructed to explore very different regions of parameters as compared to training data set. The details are listed in Table 2. Note that all the training and testing ρ(pT, ϕ) are preprocessed by ρ′ = ρ/ρmax − 0.5 to normalize the input data.

See full tableTable 2. The testing data set

The existence of physical encoders and neural-network decoder

After training and validating the network, it is tested on the testing data set of ρ(pT, ϕ) events (see Sec. 4 for the details of our neural-network model). As shown in Table 3, high prediction accuracies—on average larger than 95% with small model uncertainties given by a 10-fold cross validation tests—are achieved for these three groups of testing data sets, which indicates that our method is highly independent of initial conditions. The network is robust against shear viscosity and τ₀ due to the inclusion of events with different η/s and τ₀ in the training. In the testing stage the neural network identifies the type of the QCD transition solely from the spectra of each single event. Furthermore, in the training only one freeze-out temperature is used, while the network is tolerant to a wide range of freeze-out temperatures during the testing. For simplicity, the exploratory study has not included pions from resonance decays (the hadronic transport module UrQMD is switched off in iEBE-VISHNU to exclude contributions from resonance decays in testing data).

See full tableTable 3. Testing accuracies

For complex and dynamically evolving systems, the final states may not contain enough information to retrieve the physical properties of initial and intermediate states due to entropy production (information loss) during the evolution. The mean prediction accuracy decreases from 97.1% (for η/s = 0.0) to 96.6% (for η/s = 0.08) and 87% (for η/s = 0.16) in the 10-fold cross validation for testing GROUP 1. Besides, the construction of conventional observables may introduce further information loss due to projection of raw data to lower dimensions, as well as information interference due to its sensitivity to multiple factors. These make it yet unclear how to reliably extract physical properties from raw data. Our study firmly demonstrates how to detect the existence of physical encoders in final states with deep CNN decoders, and sets the stage for further applications, such as identifying all relevant physical properties of the systems.

Observation from the neural-network decoder

In order to get physical insights from the neural-network model, it is instructive to visualize the complex dependences learned by the network. For this purpose, we employ the recently developed Prediction Difference Analysis method³⁸,³⁹. This method uses the observation that replacing one feature in the input image can induce a sizable prediction difference if that feature is important for classification decision. The prediction differences can be visualized as the importance maps of all the input features for the classification network.

Shown in Fig. 2 are importance maps which illustrate the (pT, ϕ) dependence of the mean prediction difference averaged over 800 events for different model setups (initial conditions, PDE solver and model parameters), EoSs and values of the shear viscosity. For a given event, the mean prediction difference in each (pT, ϕ) bin is computed against ten random reference events from the same data set. Comparing different columns in the same row in Fig. 2, we can see that importance maps vary slightly for different values of viscosity and model setups (Group 1: IEBE-VISHNU + MC-Glauber, Group 2: CLVics + IP-Glasma) for the same EoS. However, importance maps for EOSL in general have a distinctly narrower width in the pT range than that for EOSQ, independently of the model setup and the value of viscosity⁴⁰. This might be the important region of hidden features the network recognizes in classifying the EoS under each event.

Fig. 2View larger versionFig. 2. Importance maps of the particle momentum distribution. The values in the scale bar represent the relative importance of each bin for classification computed using the Prediction Difference Analysis method by averaging over about 800 events for each category. EOSL in the first row represents the equation of state with a smooth crossover, EOSQ in the second row represents a first-order phase transition equation of state. The G1 in a–d represents the testing data set Group 1 from iEBE-VISHNU model while G2 in e–h represents the testing data set from CLVisc + IP-Glasma model. The η/s = 0 in a, b, e, f represents ideal hydrodynamics while η/s = 0.08 in c, d, g, h represents viscous hydrodynamics with shear viscosity over entropy density ratio 0.08

Discussion

Besides the deep CNN method employed in the present paper, there are also some other machine learning classifiers. In Supplementary Note 2 we attached the results from several traditional machine learning methods, such as support vector machine classifier (SVC), decision trees, random forests and gradient boosting trees. The best classifier (linear SVC) that generalizes well on two testing data sets achieves on average ~80% prediction accuracy. The important features from different classifiers differ from each other, however, those with good generalization capability have similar importance regions as given by the deep CNN. The deep CNN with on average ~95% prediction accuracy works much better to answer the core questions—is there a traceable encoder of the dynamical information from phase structure (EoS) that survives the evolution and exists in the final snapshot? If yes, then how to exclusively and effectively decode these information from the highly complex final output? These questions are crucial but unclear for decades in high-energy heavy-ion physics (and also in physical cosmology) due to the complexity and highly-dynamical characteristics in the collision evolution. The deep CNN demonstrates the revolution that big data analysis and machine learning might bring to the high energy physics and astrophysics.

The present method yields a perspective on identifying the nature of the QCD transition in heavy-ion collisions. With the help of deep CNNs and its well generalization performance, we firmly demonstrate that discriminative and traceable projections—encoders—from the QCD transition onto the final-state ρ(pT, ϕ) do exist in the complex and highly dynamical heavy-ion collisions, although these encoders may not be intuitive. The deep CNN provides a powerful and efficient decoder from which the EoS information can be extracted directly from the ρ(pT, ϕ). It is in this sense that the high-level representations, which help decoding the EoS information in the present method, act as an EoS-meter for the QCD matter created in heavy-ion collisions. The Prediction Difference Analysis method is employed to extract the most relevant features for the classification task, which may inspire phenomenological and experimental studies. Our study might provide a key to the success of the experimental determination of QCD EoS and search for the critical end point. Another intriguing application of our framework is to extract the QGP transport coefficients from heavy-ion collisions. The present method can be further improved by including hadronic rescattering and detector efficiency corrections.

Methods

Network architecture

The decisive ingredients for the success of hydrodynamic modeling of relativistic heavy-ion collisions are the bulk-matter EoS and the viscosity. In the study of the QCD transition in heavy-ion collisions, one of the holy-grail question is: how to reliably extract EoS and the nature of the QCD transition from the experimental data? The CNN⁴¹,⁴² is a powerful technique in tasks such as image and video recognition, natural language processing. Supervised training of the CNN with labeled ρ(pT, ϕ) generated by CLVisc is tested with ρ(pT, ϕ) generated by iEBE-VISHNU. The training and testing ρ(pT, ϕ) can be regarded as numerical experimental data. Hence, analyzing real experimental data is possible with straightforward generalizations of the current prototype setup.

Our CNN architecture is shown in Fig. 3. The input ρ(pT, ϕ) consists of 15 pT-bins and 48 ϕ-bins. We use two convolutional layers each followed by batch normalization⁴³, dropout⁴⁴,⁴⁵ with a rate 0.2 and PReLU activation⁴⁶. These technical terms are briefly explained in Supplementary Note 1. In the first convolutional layer, there are 16 filters of size 8 × 8 scanning through the input ρ(pT, ϕ) and creating 16 features of size 15 × 48. These features are further convoluted in the second convolutional layer that has 32 filters of size 7 × 7 × 16. The weight matrix of both convolutional layers are initialized with normal distribution and constrained with L2 regularization⁴⁷. In a convolutional layer, each neuron only locally connects to a small chunk of neurons in the previous layer by a convolution operation—this is a key reason for the success of the CNN architecture. Dropout, batch normalization, PReLU and L2 regularization work together to prevent overfitting that may generate model-dependent features from the training data set and thus hinder the generalizability of the method. The resulting 32 features of size 8 × 24 from the second convolutional layer are flattened and connected to a 128-neuron fully connected layer with batch normalization, dropout with rate 0.5 and sigmoid activation. The output layer is another fully connected layer with softmax activation and two neurons to indicate the type of the EoS. For multi-class classification, one may use more neurons in the output layer.

Fig. 3View larger versionFig. 3. The convolution neural network architecture. The architecture is designed to identify the quantum chromodynamics transition by using particle spectra with 15 transverse momentum pT bins and 48 azimuthal angle ϕ bins

There are several non-trainable parameters in the neural network, such as the number of hidden layers, the size of the convolution kernels, the size of the final hidden layer and the dropout rate. The neural network in the present work can be easily rebuilt with these hyper-parameters in Keras⁴⁸ (the source code is also available as requested). These parameters are adjusted heuristically to maximize the training accuracy and validation accuracy but not the testing accuracy. The first step is to choose the number of hidden layers, the size of the convolution kernels and the size of the final hidden layer such that the model has enough capacity to describe the training data. At this step, we use a small portion of the training data, tune the widely used values of parameters and observe big training accuracy but small validation accuracy. It is found that the widely used convolution kernel sizes 5 × 5 and 3 × 3 do not work well at this step and increasing the number of the convolution layers from 2 to 3 does not improve the training accuracy and the validation accuracy. The next step is to increase the validation accuracy, in addition to the batch normalization and L2 regularization, it is found that dropout with a proper rate and tuning the size of the final hidden layer help to increase the validation accuracy. With this minimal working neural network, the validation accuracy increases rapidly with more training data. What is interesting is that when there are big training data, the previously not functioning architectures (with smaller convolution kernels and more hidden layers) also start to work and produces similar testing accuracy. The optimal neural network architecture and the values of the non-trainable parameters with big training data may desire future investigation.

Training and validation

We use supervised learning to tackle this binary classification problem with the crossover case labeled by (1, 0) and the first-order case labeled by (0, 1). The difference between the true label and the predicted label from the two output neurons, quantified by cross entropy⁴⁹, serves as the loss function l(θ), where θ are the trainable parameters of the neural network. Training attempts to minimize the loss function by updating θ → θ − δθ. Here δθ = α ∂l(θ)/∂θ where α is the learning rate with initial value 0.0001 and adaptively changed in AdaMax method⁵⁰.

We build the architecture using Keras with a TensorFlow (r1.0)⁵¹ backend and train the neural network with 2 NVIDIA GPUs K20m. The training data set is fed into the network in batches with batch size empirically selected as 64. One traversal of all the batches in the training data set is called one epoch. To accelerate the learning, the training data set is reshuffled before each epoch. The neural network is trained with 500 epochs. Small fluctuations of validation accuracy saturated around 99% are observed. The model parameters are saved to a new checkpoint whenever a smaller validation error is encountered.

The k-fold stratified cross validation is employed to estimate the model uncertainties. The training data set is randomly shuffled and split into k equal folds with each fold containing equal number of two types of training data. One of these k folds is used for validation while the other k − 1 folds are used for training. Finally k models (according to k pairs of (training, validation) partitioning) are trained to get the mean prediction accuracy and standard deviation. As shown in Fig. 4, the prediction accuracy approaches 99% with negligible uncertainty for testing on CLVisc + AMPT (same data generator as training), using less than 50% of the training data. While for the testing on IEBE-VISHNU + MC-Glauber (testing Group 1) and CLVisc + IP-Glasma (testing Group 2), the prediction accuracy increases as one increases the size of the training data set, which is in line with the practical expectation that more training data could boost the network’s performance. With the full training data, we get on average a larger than 95% prediction accuracy, which is a very positive manifestation of the generalization capability of our deep CNN.

Fig. 4View larger versionFig. 4. The dependence of testing accuracies on training data size. The prediction accuracy on testing data when different fractions of the training data is used to train the network. The solid lines and error bars represent the mean and the standard deviation of prediction accuracies from trained models in 10-fold cross validation method

For the network settings, most of the parameters are introduced in the fully connected layers. In an alternative model, we add two more convolutional layers with filter size (3, 3) and subsequent average pooling layers to reduce the number of neurons in the flatten layer and also in the first fully connected layer, which helps to reduce the total number of parameters by a factor of 10. This deeper neural network produces similar prediction accuracy and model uncertainty in a 10-fold cross validation tests.

The input images in the present method are particle density distributions in the momentum space. Due to collective expansion of the QGP, fluctuations in the initial state are transformed to strong correlations of final state particles in the images. These local structures and translational invariance of odd-order Fourier decomposition along the azimuthal angle direction make convolution neural networks preferable to fully connected neural networks.

The relativistic hydrodynamic simulations of the heavy ion collisions are quite computing intensive, even with the GPU parallelization, it still takes much longer to accumulate enough training data than the training process. In the beginning of this study when the training data size is not big enough, we experimented with fully connected neural networks. However, the network always overfits the training data and fails to work with the validating data. We noticed that CNN has much better generalizability than fully connected neural network with small set of data. With 22,000 events, the best performance of fully connected neural networks, with 2–5 hidden layers, gave on average 90% recognition rate on the testing data. Data augmentation in fully connected neural networks bring negligible improvement (less than 1%) on the testing data. The fully connected neural networks neglect the translation invariance of the local correlations of particles that are close to each other in momentum space.

Data availability

The data sets generated and analyzed during the current study are available in the public repository⁵², 10.6084/m9.figshare.5457220.v1.

Supplementary Material

Open In Web Browser

Footnotes

Electronic supplementary material

Supplementary Information accompanies this paper at 10.1038/s41467-017-02726-3.

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Acknowledgements

L.-G.P. and H.P. acknowledge funding of a Helmholtz Young Investigator Group VH-NG-822 from the Helmholtz Association and the GSI Helmholtzzentrum für Schwerionenforschung (GSI). N.S. and K.Z. acknowledge the generous support of their DL-research at FIAS by SAMSON AG, Frankfurt and the support from GSI. H.St. acknowledges the support through the Judah M. Eisenberg Laureatus Chair at Goethe University. L.-G.P. and X.-N.W. are supported in part by the National Science Foundation (NSF) within the framework of the JETSCAPE collaboration, under grant number ACI-1550228. X.N.W was supported in part by NSFC under the Grant No. 11521064, by MOST of China under Grant No. 2014DFG02050, by the Major State Basic Research Development Program (MSBRD) in China under the Grant No. 2015CB856902and by U.S. DOE under Contract No. DE-AC02-05CH11231. This work was supported in part by the Helmholtz International Center for the Facility for Antiproton and Ion Research (HIC for FAIR) within the framework of the Landes-Offensive zur Entwicklung Wissenschaftlich-Oekonomischer Exzellenz (LOEWE) program launched by the State of Hesse. The computations were done in the Green-Cube GPU cluster LCSC at GSI, the Loewe-CSC at Goethe University, NERSC at LBNL and the GPU cluster at Central China Normal University.

Author contributions

L.-G.P. contributed to the idea, the training and the second testing data set, the neural network construction for training/testing and the manuscript preparation; K.Z. contributed to the idea, the first testing data set, intensive discussions on neural network structures, physical explanations of the results and the manuscript edition; N.S. contributed to intensive discussions on neural network structures, physical explanations of the results and the manuscript edition; H.P., H.S. and X.-N.W. contributed to the computing resources, physical insights and manuscript editions.

Notes

Competing interests

The authors declare no competing financial interests.

Articles from Nature Communications are provided here courtesy of Nature Publishing Group

PMC Copyright Notice

The articles available from the PMC site are protected by copyright, even though access is free. Copyright is held by the respective authors or publishers who provide these articles to PMC. Users of PMC are responsible for complying with the terms and conditions defined by the copyright holder.

Users should assume that standard copyright protection applies to articles in PMC, unless an article contains an explicit license statement that gives a user additional reuse or redistribution rights. PMC does not allow automated/bulk downloading of articles that have standard copyright protection.

See the copyright notice on the PMC site, https://www.ncbi.nlm.nih.gov/pmc/about/copyright/, for further details and specific exceptions.

References

Schmidhuber J, author. Deep learning in neural networks: an overview. Neural Netw. 2015;61:85–117. [Cross Ref] [PubMed]

LeCun Y, Bengio Y, Hinton G, authors. Deep learning. Nature. 2015;521:436–444. [Cross Ref] [PubMed]

Baldi P, Sadowski P, Whiteson D, authors. Searching for exotic particles in high-energy physics with deep learning. Nat. Commun. 2014;5:4308 [Cross Ref] [PubMed]

Baldi P, Sadowski P, Whiteson D, authors. Enhanced Higgs Boson to τ⁺τ⁻ search with deep learning. Phys. Rev. Lett. 2015;114:111801 [Cross Ref] [PubMed]

Searcy J, Huang L, Pleier MA, Zhu J, authors. Determination of the WW polarization fractions in pp → W±W±jj using a deep machine learning technique. Phys. Rev. D. 2016;93:094033 [Cross Ref]

Barnard J, Dawe EN, Dolan MJ, Rajcic N, authors. Parton shower uncertainties in jet substructure analyses with deep neural networks. Phys. Rev. D. 2017;95:014018 [Cross Ref]

Moult I, Necib L, Thaler J, authors. New angles on energy correlation functions. J. High Energy Phys. 2016;12:153 [Cross Ref]

Utama R, Chen WC, Piekarewicz J, authors. Nuclear charge radii: density functional theory meets Bayesian neural networks. J. Phys. G. 2016;43:114002 [Cross Ref]

Mehta, P. & Schwab, D. J. An exact mapping between the Variational Renormalization Group and deep learning. Preprint at https://arxiv.org/abs/1410.3831 (2014).

Carrasquilla J, Melko RG, authors. Machine learning phases of matter. Nat. Phys. 2017;13:431–434. [Cross Ref]

Carleo G, Troyer M, authors. Solving the quantum many-body problem with artificial neural networks. Science. 2017;355:602–606. [Cross Ref] [PubMed]

Torlai G, Melko RG, authors. Learning thermodynamics with boltzmann machines. Phys. Rev. B. 2016;94:165134 [Cross Ref]

Broecker P, Carrasquilla J, Melko RG, Trebst S, authors. Machine learning quantum phases of matter beyond the fermion sign problem. Sci. Rep. 2017;7:8823 [Cross Ref] [PubMed]

Ch’ng K, Carrasquilla J, Melko RG, Khatami E, authors. Machine learning phases of strongly correlated fermions. Phys. Rev. X. 2017;7:031038

Stöcker H, Greiner W, authors. High-energy heavy ion collisions: probing the equation of state of highly excited hadronic matter. Phys. Rep. 1986;137:277–392. [Cross Ref]

Stephanov MA, author. QCD phase diagram: an overview. PoS. LAT. 2006;2006:024

Fukushima K, Hatsuda T, authors. The phase diagram of dense QCD. Rept. Prog. Phys. 2011;74:014001 [Cross Ref]

Adams J, et al., authors. Experimental and theoretical challenges in the search for the quark gluon plasma: the STAR Collaboration’s critical assessment of the evidence from RHIC collisions. Nucl. Phys. A. 2005;757:102–183. [Cross Ref]

Muller B, Schukraft J, Wyslouch B, authors. First Results from Pb + Pb collisions at the LHC. Ann. Rev. Nucl. Part. Sci. 2012;62:361–386. [Cross Ref]

Friman B, et al., authors. The CBM physics book: compressed baryonic matter in laboratory experiments. Lect. Notes Phys. 2011;814:1–980. [Cross Ref]

Ablyazimov T, et al., authors. Challenges in QCD matter physics–the scientific programme of the Compressed Baryonic Matter experiment at FAIR. Eur. Phys. J. A. 2017;53:60 [Cross Ref]

Luzum M, Romatschke P, authors. Conformal relativistic viscous hydrodynamics: applications to RHIC results at s(NN)**(1/2) = 200-GeV. Phys. Rev. C. 2008;78:034915 [Cross Ref]

Pratt S, Sangaline E, Sorensen P, Wang H, authors. Constraining the Eq. of state of super-hadronic matter from heavy-ion collisions. Phys. Rev. Lett. 2015;114:202301 [Cross Ref] [PubMed]

Bernhard JE, Moreland JS, Bass SA, Liu J, Heinz U, authors. Applying Bayesian parameter estimation to relativistic heavy-ion collisions: simultaneous characterization of the initial state and quark-gluon plasma medium. Phys. Rev. C. 2016;94:024907 [Cross Ref]

Heinz UW, author. Early collective expansion: relativistic hydrodynamics and the transport properties of QCD matter. Landolt-Bornstein. 2010;23:240–292

Romatschke P, author. New Developments in Relativistic Viscous Hydrodynamics. Int. J. Mod. Phys. E. 2010;19:1–53. [Cross Ref]

Teaney, D. A. Viscous hydrodynamics and the quark gluon plasma. Preprint at https://arxiv.org/abs/0905.2433 (2009).

Gale C, Jeon S, Schenke B, authors. Hydrodynamic modeling of heavy-ion collisions. Int. J. Mod. Phys. A. 2013;28:1340011 [Cross Ref]

Strickland M, author. Anisotropic hydrodynamics: three lectures. Acta Phys. Pol. B. 2014;45:2355 [Cross Ref]

Pang LG, Wang Q, Wang XN, authors. Effects of initial flow velocity fluctuation in event-by-event (3 + 1)D hydrodynamics. Phys. Rev. C. 2012;86:024911 [Cross Ref]

Pang LG, Hatta Y, Wang XN, Xiao BW, authors. Analytical and numerical Gubser solutions of the second-order hydrodynamics. Phys. Rev. D. 2015;91:074027 [Cross Ref]

Huovinen P, Petreczky P, authors. QCD equation of state and hadron resonance gas. Nucl. Phys. A. 2010;837:26–53. [Cross Ref]

Sollfrank J, et al., authors. Hydrodynamical description of 200-A/GeV/c S + Au collisions: Hadron and electromagnetic spectra. Phys. Rev. C. 1997;55:392 [Cross Ref]

Shen C, et al., authors. The iEBE-VISHNU code package for relativistic heavy-ion collisions. Comput. Phys. Commun. 2016;199:61–85. [Cross Ref]

Stöcker H, author. Collective flow signals the quark gluon plasma. Nucl. Phys. A. 2005;750:121–147. [Cross Ref]

Lin ZW, Ko CM, Li BA, Zhang B, Pal S, authors. A Multi-phase transport model for relativistic heavy ion collisions. Phys. Rev. C. 2005;72:064901 [Cross Ref]

Gale C, Jeon S, Schenke B, Tribedy P, Venugopalan R, authors. Event-by-event anisotropic flow in heavy-ion collisions from combined Yang-Mills and viscous fluid dynamics. Phys. Rev. Lett. 2013;110:012302 [Cross Ref] [PubMed]

Robnik-Sikonja M, Kononenko I, authors. Explaining classifications for individual instances. Knowl. Data Eng. IEEE Trans. 2008;20:589–600. [Cross Ref]

Zintgraf, L. M., Cohen, T. S., Adel, T. & Welling, M. Visualizing deep neural network decisions: prediction difference analysis. Preprint at https://arxiv.org/abs/1702.04595 (2017).

Chaudhuri AK, Heinz UW, authors. Hydrodynamical evolution of dissipative QGP fluid. J. Phys. Conf. Ser. 2006;50:251–258. [Cross Ref]

Krizhevsky, A., Sutskever, I. & Hinton, G. E. ImageNet Classification with Deep Convolutional Neural Networks. In: Pereira, F., Burges, C. J. C., Bottou, L. & Weinberger, K. Q. (eds) Proceedings of the 25th International Conference on Neural Information Processing Systems (NIPS, 2012).

Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition. Preprint at https://arxiv.org/abs/1409.1556 (2015).

Ioffe, S. & Szegedy, C. Batch normalization: accelerating deep network training by reducing internal covariate shift. Preprint at https://arxiv.org/abs/1502.03167 (2015).

Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I. & Salakhutdinov, R. R. Improving neural networks by preventing co-adaptation of feature detectors. Preprint at https://arxiv.org/abs/1207.0580 (2012).

Srivastava N, et al., authors. Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 2014;15:1929

He, K., Zhang, X., Ren, S. & Sun, J. Delving deep into rectifiers: surpassing human-level performance on imagenet classification. https://arxiv.org/abs/1502.01852 (2015).

Ng, A. Y. Feature selection. in Proc 21st International Conference on Machine Learning. (Banff, Canada, 2004).

Chollet, F. Keras: The Python Deep Learning libraryhttps://github.com/fchollet/keras (2015).

Kullback S, Leibler RA, authors. On information and sufficiency. Ann. Math. Stat. 1951;22:79–86. [Cross Ref]

Kingma, D. & Ba, J. Adam: a method for stochastic optimization. Preprint at https://arxiv.org/abs/1412.6980 (2015).

Abadi, M. et al. TensorFlow: Large-scale machine learning on heterogeneous systems. Preprint at https://arxiv.org/abs/1603.04467 (2016).

Pang, L. G. et al. Training and testing data used in the paper “An equation-of-state-meter of QCD transition from deep learning”, figshare. 10.6084/m9.figshare.5457220.v1 (2017).

[Back]

Fig. 1.

The conjectured phase diagram in quantum chromodynamics. In the region with high temperature and small baryon chemical potential, the phase transition between hadronic matter and quark–gluon plasma is a cross over according to lattice QCD calculations (blue dashed line in the small insert). In the region with low temperature and moderately high baryon chemical potential, the phase transition is first order (red line in the small insert). At low temperature and high baryon chemical potential, there might exist other phases, such as color superconductor

[Back]

[Back]

Table 1.

The training data set

Training data set | η/s = 0 | η/s = 0.08
EOSL | EOSQ | EOSL | EOSQ
Au–Au sNN=200 GeV | 7435 | 5328 | 500 | 500
Pb–Pb sNN=2.76 TeV | 4967 | 2828 | 500 | 500

Numbers of ρ(pT, ϕ) generated by the CLVisc hydrodynamic package with the AMPT initial conditions in the centrality range 0–60%. η/s is ratio of shear viscosity to entropy density. τ₀ = 0.4 fm for the Au–Au collisions and τ₀ = 0.2 fm for the Pb–Pb collisions. The freeze-out temperature is set to be 137 MeV

[Back]

[Back]

Table 2.

The testing data set

Testing data set group 1: iEBE-VISHNU + MC-Glauber
Centrality: 10–60% | η/s ∈ [0, 0.05] | η/s ∈ (0.05, 0.10] | η/s ∈ (0.10, 0.16]
EOSL | EOSQ | EOSL | EOSQ | EOSL | EOSQ
Au–Au sNN=200 GeV | 650 | 850 | 900 | 750 | 200 | 950
Pb–Pb sNN=2.76 TeV | 500 | 650 | 600 | 644 | 499 | 150
Testing data set group 2: CLVisc + IP-Glasma
Au–Au sNN=200 GeV, b ≲ 8 fm | EOSL | EOSQ
η/s = 0 | 4164 | 4752
η/s = 0.08 | 1173 | 864

Numbers of ρ(pT, ϕ) generated by the CLVisc and iEBE-VISHNU hydrodynamic packages with different initial conditions. η/s is ratio of shear viscosity and entropy density. b is the impact parameter. τ₀ = 0.6fm for all the collisions. In iEBE-VISHNU simulations, the freeze-out temperature is varied in the range [115, 142]MeV. In CLVisc simulations, the freeze-out temperature is set to be 137 MeV

[Back]

[Back]

Table 3.

Testing accuracies

Testing data | Group 0 | Group 1 | Group 2
Number of events | 4000 | 7343 | 10,953
Accuracy | 99.88 ± 0.04% | 93.46 ± 1.35% | 93.91 ± 3.92%

The mean prediction accuracies and the standard deviations given by ten trained models in cross validation method, from three groups of testing data sets, (GROUP 0) CLVisc with AMPT initial condition, (GROUP 1) iEBE-VISHNU and (GROUP 2) CLVisc with the IP-Glasma-like initial condition

[Back]

[Back]

Fig. 2.

Importance maps of the particle momentum distribution. The values in the scale bar represent the relative importance of each bin for classification computed using the Prediction Difference Analysis method by averaging over about 800 events for each category. EOSL in the first row represents the equation of state with a smooth crossover, EOSQ in the second row represents a first-order phase transition equation of state. The G1 in a–d represents the testing data set Group 1 from iEBE-VISHNU model while G2 in e–h represents the testing data set from CLVisc + IP-Glasma model. The η/s = 0 in a, b, e, f represents ideal hydrodynamics while η/s = 0.08 in c, d, g, h represents viscous hydrodynamics with shear viscosity over entropy density ratio 0.08

[Back]

[Back]

Fig. 3.

The convolution neural network architecture. The architecture is designed to identify the quantum chromodynamics transition by using particle spectra with 15 transverse momentum pT bins and 48 azimuthal angle ϕ bins

[Back]

[Back]

Fig. 4.

The dependence of testing accuracies on training data size. The prediction accuracy on testing data when different fractions of the training data is used to train the network. The solid lines and error bars represent the mean and the standard deviation of prediction accuracies from trained models in 10-fold cross validation method

[Back]