Matroidal Entropy Functions: A Quartet of Theories of Information,Matroid, Design,and Coding

In this paper, we study the entropy functions on extreme rays of the polymatroidal region which contain a matroid, i.e., matroidal entropy functions. We introduce variable strength orthogonal arrays indexed by a connected matroid M and positive integer v which can be regarded as expanding the classic combinatorial structure orthogonal arrays. It is interesting that they are equivalent to the partition-representations of the matroid M with degree v and the (M,v) almost affine codes. Thus, a synergy among four fields, i.e., information theory, matroid theory, combinatorial design, and coding theory is developed, which may lead to potential applications in information problems such as network coding and secret-sharing. Leveraging the construction of variable strength orthogonal arrays, we characterize all matroidal entropy functions of order n≤5 with the exception of log10·U2,5 and logv·U3,5 for some v.     

A Two-Steps-Ahead Estimator for Bubble Entropy

Aims: Bubble entropy (bEn) is an entropy metric with a limited dependence on parameters. bEn does not directly quantify the conditional entropy of the series, but it assesses the change in entropy of the ordering of portions of its samples of length m, when adding an extra element. The analytical formulation of bEn for autoregressive (AR) processes shows that, for this class of processes, the relation between the first autocorrelation coefficient and bEn changes for odd and even values of m. While this is not an issue, per se, it triggered ideas for further investigation. Methods: Using theoretical considerations on the expected values for AR processes, we examined a two-steps-ahead estimator of bEn, which considered the cost of ordering two additional samples. We first compared it with the original bEn estimator on a simulated series. Then, we tested it on real heart rate variability (HRV) data. Results: The experiments showed that both examined alternatives showed comparable discriminating power. However, for values of 10<m<20, where the statistical significance of the method was increased and improved as m increased, the two-steps-ahead estimator presented slightly higher statistical significance and more regular behavior, even if the dependence on parameter m was still minimal. We also investigated a new normalization factor for bEn, which ensures that bEn=1 when white Gaussian noise (WGN) is given as the input. Conclusions: The research improved our understanding of bubble entropy, in particular in the context of HRV analysis, and we investigated interesting details regarding the definition of the estimator.     

Thermal Management and Modeling of Forced Convection and Entropy Generation in a Vented Cavity by Simultaneous Use of a Curved Porous Layer and Magnetic Field

The effects of using a partly curved porous layer on the thermal management and entropy generation features are studied in a ventilated cavity filled with hybrid nanofluid under the effects of inclined magnetic field by using finite volume method. This study is performed for the range of pertinent parameters of Reynolds number (100≤Re≤1000), magnetic field strength (0≤Ha≤80), permeability of porous region (10−4≤Da≤5×10−2), porous layer height (0.15H≤tp≤0.45H), porous layer position (0.25H≤yp≤0.45H), and curvature size (0≤b≤0.3H). The magnetic field reduces the vortex size, while the average Nusselt number of hot walls increases for Ha number above 20 and highest enhancement is 47% for left vertical wall. The variation in the average Nu with permeability of the layer is about 12.5% and 21% for left and right vertical walls, respectively, while these amounts are 12.5% and 32.5% when the location of the porous layer changes. The entropy generation increases with Hartmann number above 20, while there is 22% increase in the entropy generation for the case at the highest magnetic field. The porous layer height reduced the entropy generation for domain above it and it give the highest contribution to the overall entropy generation. When location of the curved porous layer is varied, the highest variation of entropy generation is attained for the domain below it while the lowest value is obtained at yp=0.3H. When the size of elliptic curvature is varied, the overall entropy generation decreases from b = 0 to b=0.2H by about 10% and then increases by 5% from b=0.2H to b=0.3H.     

Dirichlet Polynomials and Entropy

A Dirichlet polynomial d in one variable y is a function of the form d(y)=anny+⋯+a22y+a11y+a00y for some n,a0,…,an∈N. We will show how to think of a Dirichlet polynomial as a set-theoretic bundle, and thus as an empirical distribution. We can then consider the Shannon entropy H(d) of the corresponding probability distribution, and we define its length (or, classically, its perplexity) by L(d)=2H(d). On the other hand, we will define a rig homomorphism h:Dir→Rect from the rig of Dirichlet polynomials to the so-called rectangle rig, whose underlying set is R⩾0×R⩾0 and whose additive structure involves the weighted geometric mean; we write h(d)=(A(d),W(d)), and call the two components area and width (respectively). The main result of this paper is the following: the rectangle-area formula A(d)=L(d)W(d) holds for any Dirichlet polynomial d. In other words, the entropy of an empirical distribution can be calculated entirely in terms of the homomorphism h applied to its corresponding Dirichlet polynomial. We also show that similar results hold for the cross entropy.     

Measure Theoretic Entropy of Discrete Geodesic Flow on Nagao Lattice Quotient

The discrete geodesic flow on Nagao lattice quotient of the space of bi-infinite geodesics in regular trees can be viewed as the right diagonal action on the double quotient of PGL2Fq((t−1)) by PGL2Fq[t] and PGL2(Fq[[t−1]]). We investigate the measure-theoretic entropy of the discrete geodesic flow with respect to invariant probability measures.     

On Rényi Permutation Entropy

Among various modifications of the permutation entropy defined as the Shannon entropy of the ordinal pattern distribution underlying a system, a variant based on Rényi entropies was considered in a few papers. This paper discusses the relatively new concept of Rényi permutation entropies in dependence of non-negative real number q parameterizing the family of Rényi entropies and providing the Shannon entropy for q=1. Its relationship to Kolmogorov–Sinai entropy and, for q=2, to the recently introduced symbolic correlation integral are touched.     

A Two-Moment Inequality with Applications to Rényi Entropy and Mutual Information

This paper explores some applications of a two-moment inequality for the integral of the rth power of a function, where 0<r<1. The first contribution is an upper bound on the Rényi entropy of a random vector in terms of the two different moments. When one of the moments is the zeroth moment, these bounds recover previous results based on maximum entropy distributions under a single moment constraint. More generally, evaluation of the bound with two carefully chosen nonzero moments can lead to significant improvements with a modest increase in complexity. The second contribution is a method for upper bounding mutual information in terms of certain integrals with respect to the variance of the conditional density. The bounds have a number of useful properties arising from the connection with variance decompositions.     

Classical and Quantum H-Theorem Revisited: Variational Entropy and Relaxation Processes

We propose a novel framework to describe the time-evolution of dilute classical and quantum gases, initially out of equilibrium and with spatial inhomogeneities, towards equilibrium. Briefly, we divide the system into small cells and consider the local equilibrium hypothesis. We subsequently define a global functional that is the sum of cell H-functionals. Each cell functional recovers the corresponding Maxwell–Boltzmann, Fermi–Dirac, or Bose–Einstein distribution function, depending on the classical or quantum nature of the gas. The time-evolution of the system is described by the relationship dH/dt≤0, and the equality condition occurs if the system is in the equilibrium state. Via the variational method, proof of the previous relationship, which might be an extension of the H-theorem for inhomogeneous systems, is presented for both classical and quantum gases. Furthermore, the H-functionals are in agreement with the correspondence principle. We discuss how the H-functionals can be identified with the system’s entropy and analyze the relaxation processes of out-of-equilibrium systems.     

Higher Dimensional Rotating Black Hole Solutions in Quadratic f(R) Gravitational Theory and the Conserved Quantities

We explore the quadratic form of the f(R)=R+bR2 gravitational theory to derive rotating N-dimensions black hole solutions with ai,i≥1 rotation parameters. Here, R is the Ricci scalar and b is the dimensional parameter. We assumed that the N-dimensional spacetime is static and it has flat horizons with a zero curvature boundary. We investigated the physics of black holes by calculating the relations of physical quantities such as the horizon radius and mass. We also demonstrate that, in the four-dimensional case, the higher-order curvature does not contribute to the black hole, i.e., black hole does not depend on the dimensional parameter b, whereas, in the case of N>4, it depends on parameter b, owing to the contribution of the correction R2 term. We analyze the conserved quantities, energy, and angular-momentum, of black hole solutions by applying the relocalization method. Additionally, we calculate the thermodynamic quantities, such as temperature and entropy, and examine the stability of black hole solutions locally and show that they have thermodynamic stability. Moreover, the calculations of entropy put a constraint on the parameter b to be b<116Λ to obtain a positive entropy.     

Non-extensive statistical entropy,quantum groups and quantum entanglement

In this work, we explore a new connection between quantum groups and Tsallis entropy through the energy spectrum of a Hamiltonian with S_Uq(2)$S{U}_q\left(2\right)$ symmetry. Identifying the deformation parameter of the entropy with the parameter of deformation of the associated quantum group, we deduce Tsallis entropy for states related to such a system with S_Uq(2)$S{U}_q\left(2\right)$ symmetry and conducted an investigation of quantum entanglement.     

Weak Singularities of the Isothermal Entropy Change as the Smoking Gun Evidence of Phase Transitions of Mixed-Spin Ising Model on a Decorated Square Lattice in Transverse Field

The magnetocaloric response of the mixed spin-1/2 and spin-S (S>1/2) Ising model on a decorated square lattice is thoroughly examined in presence of the transverse magnetic field within the generalized decoration-iteration transformation, which provides an exact mapping relation with an effective spin-1/2 Ising model on a square lattice in a zero magnetic field. Temperature dependencies of the entropy and isothermal entropy change exhibit an outstanding singular behavior in a close neighborhood of temperature-driven continuous phase transitions, which can be additionally tuned by the applied transverse magnetic field. While temperature variations of the entropy display in proximity of the critical temperature Tc a striking energy-type singularity (T−Tc)log|T−Tc|, two analogous weak singularities can be encountered in the temperature dependence of the isothermal entropy change. The basic magnetocaloric measurement of the isothermal entropy change may accordingly afford the smoking gun evidence of continuous phase transitions. It is shown that the investigated model predominantly displays the conventional magnetocaloric effect with exception of a small range of moderate temperatures, which contrarily promotes the inverse magnetocaloric effect. It turns out that the temperature range inherent to the inverse magnetocaloric effect is gradually suppressed upon increasing of the spin magnitude S.     

Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm

This article deals with compression of binary sequences with a given number of ones, which can also be considered as a list of indexes of a given length. The first part of the article shows that the entropy H of random n-element binary sequences with exactly k elements equal one satisfies the inequalities klog2(0.48·n/k)<H<klog2(2.72·n/k). Based on this result, we propose a simple coding using fixed length words. Its main application is the compression of random binary sequences with a large disproportion between the number of zeros and the number of ones. Importantly, the proposed solution allows for a much faster decompression compared with the Golomb-Rice coding with a relatively small decrease in the efficiency of compression. The proposed algorithm can be particularly useful for database applications for which the speed of decompression is much more important than the degree of index list compression.     

Exploring the Neighborhood of q-Exponentials

The q-exponential form eqx≡[1+(1−q)x]1/(1−q)(e1x=ex) is obtained by optimizing the nonadditive entropy Sq≡k1−∑ipiqq−1 (with S1=SBG≡−k∑ipilnpi, where BG stands for Boltzmann–Gibbs) under simple constraints, and emerges in wide classes of natural, artificial and social complex systems. However, in experiments, observations and numerical calculations, it rarely appears in its pure mathematical form. It appears instead exhibiting crossovers to, or mixed with, other similar forms. We first discuss departures from q-exponentials within crossover statistics, or by linearly combining them, or by linearly combining the corresponding q-entropies. Then, we discuss departures originated by double-index nonadditive entropies containing Sq as particular case.     

Confined Quantum Hard Spheres

We present computer simulation and theoretical results for a system of N Quantum Hard Spheres (QHS) particles of diameter σ and mass m at temperature T, confined between parallel hard walls separated by a distance Hσ, within the range 1≤H≤∞. Semiclassical Monte Carlo computer simulations were performed adapted to a confined space, considering effects in terms of the density of particles ρ*=N/V, where V is the accessible volume, the inverse length H−1 and the de Broglie’s thermal wavelength λB=h/2πmkT, where k and h are the Boltzmann’s and Planck’s constants, respectively. For the case of extreme and maximum confinement, 0.5<H−1<1 and H−1=1, respectively, analytical results can be given based on an extension for quantum systems of the Helmholtz free energies for the corresponding classical systems.     

Degrees-Of-Freedom in Multi-Cloud Based Sectored Cellular Networks

This paper investigates the achievable per-user degrees-of-freedom (DoF) in multi-cloud based sectored hexagonal cellular networks (M-CRAN) at uplink. The network consists of N base stations (BS) and K≤N base band unit pools (BBUP), which function as independent cloud centers. The communication between BSs and BBUPs occurs by means of finite-capacity fronthaul links of capacities CF=μF·12log(1+P) with P denoting transmit power. In the system model, BBUPs have limited processing capacity CBBU=μBBU·12log(1+P). We propose two different achievability schemes based on dividing the network into non-interfering parallelogram and hexagonal clusters, respectively. The minimum number of users in a cluster is determined by the ratio of BBUPs to BSs, r=K/N. Both of the parallelogram and hexagonal schemes are based on practically implementable beamforming and adapt the way of forming clusters to the sectorization of the cells. Proposed coding schemes improve the sum-rate over naive approaches that ignore cell sectorization, both at finite signal-to-noise ratio (SNR) and in the high-SNR limit. We derive a lower bound on per-user DoF which is a function of μBBU, μF, and r. We show that cut-set bound are attained for several cases, the achievability gap between lower and cut-set bounds decreases with the inverse of BBUP-BS ratio 1r for μF≤2M irrespective of μBBU, and that per-user DoF achieved through hexagonal clustering can not exceed the per-user DoF of parallelogram clustering for any value of μBBU and r as long as μF≤2M. Since the achievability gap decreases with inverse of the BBUP-BS ratio for small and moderate fronthaul capacities, the cut-set bound is almost achieved even for small cluster sizes for this range of fronthaul capacities. For higher fronthaul capacities, the achievability gap is not always tight but decreases with processing capacity. However, the cut-set bound, e.g., at 5M6, can be achieved with a moderate clustering size.     

Entropy of the Land Parcel Mosaic as a Measure of the Degree of Urbanization

Quantifying the urbanization level is an essential yet challenging task in urban studies because of the high complexity of this phenomenon. The urbanization degree has been estimated using a variety of social, economic, and spatial measures. Among the spatial characteristics, the Shannon entropy of the landscape pattern has recently been intensively explored as one of the most effective urbanization indexes. Here, we introduce a new measure of the spatial entropy of land that characterizes its parcel mosaic, the structure resulting from the division of land into cadastral parcels. We calculate the entropies of the parcel areas’ distribution function in different portions of the urban systems. We have established that the Shannon and Renyi entropies R0 and R1/2 are most effective at differentiating the degree of a spatial organization of the land. Our studies are based on 30 urban systems located in the USA, Australia, and Poland, and three desert areas from Australia. In all the cities, the entropies behave the same as functions of the distance from the center. They attain the lowest values in the city core and reach substantially higher values in suburban areas. Thus, the parcel mosaic entropies provide a spatial characterization of land to measure its urbanization level effectively.     

Computing Accurate Probabilistic Estimates of One-D Entropy from Equiprobable Random Samples

We develop a simple Quantile Spacing (QS) method for accurate probabilistic estimation of one-dimensional entropy from equiprobable random samples, and compare it with the popular Bin-Counting (BC) and Kernel Density (KD) methods. In contrast to BC, which uses equal-width bins with varying probability mass, the QS method uses estimates of the quantiles that divide the support of the data generating probability density function (pdf) into equal-probability-mass intervals. And, whereas BC and KD each require optimal tuning of a hyper-parameter whose value varies with sample size and shape of the pdf, QS only requires specification of the number of quantiles to be used. Results indicate, for the class of distributions tested, that the optimal number of quantiles is a fixed fraction of the sample size (empirically determined to be ~0.25–0.35), and that this value is relatively insensitive to distributional form or sample size. This provides a clear advantage over BC and KD since hyper-parameter tuning is not required. Further, unlike KD, there is no need to select an appropriate kernel-type, and so QS is applicable to pdfs of arbitrary shape, including those with discontinuous slope and/or magnitude. Bootstrapping is used to approximate the sampling variability distribution of the resulting entropy estimate, and is shown to accurately reflect the true uncertainty. For the four distributional forms studied (Gaussian, Log-Normal, Exponential and Bimodal Gaussian Mixture), expected estimation bias is less than 1% and uncertainty is low even for samples of as few as 100 data points; in contrast, for KD the small sample bias can be as large as −10% and for BC as large as −50%. We speculate that estimating quantile locations, rather than bin-probabilities, results in more efficient use of the information in the data to approximate the underlying shape of an unknown data generating pdf.     

Information Measures for Generalized Order Statistics and Their Concomitants under General Framework from Huang-Kotz FGM Bivariate Distribution

In this paper, we study the concomitants of dual generalized order statistics (and consequently generalized order statistics) when the parameters γ1,…,γn are assumed to be pairwise different from Huang–Kotz Farlie–Gumble–Morgenstern bivariate distribution. Some useful recurrence relations between single and product moments of concomitants are obtained. Moreover, Shannon’s entropy and the Fisher information number measures are derived. Finally, these measures are extensively studied for some well-known distributions such as exponential, Pareto and power distributions. The main motivation of the study of the concomitants of generalized order statistics (as an important practical kind to order the bivariate data) under this general framework is to enable researchers in different fields of statistics to use some of the important models contained in these generalized order statistics only under this general framework. These extended models are frequently used in the reliability theory, such as the progressive type-II censored order statistics.     

Optimization,Stability, and Entropy in Endoreversible Heat Engines

The stability of endoreversible heat engines has been extensively studied in the literature. In this paper, an alternative dynamic equations system was obtained by using restitution forces that bring the system back to the stationary state. The departing point is the assumption that the system has a stationary fixed point, along with a Taylor expansion in the first order of the input/output heat fluxes, without further specifications regarding the properties of the working fluid or the heat device specifications. Specific cases of the Newton and the phenomenological heat transfer laws in a Carnot-like heat engine model were analyzed. It was shown that the evolution of the trajectories toward the stationary state have relevant consequences on the performance of the system. A major role was played by the symmetries/asymmetries of the conductance ratio σhc of the heat transfer law associated with the input/output heat exchanges. Accordingly, three main behaviors were observed: (1) For small σhc values, the thermodynamic trajectories evolved near the endoreversible limit, improving the efficiency and power output values with a decrease in entropy generation; (2) for large σhc values, the thermodynamic trajectories evolved either near the Pareto front or near the endoreversible limit, and in both cases, they improved the efficiency and power values with a decrease in entropy generation; (3) for the symmetric case (σhc=1), the trajectories evolved either with increasing entropy generation tending toward the Pareto front or with a decrease in entropy generation tending toward the endoreversible limit. Moreover, it was shown that the total entropy generation can define a time scale for both the operation cycle time and the relaxation characteristic time.