Entropy for Past Residual Life Time Distributions
Arif Habib1, Meshiel Alalyani2
1College of applied Medical Sciences - Khamis Mushait;,King Khalid University, Kingdome of Saudi Arabia
2College of Nursing – Khamis Mushait, King Khalid University, Kingdome of Saudi Arabia
Arif Habib, Meshiel Alahyani. Entropy for Past Residual Life Time Distributions. American Journal of Theoretical and Applied Statistics. Vol. 4, No. 3, 2015, pp. 118-124. doi: 10.11648/j.ajtas.20150403.17
Abstract: As we are familiar that existence of life is uncertain. In the context of reliability and lifetime distributions, there are some measures such as the hazard rate function or the mean residual lifetime function that have been used to characterize or compare the aging process of a component. This definition deals with random variable truncated above some t, i.e. the support of the random variable is taken to be (0, t). We outline some common methods for past residual lifetime distributions with the aim to provide some insights on general construction mechanisms. Some applications are given to provide the readers a possible source of ideas to draw upon. Applications of past residual lifetime distributions in reliability, survival analysis and mortality studies are briefly discussed.
Keywords: Differential Entropy, Past Residual Entropy, Life Time Distributions
Information theory includes the study of uncertainty measures plays a significant role in studying the various aspects of a system when it fails between two time points. In reliability theory and survival analysis, the residual entropy was considered in Ebrahimi and Pellerey , which basically measures the expected uncertainty contained in remaining lifetime of a system. The residual entropy has been used to measure the wear and tear of components and to characterize, classify and order distributions of lifetimes by Belzunce et al.  and Ebrahimi . The notion of past entropy, which can be viewed as the entropy of the inactivity time of a system, was introduced in Di Crescenzo and Longobardi . Many ageing (lifetime) distributions have been constructed with a view for applications in various disciplines, in particular, in reliability engineering, survival analysis, demography, actuarial study and others. Statistical analysis of lifetime data is an important topic in biomedical science, reliability engineering, social sciences and others. Typically, ‘lifetime’ refers to human life length, the life span of a device before it fails, the survival time of a patient with serious disease from the date of diagnosis or major treatment or the duration of a social event such as marriage.
Let be an absolutely continuous non- negative random variable having distribution function and survival function . The basic measure of uncertainty is defined by Shannon as
where is the density function of . (Throughout this paper, log will denote the natural logarithm.)
Ifis a discrete random variable taking the values with respective probabilities, then the Shannon’s entropy is defined as
The role of differential entropy as a measure of uncertainty in residual life time distribution has attracted increasing attention in recent years. As urged by Ebrahimi, if a unit is known to have survived to age , then is no longer useful for measuring the uncertainty about the remaining life time of the unit. Accordingly, he introduced the measure of uncertainty of residual life time distribution, of a component as,
where is the survival function and is the hazard function of the random variable, because the reliability function and the hazard rate function can be uniquely determined from each other, a new ageing distribution can therefore be derived by constructing one of them first.
After the unit has survived for time , basically measures the expected uncertainty in the conditional density of about the predictability of remaining life time of the unit .
It is reasonable to presume that in many realistic situations uncertainty is not necessarily related to the future but can also refer to the past. For instance, if at time , a system which is observed only at certain preassigned inspection times, is found to be down, then the uncertainty of the system life relies on the past, i.e., on which instant in it has failed. Based on this idea, Dicrescenzo and Longobardi have studied the past entropy over. If denote the life time of a component or of living organism, then the past entropy of is defined as
where is the cumulative distribution function and is the reversed hazard function or reversed failure rate of .
The function is receiving increasing attention in reliability theory and survival analysis . In view of the growing importance of the concept of reversed hazard function , Chandra and Roy examined some result on implicative relationship in the context of the monotonic behavior of reversed hazard function.
In this paper, we investigate the problem of characterization of past life time distribution by using the following generalized residual entropy function,
It must to be noted that and (1.5) reduce to (1.1). The measure (1.5) is the past residual life entropy corresponding to (1.3).
2. A Few Orders Based on the Generalised Past Entropy
In this section, we define a few orders based on the generalized past entropy and study their properties.
Definition 2.1: Let and be two random variables denoting the life time of two components with density functionsandrespectively. Then is said to be greater than in past entropy (written as ) if for all
Definition 2.2: Let and be two random variables denoting the life time of two components with density functionsandrespectively. Then is said to be greater than in generalized past entropy of order ( written as ) if, for all .
The following lemma which gives the value of the function under the linear transformation, will be used in proving the upcoming theorem of this section.
Lemma 2.1: For an absolutely continuous random variable , define , where are constants. Then, for ,
Proof: We have,
Therefore, for we have,
, which proves the lemma.
The following theorem shows that generalized past entropy order defined above is closed under increasing linear transformation.
Theorem 2.1: Let and be two absolutely continuous random variables, define and , . Let (I) (II) (III) .Then , if or is increasing in .
Proof: Suppose is increasing in .
Further, since , we have
From (2.1) and (2.2), we have
Using (2.3) and applying lemma 2.1, we have
The proof of part second is similar and hence omitted.
Corollary 2.1: Let and be two absolutely continuous random variables such that . Define and , are constants. Then , if or is increasing in .
Now we state a more stronger result. The proof is simple and hence omitted.
Theorem 2.2: Let and be two absolutely continuous random variables .Define and , are constants. Then, if for .
3. Characterization Results
3.1. Continuous Case
Let be a continuous non negative random variable representing component failure time with failure distribution function.
After simplification of (1.7), we have
We now show that uniquely determines .
Theorem 3.1: Let be a continuous non negative random variable with distribution function and an increasing generalized past residual entropy,. Then
uniquely determines .
Proof: Differentiating (2.1) with respect to , we have
where is the reversed hazard function.
Hence for fixed, is a solution of
Differentiating both sides with respect to, we have
Note that gives,
Two cases arises:
Case 1: Let , then , and is a convex function with minimum at
. So the unique solution to is given by
Case 2: Let , then , and is a concave function with maximum at
. So the unique solution to is given by
Combining both the cases, we conclude that uniquely determines , which in turns determines uniquely.
Theorem 3.2: The uniform distribution over , , can be characterized by increasing generalized past entropy .
Proof: In case of uniform distribution over , , we have
, which is increasing in .
Differentiating with respect to , we have
Using the value of in (3.2), we get
Thus, has unique solution given by . But is a solution to (3.2). Hence, is the unique solution to . This gives that the distribution is uniform, and the theorem is proved.
Belzunce et al., derive the residual entropy expressions for some continuous distributions. Corresponding to these distributions, we derive the expressions for the generalized past residual entropy as mentioned in the below table A.
|Finite range|| |
3.2. Discrete Case
Letis a discrete random variable taking the values with respective probabilities . The past uncertainty of discrete lifetime distribution is defined as
where is the distribution function of .
The generalized past residual entropy for discrete case is defined as
for (3.4) reduces to (3.3)
Theorem3.3: if has a discrete distribution function with support and an increasing generalized past residual entropy ,then uniquely determines .
Proof : we have ,
Which is equivalent to
For , we obtain
Subtracting (3.5) from (3.6), writing , we have
where . It can be noted that for a fixed
is a solution to
Differentiating both sides with respect to, we get
Thus , gives
Two cases arises:
Case 1: When . Thus first decreases then increases with minimum at
Case 2: When. Thus first increases and then decreases with maximum at.
Combining both the cases, we conclude that uniquely determines, which in turns determines uniquely.
Theorem 3.4: The uniform distribution with support is characterized by increasing discrete generalized past residual entropy.
Proof: In case of uniform distribution with support, we have
, which is increasing in .
Thus has a unique solution given by . But is the solution of (3.8). Hence is the unique solution to . This gives that the distribution is discrete uniform and the theorem is proved.
4. New Class of Life Time Distributions
In this section we define a non parametric class of life time distributions based on generalized past residual entropy.
Definition: A non negative random variableis said to have increasing uncertainty of past life (IUPL), if is increasing in .
Definition: A non negative random variableis said to have increasing uncertainty of generalized past residual life (IUGPRL) of order , if is increasing in .
Theorem 4.1: Let of order. Define , where are constants. Then .
Proof: Since of order,therefore,.
By applying lemma (2.1), it follows that of order.
The next theorem gives the lower bound to the reversed hazard rate function in terms of .
Theorem 4.2 : If is IUGPRL of order , then.
Proof: Since is IUGPRL of order , therefore, which yields, which proves the theorem.
Corollary 4.1: Let be a is IUGPRL of order, then
It is reasonable to presume that in many realistic situations uncertainty is not necessary related to the future but can also refer to the past. For instance, if at time, a system which is observed only at certain pre-assigned inspection times is found to be down, then the uncertainty of the system life relies on the past, i.e., on which instant in it has failed.
Ageing distributions are an integral part of reliability engineering both at the component and system levels. Their applications include (but not limited to) lifetime analysis, accelerated life test, product burn-in before field use, replacement and warranty policies and many other issues.
5.2. Actuarial Sciences
The results of analysis are dependent upon the underlying assumptions involved, and the actuary should attempt to be as "unprejudiced" as possible in determining the modeling assumptions. In fact, this is actually a further strength of the information theoretic technique. The purpose is to investigate the effect of inflation, truncation or censoring from below (use of a deductible) and truncation or censoring from above (use of a policy limit) on the entropy of losses of insurance policies. Losses are differentiated between per-payment and per-loss (franchise deductible).
5.3. Social Sciences
In social sciences, the time spent (duration) in a state before exiting is an important consideration for managers and planners. For example, a social scientist may be concerned with the recidivism in criminal justice, the length of time to complete a Ph. D degree, the duration an individual remains unemployed, the duration an individual stays in an employment, the duration an individual remains married, the durations of coalitions, the time until announcement of support of a bill, the length a leader stays in power, the duration of a war and others. Surprisingly, many such ‘duration’ variables have a unimodal hazard rate that can be fitted by the inverse-Weibull, inverse Gaussian, lognormal, exponential or generalized power Weibull family.
5.4. Biological Systems
Biological systems produce work through their lifetime. This generates Entropy expressed by the energy of decay of the system. Aging and the deterioration of the human body, diseases and organic decay are typical examples of various forms of Entropy. Medicine has being struggling to reduce their effect by optimizing the duration of human life.
The energy produced by the work of living organisms generates Entropy in the form of decline of reproduction of species and the decay of their environment. This may be measured analytically, by the entropy which expresses the irreversible residue of low level energy. The phenomenon of such devastation is obvious in the environment which is full of waste dumps and barren land where various endangered species used to live.
We have introduced and studied the concept of entropy for the past life time distributions. In this context we study the properties of the resulting entropies such as the residual loss entropy and the past loss entropy which are the result of use of a deductible and a policy limit, respectively. Interesting relationships between these entropies are presented. We have generalized several results available in the literature regarding the past residual entropy. It is shown that the proposed measure uniquely determines the distribution function. The uniform and discrete uniform distribution has been characterized in terms of past-generalized residual entropy.
The theoretical results obtained in this paper can be used to go further and analyze the applications in other disciplines where uncertainty exists.
We sincerely thank the editor and the anonymous referees and reviewers, careful reading of the manuscript and some thought provoking comments. The valuable comments have forced us to give clarification to quite a few questions and to correct some mistakes improving the quality of the paper substantially.
Dr. Arif Habib Hanga
Ph. D, M.Phil, M.Sc in Statistics; B. Sc., B. Ed., PGDCA in Computer Science.
I obtained my Ph. D in statistics (Information theory), started my career as Chief Statistician, AYUSH, M. o. H, Government of India. In 2008, I joined as an Assistant professor in University of Kashmir. So far I have worked on 3 patents in my credit, published 14 papers, 4 monographs, and attended 28 National / International conferences. Presently I am working as Asstt. Professor in King Khalid University-Abha, KSA.
Mesheil Alahyani is Assistant Professor, College of Nursing, King Khalid University, KSA. He received his Bachelor of Nursing from Curtin University, Australia, an MSN (Edu) Curtin university and PhD (Quality of Care) from the same University. He is certified in Clinical Instructions and quality management. His expertise is in reliability and quality management and also has been recognized for his expertise in Hospitals Accreditations.