 Original research
 Open Access
 Published:
Optimal load frequency control through combined state and control gain estimation for noisy measurements
Protection and Control of Modern Power Systems volume 5, Article number: 24 (2020)
Abstract
Combined estimation of state and feedback gain for optimal load frequency control is proposed. Load frequency control (LFC) addresses the problem of controlling system frequency in response to disturbance, and is one of main research areas in power system operation. A well acknowledged solution to this problem is feedback stabilization, where the Linear Quadratic Regulator (LQR) based controller computes the feedback gain K from the known system parameters and implements the control, assuming the availability of all the state variables. However, this approach restricts control to cases where the state variables are readily available and the system parameters are steady. Alternatively, by estimating the states continuously from available measurements of some of the states, it can accommodate dynamic changes in the system parameters. The paper proposes the technique of augmenting the state variables with controller gains. This introduces a nonlinearity to the augmented system and thereby the estimation is performed using an Extended Kalman Filter. This results in producing controller gains that are capable of controlling the system in response to changes in load demand, system parameter variation and measurement noise.
Introduction
To control a power system against frequency variation in response to changes in demand, load frequency control (LFC) is a well acknowledged strategy. LFC has been addressed in the literature in great detail [1,2,3,4,5,6,7]. By and large, all the investigations extensively utilize optimal control theory to develop LFC. However, the difficulty in recording in real time all the state variables from the system required in the above approaches has been the major concern for the implementation of the techniques [8]. In order to alleviate the problems, the reconstruction of all the states from available outputs and controls using an observer has received significant attention [8, 9].
The design of most observers requires the determination of observer gains, such that the eigenvalues of the characteristic equation on the observation error match a set of preassigned values [8]. While the preassignment of the eigenvalues is straightforward for small systems, it could become a problem for highorder systems. Alternatively, continuous estimation of the observer gains, along with the states from a limited number of measurements can lead to optimal observer gains, capable of stabilizing the system. In this paper, the design and evaluation of such an observer, which is a state estimator, is presented to minimize the error between the measured and estimated state variables using the Extended Kalman Filter (EKF).
The automatic generation control (AGC) or the LFC problem dates back to 1950’s [1, 10]. With the change of power system structure and the growth in size and complexity of interconnected systems [11], it has become imperative that the total power generation and load demand match well all the time, and any deviation in the demand of power could change the operating point and reflect the disturbance onto the frequency [12, 13]. Stable system frequency and steady interchange of tie line power with neighboring control areas are the two main attributes required to be guaranteed by LFC [4, 11, 14]. In a typical power system, the number of variables influencing the performance can be quite large.
In [15], an improved LFC method is introduced which has better performance in a multiarea power system including HVDC transmission links. The LQR method is used along with the Kalman Filter because all the system states may not be available, and the measurements may not be free from noise. The Kalman Filter estimates the unmeasurable states and incorporates the optimal gain of LQR for the control of frequency. Reference [16] presents the importance of a classical control method such as integral control in the LFC problem. However, this approach does not provide adequate control performance when uncertainties arise in the system parameters.
Implementation of optimal control theory into the control of power system faces difficulties in the selection of Q and R matrices for the design of the LQR controller [9]. Typically, feedback gain K is computed from the weighting matrices of the LQR controller. To avoid the difficulties in computing Q and R matrices for LQR controller, an estimation technique is proposed in [9] which augments the required feedback gain K, along with the system state estimation through Extended Kalman Filter method.
For multiarea power systems, the complexity increases and there will be a dimensional expansion of the dynamic states. Most states may be unmeasurable, and in such cases, state estimation can be performed with the Kalman estimator from limited measurements. However, for control purposes some optimal methods are preferred. Therefore, the paper proposes a novel technique of augmenting the states with optimal gains for estimation. It also incorporates parameter uncertainties in the system. On augmenting the gains along with states, the state space equation becomes nonlinear and thus Extended Kalman Filter is considered for the estimation in the new augmented system.
Since real time measurements are always noisy, the proposed technique is designed in such a way that it can handle measurement noise variance better than conventional control methods. For the incorporation of noise, no additional tuning is needed for this technique, while the computational time required is also comparatively reduced.
Accordingly, in the sections to follow, control strategy based on state space theory is used to formulate LFC implementation. The basic idea of state estimation using EKF is introduced in Section 4, followed by the proposed LFC. Detailed simulation results are given in Section 6. These are summarized for three cases with different noise variances injected to frequency measurements. A comparative study is also provided with LQR [15] and integral control [16]. The system used for verification is discussed in detail in the Appendix.
State feedback control
The discretetime statespace model with p inputs, q outputs and n state variables is considered as
where.
A is the state matrix of dimension (n × n).
B is the input matrix of dimension (n × p).
H is the output matrix of dimension (q × n).
X_{(k)} is the state vector of dimension n.
u_{(k)} is the input vector of dimension p.
z_{(k)} is the output vector of dimension q.
Assuming that all the states of the system are measurable, a state feedback control law uses the current states of the plant in order to determine the control effort, u_{(k)} = g(X_{(k)}) [17, 18]. Thus, choosing g(X_{(k)}) to be in the form g(X_{(k)}) = − K^{T}X_{(k)}, where K is the gain matrix of dimension (n × p), the closedloop system dynamics are given by
Figure 1 illustrates the scheme. It may be noted from (3) that K can be used to place the poles of the closed loop system in order to obtain a desired behavior.
Linear quadratic regulator control
Assuming that all the state variables are simultaneously measurable, the LQR control strategy forms an optimal method to compute the value of K, where the optimal solution is given by minimizing a linearquadratic cost function [18]. The LQR approach presumes that a gain which stabilizes the system is guaranteed to offer a valid solution for the problem [19]. Hence, for the dynamic system in (1) and (2), the control gain for the LQR controller minimizes the cost function given by [18]
Following [6], the optimal gain is the solution of the Algebraic Riccati Equation given by
As is clear from (5), the LQR presupposes the ready availability of Q and R, which are difficult to specify for a given system. Assuming that all states are measurable, the control strategy u = − K^{T}X places poles to stabilize the system. In the state feedback design as outlined above, it is assumed that all state variables are readily available for feedback. However, in practice, not all state variables are directly measurable in the case of large systems while any measurements would contain noise. Thus, it becomes imperative to estimate unavailable state variables from the available measurements of state variables using a state observer [9, 15, 20]. The present paper proposes to use the Kalman Estimator for estimating states from the available measurement of frequency change. It also estimates the gain vector K by augmenting the state vector with the K vector given by
where X_{a} represents the states of the new augmented system.
Estimation of augmented state and feedback gain  extended Kalman filterbased approach
It is also interesting to note that LQRbased computation of K restricts the control to those cases where the system parameters are available. Alternatively, by estimating the states continuously from available measurements of some of the states, it will be possible to accommodate the dynamic changes of the system parameters.
The available measurements are given to the observer, where the Kalman estimator estimates the states X of the system [15] along with K, by minimizing the difference between the measurements and the values computed from the state estimates. Finally, u = − K^{T}X is used to stabilize the system. Figure 2 illustrates the approach.
Kalman estimator
The Kalman Filter provides a recursive statistical framework for estimation and prediction of the state of a process, given a mathematical model of that process [21]. The Kalman Filter estimates the process state by minimizing the mean of the squared estimate error (z_{(k)} − H^{T}X_{(k)}). In doing so, the goal of the Kalman Filter is to minimize the estimate error covariance as
The posteriori state estimate \( {\hat{X}}_{a\left(kk\right)} \), based on the past k observations, gives the mean of the state distribution, i.e., E(X_{a(k)}), and is computed as
The difference (z_{(k)} − H^{T}X_{(k)}) is called the measurement innovation, or the residual, and reflects the discrepancy between predicted measurement and the actual measurement. L_{(k)} is the Kalman gain given by
where R(k) is the measurement error covariance.
The state covariance P_{(k/k − 1)} is updated as
Proposed load frequency control
As explained in Section 2, the LFC controls the states of a system based on the measurement of the frequency change in the power system, considering the changes in the system dynamics. Though the problem is best addressed in the context of optimal control theory [18], limitation in obtaining the accurate real time measurements of all state variables which are required to estimate the unknown states, using the measured frequency values and the system model [22]. Considering the augmented states, the system model is modified as two sets of equations shown in (11) and (13), as
where
ΔP_{v}: real power command in p.u.
ΔP_{m}: resulting deviation in mechanical power in p.u.
Δf: the change in frequency in p.u.
From (11) it can be seen that the system is nonlinear as X and K are now the states of the augmented system and hence the Extended Kalman Filter (EKF) [23, 24] is used to compute the updates of the augmented state vector X_{a}.
The update equations of EKF [25, 26] are modified accordingly as (17)–(27). While the measurement Jacobian H(k) is the same as H given in (14), the Jacobian of the state model takes the following structure [21], as

(i)
(i)The product terms involved in the equation

(ii)
The identity nature of K_{(k + 1)} = K_{k}
The instantaneous measurements of Δf from the plant are given to the EKF to estimate the states including the K, while applying the control of u = − K^{T}X continuously.
State model:
where X_{a} = [X, K]^{T} and G is the disturbance vector of dimension 2n.
Measurement equation:
Gω_{(k)} accounts for the plant disturbance and ν_{k} the measurement noise.
Correction update:
where L_{k} is given by
where
Results and discussion
Following the linearized singlearea power system outlined in [6], the proposed algorithm is simulated in MATLAB R2018a, where the singlearea power system has the following components:

1.
A governor with transfer function \( \frac{1}{\left(1+\mathrm{s}{T}_g\right)\ } \);

2.
Load and machines with transfer function \( \frac{1}{\left(2\mathrm{Hs}+\mathrm{D}\right)\ } \);

3.
Droop characteristic \( \frac{1}{\ \mathrm{R}\ } \);

4.
A nonreheated turbine with transfer function \( \frac{1}{\left(1+\mathrm{s}{T}_t\right)\ } \);
The components are interconnected as shown in Fig. 3. R is the speed regulation of the governor, and T_{g} and T_{t} are the governor and turbine time constants, respectively. H is the inertia constant and D the frequency sensitive load coefficient. ΔP_{v} is the real power command and ΔP_{m} is the change in mechanical power. Δf is the change in frequency, ΔP_{L} is the change in load and ΔP_{ref} the reference signal.
As shown in Fig. 3, the measured values of Δf are provided for the EKF estimator to estimate the states. The detailed derivation of the state space model of the singlearea power system shown in Fig. 3 [6] is given in the Appendix. The augmented linearized discrete model of the singlearea power system [6] is described by
The power system model in MATLAB / Simulink is shown in Fig. 4, in which the MATLAB function “COMBINED ESTIMATION” performs a continuous estimation of both the state X and the feedback gain K. For all simulations explained below, a sudden increase in demand is injected (i) after 30 s and (ii) 500 s from the commencement of simulation, while each of the increases in demand exists for a duration of 30 s.
Case I
The noise in the frequency measurement is assumed to have a variance of 0.005. The corresponding variation in the frequency output of the power system shown in Fig. 5 confirms that the control is effective to bring down Δf to a range of ±1.6709 × 10^{− 6} within 50 s after the change in demand is removed. Thereafter the system continuously corrects the gain value while estimating the states so that during the occurrence of a second disturbance at 500 s Δf remains fully within the limits mentioned above. The mean value and the variance of each of the state variables after stabilization, for different levels of measurement noise injected, are shown in Table 1. Variations of other states ΔP_{v} and ΔP_{m} in response to change in demand are shown in Fig. 5(c) and (d), respectively.
It is interesting to note that ΔP_{v} and ΔP_{m} also increase initially to meet the increase in demand, but are stabilized after the second spurt in demand to values within ±4.0817 × 10^{− 4} and ± 4.2357 × 10^{− 4}, respectively.
Estimated values of state variables plotted along with the measurements from the plant are shown in Fig. 6 (a), (b) and (c). The corresponding normalized histogram in frequency estimate confirming the merit of estimation is shown in Fig. 6 (d). Figure 7 compares the control action of the proposed technique with conventional integral control and LQR for the noise variance of 0.005. With reference to Table 2, it is evident that the proposed control has better computational time compared to the integral controller and LQR.
Case II
The noise in frequency measurement is assumed to have a variance of 0.01. Here again the system continuously corrects the gain values while estimating the states, so that Δf stabilizes to ±1.5726 × 10^{− 6} as shown in Fig. 8.
As in the previous case the continuous control keeps Δf well within the limits during the second disturbance. The mean value and the variance of each of the state variables after stabilization for different levels of measurement noise injected are shown in Table 3.
Variations of other states ΔP_{v} and ΔP_{m} in response to change in demand are shown in Fig. 8(c) and (d), respectively. It is noted that ΔP_{v} and ΔP_{m} also increase initially to meet the increase in demand; but are gradually stabilized to values within ±3.8767 × 10^{− 4} and ± 3.9950 × 10^{− 4}, respectively after the second spurt in demand. Estimated values of state variables plotted along with the measurements from the plant are shown in Fig. 9 (a), (b) and (c). The corresponding normalized histogram in frequency estimate confirming the merit of estimation is shown in Fig. 9 (d).
The control actions of the proposed technique and the conventional integral control and LQR for a noise variance of 0.01 are compared in Fig. 10. With reference to Table 4, it is clear that the proposed control has better computational time compared to the integral controller and LQR.
Case III
The noise in frequency measurement is assumed to have a variance of 0.1. Here again the system continuously corrects the gain values while estimating the states, so that Δf stabilizes to ±1.023× 10^{− 6} as shown in Fig. 11.
It can be seen that the increase in the measurement noise affects the variance in the estimate of all the state variables. However, as in the previous cases, the continuous control keeps Δf well within the limits during the second disturbance. The mean value and the variance of each of the state variables after stabilization for different levels of measurement noise injected, are shown in the Table 5, while variations of other states ΔP_{v} and ΔP_{m} are shown in Fig. 11(c) and (d), respectively. It can be noted that ΔP_{v} and ΔP_{m} also increase initially to meet the increase in demand; but are stabilized to values within ±0.5515 and ± 0.5677, respectively after the second spurt in demand. It can be seen that the states stabilize within a variance of ±σ in all cases, while the gain K shows little variation from the mean value.
Estimated values of state variables plotted along with the measurements from the plant are shown in Fig. 12 (a), (b) and (c). The corresponding normalized histogram in frequency estimate confirming the merit of estimation is shown in Fig. 12 (d). Figure 13 compares the control actions of the proposed technique with the conventional integral control and LQR for a noise variance of 0.1. It is noted that the corresponding poles placed in the system also stabilize around mean values with variances as shown in Table 6.
Table 7 compares these controllers in terms of steady state error, variance and computational time. It can be seen that for high measurement noise variance, the proposed technique performs well in comparison to others, as integral controller and LQR show higher steady state errors. Since the measurements are corrupted by high noise variance, additional tuning is required for these controllers to bring back the offset to zero. This is avoided with the proposed technique.
Extension to MIMO systems
The techniques demonstrated so far are directly applicable for SISO systems, where K will be a (n × 1) vector. However, for MIMO systems as in the case of a multiarea power system, K will be a matrix as shown in (3). By arranging the elements of the (n × p) matrix as a (np × 1) vector and augmenting it to the state vector X, the proposed approach can be extended to MIMO systems. The dimensions of the matrices such as F_{k} in (17), P_{(kk)} in (10) and H in (24) will increase, but can be handled in the implementation easily by taking note of the sparse nature of the matrices.
Conclusion
This paper has demonstrated a new observerbased approach for implementing the LFC in power systems. The EKF based observer continuously estimates the gains and the states based on the measurement of shift in frequency. Simulations are carried out in a singlearea power system in MATLAB/SIMULINK, in which the observer implemented as a separate MATLAB code is plugged into the system to sample the output from the power system and inject the control back. The performance of the implemented LFC is tested by injecting a sudden change in demand lasting for 30 s. The power system is stabilized within ±σ after each change in demand, thereby ascertaining the effectiveness of the control strategy.
Availability of data and materials
Data sharing not applicable to this article as no datasets were generated or analysed during the current study.
Abbreviations
 AGC:

Automatic Generation Control
 EKF:

Extended Kalman Filter
 LFC:

Load Frequency Control
 LQR:

Linear Quadratic Regulator
 MIMO:

Multiple Input Multiple Output
 SISO:

Single Input Single Output
References
 1.
Concordia, C., & Kirchmayer, L. K. (1953). Tieline power and frequency control of electric power systems. Transactions of the American Institute of Electrical Engineers Part III: Power Apparatus and Systems, 72(3), 562–572.
 2.
Annamraju, A., & Nandiraju, S. (2019). Robust frequency control in a renewable penetrated power system: An adaptive fractional orderfuzzy approach. Protection and Control of Modern Power Systems, 4(1), 1–15.
 3.
Magdy, G., Shabib, G., Elbaset, A. A., & Mitani, Y. (2018). Optimized coordinated control of LFC and SMES to enhance frequency stability of a real multisource power system considering high renewable energy penetration. Protection and Control of Modern Power Systems, 3(1), 1–15.
 4.
Cohn, N. (1956). Some aspects of tieline bias control on interconnected power systems. Transactions of the American Institute of Electrical Engineers Part III: Power Apparatus and Systems, 75(3), 1415–1436.
 5.
Kothari, D. P., & Nagrath, I. J. (2003). Modern power system analysis. New Delhi: Tata McGraw Hill Publishing Company.
 6.
Saadat, H. (2002). Power system analysis. New York: McGrawHill.
 7.
Pandey, S. K., Mohanty, S. R., & Kishor, N. (2013). A literature survey on load frequency control for conventional and distribution generation power systems. Renewable and Sustainable Energy Reviews, 25, 318–334.
 8.
Yamashita, K., & Taniguchi, T. (1986). Optimal observer design for loadfrequency control. International Journal of Electrical Power & Energy Systems, 8(2), 93–100.
 9.
Mishra, S., Mallesham, G., & Sekhar, P. (2013). Biogeography based optimal state feedback controller for frequency regulation of a smart microgrid. IEEE Transactions on Smart Grid, 4(1), 628–637.
 10.
Kirchmayer, L. K. (1959). Economic control of interconnected systems. New York: Wiley.
 11.
Cohn, N. (1967). Considerations in the regulation of interconnected areas. IEEE Transactions on Power Apparatus and Systems, AS86(12), 1527–1538.
 12.
Ibraheem Kumar, P., & Kothari, D. P. (2005). Recent philosophies of automatic generation control strategies in power systems. IEEE Transactions on Power Apparatus and Systems, 20(1), 346–357.
 13.
Bevrani, H., & Hiyama, T. (2016). Intelligent automatic generation control. New York: CRC press.
 14.
Khooban, M. H., Niknam, T., Blaabjerg, F., & Dragicevic, T. (2017). A new load frequency control strategy for microgrids with considering electrical vehicles. Electric Power Systems Research, 143, 585–598.
 15.
Shahalami, S. H., & Farsi, D. (2018). Analysis of load frequency control in a restructured multiarea power system with the Kalman filter and the LQR controller. AEU International Journal of Electronics and Communications, 86, 25–46.
 16.
Alhelou, H. H., HamedaniGolshan, M. E., Zamani, R., HeydarianForushani, E., & Siano, P. (2018). Challenges and opportunities of load frequency control in conventional, modern and future smart power systems: A comprehensive review. Energies, 11(10), 1–35.
 17.
Kuo, B. C., & Golnaraghi, M. (2009). Automatic control systems. Hoboken: Wiley.
 18.
Ogata, K. (1997). Modern control systems. London: Prentice Hall.
 19.
Prajapat, G. P., Senroy, N., & Kar, I. N. (2017). Stability enhancement of DFIGbased wind turbine system through linear quadratic regulator. IET Generation Transmission and Distribution, 12(6), 1331–1338.
 20.
Kanieski, J. M., Tambara, R. V., Pinheiro, H., Cardoso, R., & Gruendling, H. A. (2016). Robust adaptive controller combined with a linear quadratic regulator based on Kalman filtering. IEEE Transactions on Automatic Control, 61(5), 1373–1378.
 21.
Muso, H., & Zarchan, P. (2005). Fundamentals of Kalman filtering: A practical approach. Virginia: American Institute of Aeronautics and Astronautics.
 22.
Tan, W., Chang, S., & Zhou, R. (2017). Load frequency control of power systems with nonlinearities. IET Generation Transmission and Distribution, 11(17), 4307–4313.
 23.
Zeng, N., Wang, Z., Li, Y., Du, M., & Liu, X. (2012). A hybrid EKF and switching PSO algorithm for joint state and parameter estimation of lateral flow immunoassay models. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 9(2), 321–329.
 24.
Usta, M. A., Okumus, H. I., & Kahveci, H. (2017). A simplified threelevel SVMDTC induction motor drive with speed and stator resistance estimation based on extended Kalman filter. Electrical Engineering, 99(2), 707–720.
 25.
Lamsal, D., Sreeram, V., Mishra, Y., & Kumar, D. (2017). Kalman filter approach for dispatching and attenuating the power fluctuation of wind and photovoltaic power generating systems. IET Generation Transmission and Distribution, 12(7), 1501–1508.
 26.
Fan, L., & Wehbe, Y. (2013). Extended Kalman filtering based real time dynamic state and parameter estimation using PMU data. Electric Power Systems Research, 103, 168–177.
Acknowledgements
Not applicable
Funding
Funding information is not applicable / No funding was received.
Author information
Affiliations
Contributions
Corresponding author contributed to the research, manuscript preparation and submission. Coauthors guided the work and supervised in manuscript revision, advice and professional support to the corresponding author. The author(s) read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Appendix
Appendix
In this section, a simplified frequency response model for a singlearea power system with generator, along with a turbine and governor, is chosen for illustration.
Following [6], the s domain equations for the block diagram shown are given below:
Solving the first derivative term yields
System matrix,
A typical power system with parameters described above for constructing A and B matrices is shown in Table 8.
For the purpose of discrete simulations, A and B are discretized as
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Pillai, A.G., Samuel, E.R. & Unnikrishnan, A. Optimal load frequency control through combined state and control gain estimation for noisy measurements. Prot Control Mod Power Syst 5, 24 (2020). https://doi.org/10.1186/s41601020001695
Received:
Accepted:
Published:
Keywords
 Load frequency control
 State feedback control
 Linear quadratic regulator
 Extended Kalman filter
 Single area power system