#+TITLE: A new method of designing complementary filters for sensor fusion using $\mathcal{H}_\infty$ synthesis :DRAWER: #+LATEX_CLASS: elsarticle #+LATEX_CLASS_OPTIONS: [preprint, sort&compress] #+OPTIONS: toc:nil todo:nil title:nil author:nil date:nil #+STARTUP: overview #+LATEX_HEADER_EXTRA: \journal{Mechanical Systems and Signal Processing} #+LATEX_HEADER_EXTRA: \author[a1,a2]{Thomas Dehaeze\corref{cor1}} #+LATEX_HEADER_EXTRA: \author[a3,a4]{Mohit Verma} #+LATEX_HEADER_EXTRA: \author[a2,a4]{Christophe Collette} #+LATEX_HEADER_EXTRA: \cortext[cor1]{Corresponding author. Email Address: dehaeze.thomas@gmail.com} #+LATEX_HEADER_EXTRA: \address[a1]{European Synchrotron Radiation Facility, Grenoble, France} #+LATEX_HEADER_EXTRA: \address[a2]{University of Li\`{e}ge, Department of Aerospace and Mechanical Engineering, 4000 Li\`{e}ge, Belgium.} #+LATEX_HEADER_EXTRA: \address[a3]{CSIR --- Structural Engineering Research Centre, Taramani, Chennai --- 600113, India.} #+LATEX_HEADER_EXTRA: \address[a4]{Universit\'{e} Libre de Bruxelles, Precision Mechatronics Laboratory, BEAMS Department, 1050 Brussels, Belgium.} #+LATEX_HEADER: \usepackage{subcaption} #+LATEX_HEADER: \usepackage{amsfonts} #+LATEX_HEADER: \usepackage{siunitx} #+LATEX_HEADER_EXTRA: \usepackage{tabularx} #+LATEX_HEADER_EXTRA: \usepackage{booktabs} #+LATEX_HEADER_EXTRA: \usepackage{array} #+LATEX_HEADER_EXTRA: \usepackage[hyperref]{xcolor} #+LATEX_HEADER_EXTRA: \usepackage[top=2cm, bottom=2cm, left=2cm, right=2cm]{geometry} #+LATEX_HEADER_EXTRA: \hypersetup{colorlinks=true} :END: * Build :noexport: #+NAME: startblock #+BEGIN_SRC emacs-lisp :results none (add-to-list 'org-latex-classes '("elsarticle" "\\documentclass{elsarticle}" ("\\section{%s}" . "\\section*{%s}") ("\\subsection{%s}" . "\\subsection*{%s}") ("\\subsubsection{%s}" . "\\subsubsection*{%s}") ("\\paragraph{%s}" . "\\paragraph*{%s}") ("\\subparagraph{%s}" . "\\subparagraph*{%s}")) ) (defun delete-org-comments (backend) (loop for comment in (reverse (org-element-map (org-element-parse-buffer) 'comment 'identity)) do (setf (buffer-substring (org-element-property :begin comment) (org-element-property :end comment)) ""))) ;; add to export hook (add-hook 'org-export-before-processing-hook 'delete-org-comments) ;; Remove hypersetup (setq org-latex-with-hyperref nil) #+END_SRC * =hypersetup= :ignore: \hypersetup{allcolors=teal} * Abstract and Keywords :ignore: #+begin_frontmatter #+begin_abstract Sensor have limited bandwidth and are accurate only in a certain frequency band. In many applications, the signals of different sensor are fused together in order to either enhance the stability or improve the operational bandwidth of the system. The sensor signals can be fused using complementary filters. The tuning of complementary filters is a complex task and is the subject of this paper. The filters needs to meet design specifications while satisfying the complementary property. This paper presents a framework to shape the norm of complementary filters using the $\mathcal{H}_\infty$ norm minimization. The design specifications are imposed as constraints in the optimization problem by appropriate selection of weighting functions. The proposed method is quite general and easily extendable to cases where more than two sensors are fused. Finally, the proposed method is applied to the design of complementary filter design for active vibration isolation of the Laser Interferometer Gravitation-wave Observatory (LIGO). #+end_abstract #+begin_keyword Sensor fusion \sep{} Optimal filters \sep{} $\mathcal{H}_\infty$ synthesis \sep{} Vibration isolation \sep{} Precision #+end_keyword #+end_frontmatter * Introduction <> ** New introduction :ignore: *** Introduction to Sensor Fusion :ignore: # Basic explanations of sensor fusion - cite:bendat57_optim_filter_indep_measur_two roots of sensor fusion *** Advantages of Sensor Fusion :ignore: # Sensor Fusion can have many advantages / can be applied for various purposes - Increase the bandwidth: cite:zimmermann92_high_bandw_orien_measur_contr - Increased robustness: cite:collette15_sensor_fusion_method_high_perfor - Decrease the noise: *** Applications :ignore: # The applications of sensor fusion are numerous - UAV: cite:pascoal99_navig_system_desig_using_time, cite:jensen13_basic_uas - Gravitational wave observer: cite:hua05_low_ligo,hua04_polyp_fir_compl_filter_contr_system *** Kalman Filtering or Complementary filters :ignore: # There are mainly two ways to perform sensor fusion: using complementary filters or using Kalman filtering - cite:brown72_integ_navig_system_kalman_filter alternate form of complementary filters => Kalman filtering - cite:higgins75_compar_compl_kalman_filter Compare Kalman Filtering with sensor fusion using complementary filters - cite:robert12_introd_random_signal_applied_kalman advantage of complementary filters over Kalman filtering *** Design Methods of Complementary filters :ignore: # In some cases, complementary filters are implemented in an analog way such as in [...], but most of the time it is implemented numerically which allows much more complex - Analog complementary filters: cite:yong16_high_speed_vertic_posit_stage, cite:moore19_capac_instr_sensor_fusion_high_bandw_nanop # Multiple design methods have been used for complementary filters - Analytical methods: - first order: cite:corke04_inert_visual_sensin_system_small_auton_helic - second order: cite:baerveldt97_low_cost_low_weigh_attit, cite:stoten01_fusion_kinet_data_using_compos_filter, cite:jensen13_basic_uas - higher order: cite:shaw90_bandw_enhan_posit_measur_using_measur_accel, cite:zimmermann92_high_bandw_orien_measur_contr, cite:collette15_sensor_fusion_method_high_perfor, cite:matichard15_seism_isolat_advan_ligo - cite:pascoal99_navig_system_desig_using_time use LMI to generate complementary filters - cite:hua05_low_ligo,hua04_polyp_fir_compl_filter_contr_system: FIR + convex optimization - Similar to feedback system: - cite:plummer06_optim_compl_filter_their_applic_motion_measur use H-Infinity to optimize complementary filters (flatten the super sensor noise spectral density) - cite:jensen13_basic_uas design of complementary filters with classical control theory, PID - 3 complementary filters: cite:becker15_compl_filter_desig_three_frequen_bands *** Problematics / gap in the research :ignore: - Robustness problems: cite:zimmermann92_high_bandw_orien_measur_contr change of phase near the merging frequency - Trial and error - Although many design methods of complementary filters have been proposed in the literature, no simple method that allows to shape the norm of the complementary filters is available. *** Describe the paper itself / the problem which is addressed :ignore: Most of the requirements => shape of the complementary filters => propose a way to shape complementary filters. *** Introduce Each part of the paper :ignore: ** Old Introduction :ignore:noexport: *** Establish the importance of the research topic :ignore: # What are Complementary Filters A set of filters is said to be complementary if the sum of their transfer functions is equal to one at all frequencies. These filters are used when two or more sensors are measuring the same physical quantity with different noise characteristics. Unreliable frequencies of each sensor are filtered out by the complementary filters and then combined to form a super sensor giving a better estimate of the physical quantity over a wider bandwidth. This technique is called sensor fusion and is used in many applications.\par *** Applications of complementary filtering :ignore: # Improve bandwidth for UAV In cite:zimmermann92_high_bandw_orien_measur_contr,corke04_inert_visual_sensin_system_small_auton_helic, various sensors (accelerometers, gyroscopes, vision sensors, etc.) are merged using complementary filters for the attitude estimation of Unmanned Aerial Vehicles (UAV). # Improving the control robustness In cite:collette15_sensor_fusion_method_high_perfor, several sensor fusion configurations using different types of sensors are discussed in order to increase the control bandwidth of active vibration isolation systems. # Merging of different sensor types Furthermore, sensor fusion is used in the isolation systems of the Laser Interferometer Gravitational-Wave Observator (LIGO) to merge inertial sensors with relative sensors cite:matichard15_seism_isolat_advan_ligo,hua04_polyp_fir_compl_filter_contr_system. \par *** Current design methods for complementary filters :ignore: # Why Design of Complementary Filter is important As the super sensor noise characteristics largely depend on the complementary filter norms, their proper design is of primary importance for sensor fusion. # Discuss the different approach to complementary filter design In cite:corke04_inert_visual_sensin_system_small_auton_helic,jensen13_basic_uas, first and second order analytical formulas of complementary filters have been presented. # Third Order and Higher orders Higher order complementary filters have been used in cite:shaw90_bandw_enhan_posit_measur_using_measur_accel,zimmermann92_high_bandw_orien_measur_contr,collette15_sensor_fusion_method_high_perfor. # Alternate Formulation In cite:jensen13_basic_uas, the sensitivity and complementary sensitivity transfer functions of a feedback architecture have been proposed to be used as complementary filters. The design of such filters can then benefit from the classical control theory developments. # LMI / convex Optimization Linear Matrix Inequalities (LMIs) are used in cite:pascoal99_navig_system_desig_using_time for the synthesis of complementary filters satisfying some frequency-like performance. # FIR Filters Finally, a synthesis method of high order Finite Impulse Response (FIR) complementary filters using convex optimization has been developed in cite:hua05_low_ligo,hua04_polyp_fir_compl_filter_contr_system. \par *** Describe a gap in the research :ignore: # There is a need for easy synthesis methods for complementary filters Although many design methods of complementary filters have been proposed in the literature, no simple method that allows to shape the norm of the complementary filters is available. *** Describe the paper itself / the problem which is addressed :ignore: # In this paper, we propose a synthesis method for the shaping of complementary filters using the $\mathcal{H}_\infty$ norm.\par This paper presents a new design method of complementary filters based on $\mathcal{H}_\infty$ synthesis. This design method permits to easily shape the norms of the generated filters.\par *** Introduce Each part of the paper :ignore: The section ref:sec:requirements gives a brief overview of sensor fusion using complementary filters and explains how the typical requirements for such fusion can be expressed as upper bounds on the filters norms. In section ref:sec:hinf_method, a new design method for the shaping of complementary filters using $\mathcal{H}_\infty$ synthesis is proposed. In section ref:sec:application_ligo, the method is used to design complex complementary filters that are used for sensor fusion at the LIGO. Our conclusions are drawn in the final section. ** Mohit's Introduction :noexport: The sensors used for measuring physical quantity often works well within a limited frequency range called as the bandwidth of the sensor. The signals recorded by the sensor beyond its bandwidth are often corrupt with noise and are not reliable. Many dynamical systems require measurements over a wide frequency range. Very often a variety of sensors are utilized to sense the same quantity. These sensors have different operational bandwidth and are reliable only in a particular frequency range. The signals from the different sensors are fused together in order to get the reliable measurement of the physical quantity over wider frequency band. The combining of signals from various sensor is called sensor fusion cite:hua04_polyp_fir_compl_filter_contr_system. The resulting sensor is referred as "super sensor" since it can have better noise characteristics and can operate over a wider frequency band as compared to the individual sensor used for merging cite:shaw90_bandw_enhan_posit_measur_using_measur_accel. Sensor fusion is most commonly employed in the navigation systems to accurately measure the position of a vehicle. The GPS sensors, which are accurate in low frequency band, are merged with the high-frequency accelerometers. Zimmermann and Sulzer cite:zimmermann92_high_bandw_orien_measur_contr used sensor fusion to measure the orientation of a robot. They merged inclinometer and accelerometers for accurate angular measurements over large frequency band. Corke cite:corke04_inert_visual_sensin_system_small_auton_helic merged inertial measurement unit with the stereo vision system for measurement of attitude, height and velocity of an unmanned helicopter. Baerveldt and Klang cite:baerveldt97 used an inclinometer and a gyroscope to measure the orientation of the autonomous helicopter. The measurement of the 3D orientation using a gyroscope and an accelerometer was demonstrated by Roberts et al. cite:roberts03_low. Cao et al. cite:cao20_adapt_compl_filter_based_post used sensor fusion to obtain the lateral and longitudinal velocities of the autonomous vehicle. Sensor fusion is also used for enhancing the working range of the active isolation system. For example, the active vibration isolation system at the Laser Interferometer Gravitational-Wave Observatory (LIGO) cite:matichard15_seism_isolat_advan_ligo utilizes sensor fusion. The position sensors, seismometer and geophones are used for measuring the motion of the LIGO platform in different frequency bands cite:hua05_low_ligo. Tjepkema et al. cite:tjepkema12_sensor_fusion_activ_vibrat_isolat_precis_equip used sensor fusion to isolate precision equipment from the ground motion. The feedback from the accelerometer was used for active isolation at low frequency while force sensor was used at high frequency. Various configurations of sensor fusion for active vibration isolation systems are discussed by Collette and Matichard cite:collette15_sensor_fusion_method_high_perfor. Ma and Ghasemi-Nejhad cite:ma04_frequen_weigh_adapt_contr_simul used laser sensor and piezoelectric patches for simultaneous tracking and vibration control in smart structures. Recently, Verma et al. cite:verma21_virtual_sensor_fusion_high_precis_contr presented virtual sensor fusion for high precision control where the signals from a physical sensor are fused with a sensor simulated virtually. Fusing signals from different sensors can typically be done using Kalman filtering cite:odry18_kalman_filter_mobil_robot_attit_estim, ren19_integ_gnss_hub_motion_estim, faria19_sensor_fusion_rotat_motion_recon, liu18_innov_infor_fusion_method_with, abdel15_const_low_cost_gps_filter, biondi17_attit_recov_from_featur_track or complementary filters cite:brown72_integ_navig_system_kalman_filter. A set of filters is said to be complementary if the sum of their transfer functions is equal to one at all frequencies. When two filters are complementary, usually one is a low pass filter while the other is an high pass filter. The complementary filters are designed in such a way that their magnitude is close to one in the bandwidth of the sensor they are combined with. This enables to measure the physical quantity over larger bandwidth. There are two different categories of complementary filters --- frequency domain complementary filters and state space complementary filters. Earliest application of the the frequency domain complementary filters was seen in Anderson and Fritze cite:anderson53_instr_approac_system_steer_comput. A simple RC circuit was used to physically realize the complementary filters. Frequency domain complementary filters were also used in cite:shaw90_bandw_enhan_posit_measur_using_measur_accel, zimmermann92_high_bandw_orien_measur_contr, baerveldt97, roberts03_low. State space complementary filter finds application in tracking orientation of the flexible links in a robot cite:bachmann03_desig_marg_dof, salcudean91_global_conver_angul_veloc_obser, mahony08_nonlin_compl_filter_special_orthog_group and are particularly useful for multi-input multi-output systems. Pascoal et al. cite:pascoal00_navig_system_desig_using_time presented complementary filters which can adapt with time for navigation system capable of estimating position and velocity using GPS and SONAR sensors. The noise characteristics of the super sensor are governed by the norms of the complementary filters. Therefore, the proper design of the complementary filters for sensor fusion is of immense importance. The design of complementary filters is a complex task as they need to tuned as per the specification of the sensor. In many applications, analytical formulas of first and second order complementary filters are used cite:corke04_inert_visual_sensin_system_small_auton_helic,jensen13_basic_uas. However, these low order complementary filters are not optimal, and high order complementary filters can lead to better fusion cite:jensen13_basic_uas,shaw90_bandw_enhan_posit_measur_using_measur_accel. Several design techniques have been proposed to design higher order complementary filters. Pascoal cite:pascoal00_navig_system_desig_using_time used linear matrix inequalities (LMIs) cite:boyd94_linear for the design of time varying complementary filters. LMIs were also used by Hua et al. cite:hua04_polyp_fir_compl_filter_contr_system to design finite impulse response (FIR) filters for the active vibration isolation system at LIGO. Plummer cite:plummer06_optim_compl_filter_their_applic_motion_measur proposed an optimal design method using the $\mathcal{H}_{\infty}$ synthesis and weighting functions representing the measurement noise of the sensors. Although various methods have been presented in the literature for the design of complementary filters, there is a lack of general and simple framework that allows to shape the norm of complementary filters. Such a method would prove to be very useful as the noise of the "supper sensor" and its dynamical characteristics depend on the norm of the filters. This paper presents such a framework based on the $\mathcal{H}_\infty$ norm minimization. The proposed method is quite general and can be easily extended to a case where more than two complementary filters needs to be designed. The organization of this paper is as follows. Section [[*Complementary filters requirements][2]] presents the design requirements of ideal complementary filters. It also demonstrates how the noise and robustness characteristics of the "super sensor" can be transformed into upper bounds on the norm of the complementary filters. The framework for the design of complementary filters is detailed in Section [[*Design formulation using $\mathcal{H}_\infty$ synthesis][3]]. This is followed by the application of the design method to complementary filter design for the active vibration isolation at LIGO in Section [[*Application: Complementary Filter Design for Active Vibration Isolation of LIGO][4]]. Finally, concluding remarks are presented in Section [[*Concluding remarks][5]]. * Sensor Fusion and Complementary Filters Requirements <> ** Introduction :ignore: Complementary filters provides a framework for fusing signals from different sensors. As the effectiveness of the fusion depends on the proper design of the complementary filters, they are expected to fulfill certain requirements. These requirements are discussed in this section. ** Sensor Fusion Architecture <> A general sensor fusion architecture using complementary filters is shown in Figure ref:fig:sensor_fusion_overview where several sensors (here two) are measuring the same physical quantity $x$. The two sensors output signals are estimates $\hat{x}_1$ and $\hat{x}_2$ of $x$. Each of these estimates are then filtered out by complementary filters and combined to form a new estimate $\hat{x}$. The resulting sensor, termed as "super sensor", can have larger bandwidth and better noise characteristics in comparison to the individual sensor. This means that the super sensor provides an estimate $\hat{x}$ of $x$ which can be more accurate over a larger frequency band than the outputs of the individual sensors. #+name: fig:sensor_fusion_overview #+caption: Schematic of a sensor fusion architecture [[file:figs/sensor_fusion_overview.pdf]] The complementary property of filters $H_1(s)$ and $H_2(s)$ implies that the summation of their transfer functions is equal to unity. That is, unity magnitude and zero phase at all frequencies. Therefore, a pair of strict complementary filter needs to satisfy the following condition: #+name: eq:comp_filter \begin{equation} H_1(s) + H_2(s) = 1 \end{equation} It will soon become clear why the complementary property is important. ** Sensor Models and Sensor Normalization <> In order to study such sensor fusion architecture, a model of the sensors is required. Such model is shown in Figure ref:fig:sensor_model and consists of a linear time invariant (LTI) system $G_i(s)$ representing the dynamics of the sensor and an additive noise input $n_i$ representing its noise. The model input $x$ is the measured physical quantity and its output $\tilde{x}_i$ is the "raw" output of the sensor. Before filtering the sensor outputs $\tilde{x}_i$ by the complementary filters, the sensors are usually normalized to simplify the fusion. This normalization consists of first obtaining an estimate $\hat{G}_i(s)$ of the sensor dynamics $G_i(s)$. It is supposed that the estimate of the sensor dynamics $\hat{G}_i(s)$ can be inverted and that its inverse $\hat{G}_i^{-1}(s)$ is proper and stable. The raw output of the sensor $\tilde{x}_i$ is then passed through $\hat{G}_i^{-1}(s)$ as shown in Figure ref:fig:sensor_model_calibrated. This way, the units of the estimates $\hat{x}_i$ are equal to the units of the physical quantity $x$. The sensor dynamics estimate $\hat{G}_1(s)$ can be a simple gain or more complex transfer functions. #+begin_export latex \begin{figure}[htbp] \begin{subfigure}[b]{0.49\linewidth} \centering \includegraphics[scale=1]{figs/sensor_model.pdf} \caption{\label{fig:sensor_model} Basic sensor model consisting of a noise input $n_i$ and a dynamics $G_i(s)$} \end{subfigure} \hfill \begin{subfigure}[b]{0.49\linewidth} \centering \includegraphics[scale=1]{figs/sensor_model_calibrated.pdf} \caption{\label{fig:sensor_model_calibrated} Calibrated sensors using the inverse of an estimate $\hat{G}_1(s)$ of the sensor dynamics} \end{subfigure} \caption{\label{fig:sensor_models}Sensor models with an without normalization} \centering \end{figure} #+end_export Two calibrated sensors and then combined to form a super sensor as shown in Figure ref:fig:fusion_super_sensor. The two sensors are measuring the same physical quantity $x$ with dynamics $G_1(s)$ and $G_2(s)$, and with /uncorrelated/ noises $n_1$ and $n_2$. The normalized signals from both calibrated sensors are fed into two complementary filters $H_1(s)$ and $H_2(s)$ and then combined to yield an estimate $\hat{x}$ of $x$ as shown in Fig. ref:fig:fusion_super_sensor. The super sensor output is therefore equal to: #+name: eq:comp_filter_estimate \begin{equation} \hat{x} = \Big( H_1(s) \hat{G}_1^{-1}(s) G_1(s) + H_2(s) \hat{G}_2^{-1}(s) G_2(s) \Big) x + H_1(s) \hat{G}_1^{-1}(s) G_1(s) n_1 + H_2(s) \hat{G}_2^{-1}(s) G_2(s) n_2 \end{equation} #+name: fig:fusion_super_sensor #+caption: Sensor fusion architecture #+attr_latex: :scale 1 [[file:figs/fusion_super_sensor.pdf]] ** Noise Sensor Filtering <> In this section, it is supposed that all the sensors are perfectly calibrated, such that: #+name: eq:perfect_dynamics \begin{equation} \frac{\hat{x}_i}{x} = \hat{G}_i(s) G_i(s) = 1 \end{equation} The effect of a non-perfect normalization will be discussed in the next section. The super sensor output $\hat{x}$ is then: #+name: eq:estimate_perfect_dyn \begin{equation} \hat{x} = x + H_1(s) n_1 + H_2(s) n_2 \end{equation} From eqref:eq:estimate_perfect_dyn, the complementary filters $H_1(s)$ and $H_2(s)$ are shown to only operate on the sensor's noises. Thus, this sensor fusion architecture permits to filter the noise of both sensors without introducing any distortion in the physical quantity to be measured. The estimation error $\delta x$, defined as the difference between the sensor output $\hat{x}$ and the measured quantity $x$, is computed for the super sensor eqref:eq:estimate_error. #+name: eq:estimate_error \begin{equation} \delta x \triangleq \hat{x} - x = H_1(s) n_1 + H_2(s) n_2 \end{equation} As shown in eqref:eq:noise_filtering_psd, the Power Spectral Density (PSD) of the estimation error $\Phi_{\delta x}$ depends both on the norm of the two complementary filters and on the PSD of the noise sources $\Phi_{n_1}$ and $\Phi_{n_2}$. #+name: eq:noise_filtering_psd \begin{equation} \Phi_{\delta x}(\omega) = \left|H_1(j\omega)\right|^2 \Phi_{n_1}(\omega) + \left|H_2(j\omega)\right|^2 \Phi_{n_2}(\omega) \end{equation} If the two sensors have identical noise characteristics ($\Phi_{n_1}(\omega) = \Phi_{n_2}(\omega)$), a simple averaging ($H_1(s) = H_2(s) = 0.5$) is what would minimize the super sensor noise. This the simplest form of sensor fusion with complementary filters. However, the two sensors have usually high noise levels over distinct frequency regions. In such case, to lower the noise of the super sensor, the value of the norm $|H_1|$ has to be lowered when $\Phi_{n_1}$ is larger than $\Phi_{n_2}$ and that of $|H_2|$ lowered when $\Phi_{n_2}$ is larger than $\Phi_{n_1}$. Therefore, by properly shaping the norm of the complementary filters, it is possible to minimize the noise of the super sensor noise. ** Sensor Fusion Robustness <> In practical systems the sensor normalization is not perfect and condition eqref:eq:perfect_dynamics is not verified. In order to study such imperfection, a multiplicative input uncertainty is added to the sensor dynamics (Figure ref:fig:sensor_model_uncertainty), where the nominal model is taken as the estimated model for the normalization $\hat{G}_i(s)$, $\Delta_i$ is any stable transfer function satisfying $|\Delta_i(j\omega)| \le 1,\ \forall\omega$, and $w_i(s)$ is a weight representing the magnitude of the uncertainty. The weight $w_i(s)$ is chosen such that the real sensor dynamics is always contained in the uncertain region represented by a circle centered on $1$ and with a radius equal to $|w_i(j\omega)|$. As the nominal sensor dynamics is taken as the normalized filter, the normalized sensor can be further simplified as shown in Figure ref:fig:sensor_model_uncertainty_simplified. #+begin_export latex \begin{figure}[htbp] \begin{subfigure}[b]{0.59\linewidth} \centering \includegraphics[scale=1]{figs/sensor_model_uncertainty.pdf} \caption{\label{fig:sensor_model_uncertainty} Sensor with multiplicative input uncertainty} \end{subfigure} \hfill \begin{subfigure}[b]{0.39\linewidth} \centering \includegraphics[scale=1]{figs/sensor_model_uncertainty_simplified.pdf} \caption{\label{fig:sensor_model_uncertainty_simplified} Simplified sensor model} \end{subfigure} \hfill \caption{\label{fig:sensor_models_uncertainty}Sensor models with dynamical uncertainty} \centering \end{figure} #+end_export A sensor fusion architecture with two sensors with dynamical uncertainty is shown in Figure ref:fig:sensor_fusion_dynamic_uncertainty. #+name: fig:sensor_fusion_dynamic_uncertainty #+caption: Sensor fusion architecture with sensor dynamics uncertainty [[file:figs/sensor_fusion_dynamic_uncertainty.pdf]] The super sensor dynamics eqref:eq:super_sensor_dyn_uncertainty is no longer equal to $1$ and now depends on the sensor dynamics uncertainty weights $w_i(s)$ as well as on the complementary filters $H_i(s)$. #+name: eq:super_sensor_dyn_uncertainty \begin{equation} \frac{\hat{x}}{x} = 1 + w_1(s) H_1(s) \Delta_1(s) + w_2(s) H_2(s) \Delta_2(s) \end{equation} The dynamical uncertainty of the super sensor can be graphically represented in the complex plane by a circle centered on $1$ with a radius equal to $|w_1(j\omega) H_1(j\omega)| + |w_2(j\omega) H_2(j\omega)|$ as shown in Figure ref:fig:uncertainty_set_super_sensor. #+name: fig:uncertainty_set_super_sensor #+caption: Uncertainty region of the super sensor dynamics in the complex plane (solid circle). The contribution of both sensors 1 and 2 to the uncertainty are represented respectively by a blue circle and a red circle. The frequency dependency $\omega$ is here omitted. [[file:figs/uncertainty_set_super_sensor.pdf]] The super sensor dynamical uncertainty (i.e. the robustness of the fusion) clearly depends on the complementary filters norms. For instance, the phase uncertainty $\Delta\phi(\omega)$ added by the super sensor dynamics at frequency $\omega$ can be found by drawing a tangent from the origin to the uncertainty circle of super sensor (Figure ref:fig:uncertainty_set_super_sensor) and is bounded by eqref:eq:max_phase_uncertainty. #+name: eq:max_phase_uncertainty \begin{equation} \Delta\phi(\omega) < \arcsin\big( |w_1(j\omega) H_1(j\omega)| + |w_2(j\omega) H_2(j\omega)| \big) \end{equation} As it is generally desired to limit the maximum phase added by the super sensor, $H_1(s)$ and $H_2(s)$ should be designed such that $\Delta \phi$ is bounded to acceptable values. Typically, the norm of the complementary filter $|H_i(j\omega)|$ should be made small when $|w_i(j\omega)|$ is large, i.e., at frequencies where the sensor dynamics is uncertain. * Complementary Filters Shaping <> ** Introduction :ignore: As shown in Section ref:sec:requirements, the noise and robustness of the "super sensor" are determined by the complementary filters norms. Therefore, a complementary filters synthesis method that allows to shape their norms would be of great use. In this section, such synthesis is proposed by expressing this problem as a $\mathcal{H}_\infty$ norm optimization. ** Synthesis Objective <> The synthesis objective is to shape the norm of two filters $H_1(s)$ and $H_2(s)$ while ensuring their complementary property eqref:eq:comp_filter. This is equivalent as to finding proper and stable transfer functions $H_1(s)$ and $H_2(s)$ such that conditions eqref:eq:comp_filter_problem_form are satisfied. #+name: eq:comp_filter_problem_form \begin{subequations} \begin{align} & H_1(s) + H_2(s) = 1 \label{eq:hinf_cond_complementarity} \\ & |H_1(j\omega)| \le \frac{1}{|W_1(j\omega)|} \quad \forall\omega \label{eq:hinf_cond_h1} \\ & |H_2(j\omega)| \le \frac{1}{|W_2(j\omega)|} \quad \forall\omega \label{eq:hinf_cond_h2} \end{align} \end{subequations} where $W_1(s)$ and $W_2(s)$ are two weighting transfer functions that are chosen to specify the maximum wanted norms of the complementary filters during the synthesis. ** Shaping of Complementary Filters using $\mathcal{H}_\infty$ synthesis <> In this section, it is shown that the synthesis objective can be easily expressed as a standard $\mathcal{H}_\infty$ optimal control problem and therefore solved using convenient tools readily available. Consider the generalized plant $P(s)$ shown in Figure ref:fig:h_infinity_robust_fusion and mathematically described by eqref:eq:generalized_plant. #+name: eq:generalized_plant \begin{equation} \begin{bmatrix} z_1 \\ z_2 \\ v \end{bmatrix} = P(s) \begin{bmatrix} w\\u \end{bmatrix}; \quad P(s) = \begin{bmatrix}W_1(s) & -W_1(s) \\ 0 & \phantom{+}W_2(s) \\ 1 & 0 \end{bmatrix} \end{equation} #+name: fig:h_infinity_robust_fusion #+caption: Generalized plant used for $\mathcal{H}_\infty$ synthesis of complementary filters #+attr_latex: :scale 1 [[file:figs/h_infinity_robust_fusion.pdf]] Applying the standard $\mathcal{H}_\infty$ synthesis on the generalized plant $P(s)$ is then equivalent as finding a stable filter $H_2(s)$ which based on $v$, generates a signal $u$ such that the $\mathcal{H}_\infty$ norm from $w$ to $[z_1, \ z_2]$ is less than one eqref:eq:hinf_syn_obj. #+name: eq:hinf_syn_obj \begin{equation} \left\|\begin{matrix} \left(1 - H_2(s)\right) W_1(s) \\ H_2(s) W_2(s) \end{matrix}\right\|_\infty \le 1 \end{equation} By then defining $H_1(s)$ to be the complementary of $H_2(s)$ eqref:eq:definition_H1, the $\mathcal{H}_\infty$ synthesis objective becomes equivalent to eqref:eq:hinf_problem which ensure that eqref:eq:hinf_cond_h1 and eqref:eq:hinf_cond_h2 are satisfied. #+name: eq:definition_H1 \begin{equation} H_1(s) \triangleq 1 - H_2(s) \end{equation} #+name: eq:hinf_problem \begin{equation} \left\|\begin{matrix} H_1(s) W_1(s) \\ H_2(s) W_2(s) \end{matrix}\right\|_\infty \le 1 \end{equation} Therefore, applying the $\mathcal{H}_\infty$ synthesis on the standard plant $P(s)$ eqref:eq:generalized_plant will generate two filters $H_2(s)$ and $H_1(s) \triangleq 1 - H_2(s)$ that are complementary eqref:eq:comp_filter_problem_form and such that there norms are bellow specified bounds [[eqref:eq:hinf_cond_h1]],eqref:eq:hinf_cond_h2. The above optimization problem can be efficiently solved in Matlab cite:matlab20 using the Robust Control Toolbox. ** Weighting Functions Design <> Weighting functions are used during the synthesis to specify what is the maximum allowed norms of the complementary filters. The proper design of these weighting functions is of primary importance for the success of the presented complementary filters $\mathcal{H}_\infty$ synthesis. First, only proper and stable transfer functions should be used. Second, the order of the weighting functions should stay reasonably small in order to reduce the computational costs associated with the solving of the optimization problem and for the physical implementation of the filters (the order of the synthesized filters being equal to the sum of the weighting functions order). Third, one should not forget the fundamental limitations imposed by the complementary property eqref:eq:comp_filter. This implies for instance that $|H_1(j\omega)|$ and $|H_2(j\omega)|$ cannot be made small at the same frequency. When designing complementary filters, it is usually desired to specify its slope, its crossover frequency and its maximum gain at low and high frequency. To help with the design of the weighting functions such that the above specification can be easily expressed, the formula eqref:eq:weight_formula is proposed. #+name: eq:weight_formula \begin{equation} W(s) = \left( \frac{ \hfill{} \frac{1}{\omega_c} \sqrt{\frac{1 - \left(\frac{G_0}{G_c}\right)^{\frac{2}{n}}}{1 - \left(\frac{G_c}{G_\infty}\right)^{\frac{2}{n}}}} s + \left(\frac{G_0}{G_c}\right)^{\frac{1}{n}} }{ \left(\frac{1}{G_\infty}\right)^{\frac{1}{n}} \frac{1}{\omega_c} \sqrt{\frac{1 - \left(\frac{G_0}{G_c}\right)^{\frac{2}{n}}}{1 - \left(\frac{G_c}{G_\infty}\right)^{\frac{2}{n}}}} s + \left(\frac{1}{G_c}\right)^{\frac{1}{n}} }\right)^n \end{equation} The parameters in formula eqref:eq:weight_formula are: - $G_0 = lim_{\omega \to 0} |W(j\omega)|$: the low frequency gain - $G_\infty = lim_{\omega \to \infty} |W(j\omega)|$: the high frequency gain - $G_c = |W(j\omega_c)|$: the gain at $\omega_c$ - $n$: the slope between high and low frequency. It is also the order of the weighting function. The parameters $G_0$, $G_c$ and $G_\infty$ should either satisfy condition eqref:eq:cond_formula_1 or eqref:eq:cond_formula_2. #+name: eq:condition_params_formula \begin{subequations} \begin{align} G_0 < 1 < G_\infty \text{ and } G_0 < G_c < G_\infty \label{eq:cond_formula_1}\\ G_\infty < 1 < G_0 \text{ and } G_\infty < G_c < G_0 \label{eq:cond_formula_2} \end{align} \end{subequations} The typical shape of a weighting function generated using eqref:eq:weight_formula is shown in Figure ref:fig:weight_formula. #+name: fig:weight_formula #+caption: Magnitude of a weighting function generated using the proposed formula eqref:eq:weight_formula, $G_0 = 1e^{-3}$, $G_\infty = 10$, $\omega_c = \SI{10}{Hz}$, $G_c = 2$, $n = 3$ #+attr_latex: :scale 1 [[file:figs/weight_formula.pdf]] ** Validation of the proposed synthesis method <> The proposed methodology for the design of complementary filters is now applied on a simple example where two complementary filters $H_1(s)$ and $H_2(s)$ have to be designed such that: - the merging frequency is around $\SI{10}{Hz}$ - the slope of $|H_1(j\omega)|$ is $-2$ above $\SI{10}{Hz}$ - the slope of $|H_2(j\omega)|$ is $+3$ below $\SI{10}{Hz}$ - the maximum gain of both filters is $10^{-3}$ away from the merging frequency The first step is to design weighting functions that translate the above requirements. They are here designed using eqref:eq:weight_formula with parameters summarized in table ref:tab:weights_params. The magnitudes of the weighting functions are shown by dashed lines in Figure ref:fig:hinf_filters_results. #+name: tab:weights_params #+caption: Parameters used for weighting functions $W_1(s)$ and $W_2(s)$ using eqref:eq:weight_formula #+ATTR_LATEX: :environment tabularx :width 0.29\linewidth :align ccc #+ATTR_LATEX: :center t :booktabs t :float t | Parameters | $W_1(s)$ | $W_2(s)$ | |------------+---------------+---------------| | $G_0$ | $0.1$ | $1000$ | | $G_\infty$ | $1000$ | $0.1$ | | $\omega_c$ | $2\pi\cdot10$ | $2\pi\cdot10$ | | $G_c$ | $0.45$ | $0.45$ | | $n$ | $2$ | $3$ | The $\mathcal{H}_\infty$ synthesis is applied on the generalized plant of Figure ref:fig:h_infinity_robust_fusion using the Matlab =hinfsyn= command. The synthesized filter $H_2(s)$ is such that $\mathcal{H}_\infty$ norm between $w$ and $[z_1,\ z_2]^T$ is minimized and here found close to one eqref:eq:hinf_synthesis_result. #+name: eq:hinf_synthesis_result \begin{equation} \left\|\begin{matrix} \left(1 - H_2(s)\right) W_1(s) \\ H_2(s) W_2(s) \end{matrix}\right\|_\infty \approx 1 \end{equation} The bode plots of the obtained complementary filters are shown by solid lines in Figure ref:fig:hinf_filters_results and their transfer functions in the Laplace domain are given in eqref:eq:hinf_synthesis_result_tf. #+name: eq:hinf_synthesis_result_tf \begin{subequations} \begin{align} H_2(s) &= \frac{(s+6.6e^4) (s+160) (s+4)^3}{(s+6.6e^4) (s^2 + 106 s + 3e^3) (s^2 + 72s + 3580)} \\ H_1(s) &\triangleq H_2(s) - 1 = \frac{10^{-8} (s+6.6e^9) (s+3450)^2 (s^2 + 49s + 895)}{(s+6.6e^4) (s^2 + 106 s + 3e^3) (s^2 + 72s + 3580)} \end{align} \end{subequations} The obtained transfer functions are of order $5$ as expected (sum of the weighting functions orders), and their magnitudes are bellow the maximum specified ones as ensured by eqref:eq:hinf_synthesis_result. #+name: fig:hinf_filters_results #+caption: Frequency response of the weighting functions and complementary filters obtained using $\mathcal{H}_\infty$ synthesis [[file:figs/hinf_filters_results.pdf]] This simple example illustrates the fact that the proposed methodology for complementary filters shaping is quite easy to use and effective. A more complex real life example is taken up in the next section. * Application: Design of Complementary Filters used in the Active Vibration Isolation System at the LIGO <> ** Introduction :ignore: Sensor fusion using complementary filters are widely used in active vibration isolation systems in gravitational wave detectors such at the LIGO cite:matichard15_seism_isolat_advan_ligo,hua05_low_ligo, the VIRGO cite:lucia18_low_frequen_optim_perfor_advan,heijningen18_low and the KAGRA cite:akutsu21_vibrat_isolat_system_beam_split. In the first isolation stage at the LIGO, two sets of complementary filters are used and included in a feedback loop cite:hua04_low_ligo. A set of complementary filters ($L_2,H_2$) is first used to fuse a seismometer and a geophone. Then, another set of complementary filters ($L_1,H_1$) is used to merge the output of the first "inertial super sensor" with a position sensor. A simplified block diagram of the sensor fusion architecture is shown in Figure ref:fig:ligo_super_sensor_architecture. #+name: fig:ligo_super_sensor_architecture #+caption: Simplified block diagram of the sensor blending strategy for the first stage at the LIGO cite:hua04_low_ligo #+attr_latex: :scale 1 [[file:figs/ligo_super_sensor_architecture.pdf]] The fusion of the position sensor at low frequency with the "inertial super sensor" at high frequency using the complementary filters ($L_1,H_1$) is done for several reasons, first of which is to give the super sensor a DC sensibility and therefore allow the feedback loop to have authority at zero frequency. The requirements on those filters are very tight and thus their design is complex and should be expressed as an optimization problem. The approach used in cite:hua05_low_ligo is to use FIR complementary filters and to write the synthesis as a convex optimization problem. After synthesis, the obtained FIR filters were found to be compliant with the requirements. However they are of very high order so their implementation is quite complex. In this section, the effectiveness of the proposed complementary filter synthesis strategy is demonstrated on the same set of requirements. ** Complementary Filters Specifications <> The specifications for the set of complementary filters ($L_1,H_1$) used at the LIGO are summarized below (for further details, refer to cite:hua04_polyp_fir_compl_filter_contr_system): - From $0$ to $\SI{0.008}{Hz}$, the magnitude $|L_1(j\omega)|$ should be less or equal to $8 \times 10^{-4}$ - Between $\SI{0.008}{Hz}$ to $\SI{0.04}{Hz}$, the filter $L_1(s)$ should attenuate the input signal proportional to frequency cubed - Between $\SI{0.04}{Hz}$ to $\SI{0.1}{Hz}$, the magnitude $|L_1(j\omega)|$ should be less than $3$ - Above $\SI{0.1}{Hz}$, the magnitude $|H_1(j\omega)|$ should be less than $0.045$ These specifications are therefore upper bounds on the complementary filters' magnitudes. They are physically represented in Figure ref:fig:fir_filter_ligo as well as the obtained magnitude of the FIR filters in cite:hua05_low_ligo. #+name: fig:fir_filter_ligo #+caption: Specifications and Bode plot of the obtained FIR filters in cite:hua05_low_ligo #+attr_latex: :scale 1 [[file:figs/fir_filter_ligo.pdf]] ** Weighting Functions Design <> The weighting functions should be designed such that their inverse magnitude is as close as possible to the specifications in order to not over-constrain the synthesis problem. However, the order of each weight should stay reasonably small in order to reduce the computational costs of the optimization problem as well as for the physical implementation of the filters. A Type I Chebyshev filter of order $20$ is used as the weighting transfer function $w_L(s)$ corresponding to the low pass filter. For the one corresponding to the high pass filter $w_H(s)$, a $7^{\text{th}}$ order transfer function is designed. The magnitudes of the weighting functions are shown in Fig. ref:fig:ligo_weights. #+name: fig:ligo_weights #+caption: Specifications and weighting functions magnitudes #+attr_latex: :scale 1 [[file:figs/ligo_weights.pdf]] ** $\mathcal{H}_\infty$ Synthesis <> $\mathcal{H}_\infty$ synthesis is performed using the architecture shown in Fig. ref:eq:generalized_plant. The complementary filters obtained are of order $27$. In Fig. ref:fig:comp_fir_ligo_hinf, their bode plot is compared with the FIR filters of order 512 obtained in cite:hua05_low_ligo. They are found to be very close to each other and this shows the effectiveness of the proposed synthesis method. #+name: fig:comp_fir_ligo_hinf #+caption: Comparison of the FIR filters (solid) designed in cite:hua05_low_ligo with the filters obtained with $\mathcal{H}_\infty$ synthesis (dashed) #+attr_latex: :scale 1 [[file:figs/comp_fir_ligo_hinf.pdf]] * Discussion ** Alternative configuration - Feedback architecture : Similar to mixed sensitivity (add schematic of feedback loop with weights) - 2 inputs / 1 output Explain differences - cite:plummer06_optim_compl_filter_their_applic_motion_measur use H-Infinity to optimize complementary filters (flatten the super sensor noise spectral density) - cite:jensen13_basic_uas design of complementary filters with classical control theory, PID #+name: fig:feedback_sensor_fusion #+caption: Classical feedback architecture for sensor fusion #+attr_latex: :scale 1 [[file:figs/feedback_sensor_fusion.pdf]] \begin{equation} \hat{x} = \underbrace{\frac{L(s)}{1 + L(s)}}_{T(s)} \hat{x}_1 + \underbrace{\frac{1}{1 + L(s)}}_{S(s)} \hat{x}_2 \end{equation} with the famous relationship \begin{equation} T(s) + S(s) = 1 \end{equation} Therefore, complementary filter design is very similar to mixed-sensitivity synthesis. They are actually equivalent by taking \begin{equation} L = H_H^{-1} - 1 \end{equation} (provided $H_H$ is invertible, therefore bi-proper) \begin{equation} P_L(s) = \begin{bmatrix} \phantom{+}W_2(s) & 0 & \phantom{+}1 \\ -W_2(s) & W_1(s) & -1 \end{bmatrix} \end{equation} #+name: fig:feedback_synthesis_architecture_generalized_plant #+caption: Generalized plant for mixed-sensitivity shaping #+attr_latex: :scale 1 [[file:figs/feedback_synthesis_architecture_generalized_plant.pdf]] ** Imposing zero at origin / roll-off 3 methods: Link to literature about doing that with mixed sensitivity ** Synthesis of Three Complementary Filters <> *** Why it is used sometimes :ignore: Some applications may require to merge more than two sensors. In such a case, it is necessary to design as many complementary filters as the number of sensors used. # Example of LIGO # In truth two options: sequential fusion or fusion at once *** Sequential vs Parallel :ignore: #+begin_export latex \begin{figure}[htbp] \begin{subfigure}[b]{0.59\linewidth} \centering \includegraphics[scale=1]{figs/sensor_fusion_three_sequential.pdf} \caption{\label{fig:sensor_fusion_three_sequential}Sequential fusion} \end{subfigure} \hfill \begin{subfigure}[b]{0.39\linewidth} \centering \includegraphics[scale=1]{figs/sensor_fusion_three_parallel.pdf} \caption{\label{fig:sensor_fusion_three_parallel}Parallel fusion} \end{subfigure} \caption{\label{fig:sensor_fusion_three}Sensor fusion architecture with more than two sensors} \centering \end{figure} #+end_export *** Mathematical Problem :ignore: The synthesis problem is then to compute $n$ stable transfer functions $H_i(s)$ such that eqref:eq:hinf_problem_gen is satisfied. #+name: eq:hinf_problem_gen \begin{subequations} \begin{align} & \sum_{i=0}^n H_i(s) = 1 \label{eq:hinf_cond_compl_gen} \\ & \left| H_i(j\omega) \right| < \frac{1}{\left| W_i(j\omega) \right|}, \quad \forall \omega,\ i = 1 \dots n \label{eq:hinf_cond_perf_gen} \end{align} \end{subequations} *** H-Infinity Architecture :ignore: The synthesis method is generalized here for the synthesis of three complementary filters using the architecture shown in Fig. ref:fig:comp_filter_three_hinf. The $\mathcal{H}_\infty$ synthesis objective applied on $P(s)$ is to design two stable filters $H_2(s)$ and $H_3(s)$ such that the $\mathcal{H}_\infty$ norm of the transfer function from $w$ to $[z_1,\ z_2, \ z_3]$ is less than one eqref:eq:hinf_syn_obj_three. #+name: eq:hinf_syn_obj_three \begin{equation} \left\| \begin{matrix} \left[1 - H_2(s) - H_3(s)\right] W_1(s) \\ H_2(s) W_2(s) \\ H_3(s) W_3(s) \end{matrix} \right\|_\infty \le 1 \end{equation} #+name: fig:comp_filter_three_hinf #+caption: Architecture for $\mathcal{H}_\infty$ synthesis of three complementary filters #+attr_latex: :scale 1 [[file:figs/comp_filter_three_hinf.pdf]] By choosing $H_1(s) \triangleq 1 - H_2(s) - H_3(s)$, the proposed $\mathcal{H}_\infty$ synthesis solves the design problem eqref:eq:hinf_problem_gen. \par *** Example of generated complementary filters :ignore: An example is given to validate the method where three sensors are used in different frequency bands (up to $\SI{1}{Hz}$, from $1$ to $\SI{10}{Hz}$ and above $\SI{10}{Hz}$ respectively). Three weighting functions are designed using eqref:eq:weight_formula and shown by dashed curves in Fig. ref:fig:three_complementary_filters_results. The bode plots of the obtained complementary filters are shown in Fig. ref:fig:three_complementary_filters_results. #+name: fig:three_complementary_filters_results #+caption: Frequency response of the weighting functions and three complementary filters obtained using $\mathcal{H}_\infty$ synthesis #+attr_latex: :scale 1 [[file:figs/three_complementary_filters_results.pdf]] * Conclusion <> This paper has shown how complementary filters can be used to combine multiple sensors in order to obtain a super sensor. Typical specification on the super sensor noise and on the robustness of the sensor fusion has been shown to be linked to the norm of the complementary filters. Therefore, a synthesis method that permits the shaping of the complementary filters norms has been proposed and has been successfully applied for the design of complex filters. Future work will aim at further developing this synthesis method for the robust and optimal synthesis of complementary filters used in sensor fusion. * Acknowledgment :PROPERTIES: :UNNUMBERED: t :END: This research benefited from a FRIA grant from the French Community of Belgium. * Bibliography :ignore: \bibliographystyle{elsarticle-num} \bibliography{ref} * Local Variables :noexport: # Local Variables: # org-latex-packages-alist: nil # End: