Self-tuning

In control theory a self-tuning system is capable of optimizing its own internal running parameters in order to maximize or minimize the fulfilment of an objective function; typically the maximization of efficiency or error minimization.

Self-tuning and auto-tuning often refer to the same concept. Many software research groups consider auto-tuning the proper nomenclature.

Self-tuning systems typically exhibit non-linear adaptive control. Self-tuning systems have been a hallmark of the aerospace industry for decades, as this sort of feedback is necessary to generate optimal multi-variable control for non-linear processes. In the telecommunications industry, adaptive communications are often used to dynamically modify operational system parameters to maximize efficiency and robustness.

Examples

Examples of self-tuning systems in computing include:

• TCP (Transmission Control Protocol)
• Microsoft SQL Server (Newer implementations only)
• FFTW (Fastest Fourier Transform in the West)
• ATLAS (Automatically Tuned Linear Algebra Software)
• libtune (Tunables library for Linux)
• PhiPAC (Self Tuning Linear Algebra Software for RISC)
• MILEPOST GCC (Machine learning based self-tuning compiler)

Performance benefits can be substantial. Professor Jack Dongarra, an American computer scientist, claims self-tuning boosts performance, often on the order of 300%.

Digital self-tuning controllers are an example of self-tuning systems at the hardware level.

Architecture

Self-tuning systems are typically composed of four components: expectations, measurement, analysis, and actions. The expectations describe how the system should behave given exogenous conditions.

Measurements gather data about the conditions and behaviour. Analysis helps determine whether the expectations are being met- and which subsequent actions should be performed. Common actions are gathering more data and performing dynamic reconfiguration of the system.

Self-tuning (self-adapting) systems of automatic control are systems whereby adaptation to randomly changing conditions is performed by means of automatically changing parameters or via automatically determining their optimum configuration. In any non-self-tuning automatic control system there are parameters which have an influence on system stability and control quality and which can be tuned. If these parameters remain constant whilst operating conditions (such as input signals or different characteristics of controlled objects) are substantially varying, control can degrade or even become unstable. Manual tuning is often cumbersome and sometimes impossible. In such cases, not only is using self-tuning systems technically and economically worthwhile, but it could be the only means of robust control. Self-tuning systems can be with or without parameter determination.

In systems with parameter determination the required level of control quality is achieved by automatically searching for an optimum (in some sense) set of parameter values. Control quality is described by a generalised characteristic which is usually a complex and not completely known or stable function of the primary parameters. This characteristic is either measured directly or computed based on the primary parameter values. The parameters are then tentatively varied. An analysis of the control quality characteristic oscillations caused by the varying of the parameters makes it possible to figure out if the parameters have optimum values, i.e.. if those values deliver extreme (minimum or maximum) values of the control quality characteristic. If the characteristic values deviate from an extremum, the parameters need to be varied until optimum values are found. Self-tuning systems with parameter determination can reliably operate in environments characterised by wide variations of exogenous conditions.

In practice systems with parameter determination require considerable time to find an optimum tuning, i.e. time necessary for self-tuning in such systems is bounded from below. Self-tuning systems without parameter determination do not have this disadvantage. In such systems, some characteristic of control quality is used (e.g., the first time derivative of a controlled parameter). Automatic tuning makes sure that this characteristic is kept within given bounds. Different self-tuning systems without parameter determination exist that are based on controlling transitional processes, frequency characteristics, etc. All of those are examples of closed-circuit self-tuning systems, whereby parameters are automatically corrected every time the quality characteristic value falls outside the allowable bounds. In contrast, open-circuit self-tuning systems are systems with para-metrical compensation, whereby input signal itself is controlled and system parameters are changed according to a specified procedure. This type of self-tuning can be close to instantaneous. However, in order to realise such self-tuning one needs to control the environment in which the system operates and a good enough understanding of how the environment influences the controlled system is required.

In practice self-tuning is done through the use of specialised hardware or adaptive software algorithms. Giving software the ability to self-tune (adapt):

1. Facilitates controlling critical processes of systems;
2. Approaches optimum operation regimes;
3. Facilitates design unification of control systems;
4. Shortens the lead times of system testing and tuning;
5. Lowers the criticality of technological requirements on control systems by making the systems more robust;
6. Saves personnel time for system tuning.

Metaheuristics

This section is an excerpt from List of metaphor-based metaheuristics § Self-tuning metaheuristics.[edit]

Self-tuning metaheuristics have emerged as a significant advancement in the field of optimization algorithms in recent years, since fine tuning can be a very long and difficult process. These algorithms differentiate themselves by their ability to autonomously adjust their parameters in response to the problem at hand, enhancing efficiency and solution quality. This self-tuning capability is particularly important in complex optimization scenarios where traditional methods may struggle due to rigid parameter settings. In this attempt, a PSO variant has already been introduced that adopts fuzzy logic to automatically calculate the parameters of each particle as well as the Flying fox optimization which is a fuzzy self tuning optimizer.

The advent of self-tuning variants in metaheuristics, marks a pivotal shift towards more autonomous optimization tools. These self-tuning algorithms significantly reduce the need for expert intervention in parameter tuning, a process requiring extensive domain knowledge. By leveraging fuzzy logic and other adaptive mechanisms, these algorithms can intelligently adjust their parameters in response to the problem's characteristics and search space dynamics. This autonomy not only simplifies the optimization process but also broadens the applicability of these algorithms, making them more accessible and effective for a wider range of users and complex problems. The ability of these self-tuning metaheuristics to perform effectively without perfect tuning by the user represents a considerable advancement in making optimization more user-friendly and efficient.

External links

• Using Probabilistic Reasoning to Automate Software Tuning
• Frigo, M. and Johnson, S. G., "The design and implementation of FFTW3", Proceedings of the IEEE, 93(2), February 2005, 216 - 231. doi:10.1109/JPROC.2004.840301.
• Optimizing Matrix Multiply using PHiPAC: a Portable, High-Performance, ANSI C Coding Methodology
• Faster than a Speeding Algorithm
• Rethinking Database System Architecture: Towards a Self-tuning RISC-style Database System
• Self-Tuning Systems Software
• Microsoft Research Adds Data Mining and Self-tuning Technology to SQL Server 2000
• A Comparison of TCP Automatic Tuning Techniques for Distributed Computing
• Tunables library for Linux
• A Review of Relay Auto-tuning Methods for the Tuning of PID-type Controllers