Dispersive flies optimisation

Dispersive flies optimisation (DFO) is a bare-bones swarm intelligence algorithm which is inspired by the swarming behaviour of flies hovering over food sources.^[1] DFO is a simple optimiser which works by iteratively trying to improve a candidate solution with regard to a numerical measure that is calculated by a fitness function. Each member of the population, a fly or an agent, holds a candidate solution whose suitability can be evaluated by their fitness value. Optimisation problems are often formulated as either minimisation or maximisation problems.

DFO ^[2] was introduced with the intention of analysing a simplified swarm intelligence algorithm with the fewest tunable parameters and components. In the first work on DFO, this algorithm was compared against a few other existing swarm intelligence techniques using error, efficiency and diversity measures. It is shown that despite the simplicity of the algorithm, which only uses agents’ position vectors at time t to generate the position vectors for time t + 1, it exhibits a competitive performance. Since its inception, DFO has been used in a variety of applications including medical imaging and image analysis as well as data mining and machine learning.

Algorithm

DFO bears many similarities with other existing continuous, population-based optimisers (e.g. particle swarm optimization and differential evolution). In that, the swarming behaviour of the individuals consists of two tightly connected mechanisms, one is the formation of the swarm and the other is its breaking or weakening. DFO works by facilitating the information exchange between the members of the population (the swarming flies). Each fly $\mathbf {x}$ represents a position in a d-dimensional search space: $\mathbf {x} =(x_{1},x_{2},\ldots ,x_{d})$ , and the fitness of each fly is calculated by the fitness function $f(\mathbf {x} )$ , which takes into account the flies' d dimensions: $f(\mathbf {x} )=f(x_{1},x_{2},\ldots ,x_{d})$ .

The pseudocode below represents one iteration of the algorithm:

for i = 1 : N flies
     $\mathbf {x_{i}} .{\text{fitness}}=f(\mathbf {x} _{i})$ 
end for i  
 $\mathbf {x} _{s}$  = arg min  ${\textstyle [f(\mathbf {x} _{i})],\;i\in \{1,\ldots ,N\}}$ 
for i = 1 : N and  $i\neq s$ 
    for d = 1 : D dimensions
        if  $U(0,1)<\Delta$ 
             $x_{id}^{t+1}=U(x_{\min ,d},x_{\max ,d})$ 
        else
             $x_{id}^{t+1}=x_{i_{nd}}^{t}+U(0,1)(x_{sd}^{t}-x_{id}^{t})$ 
        end if 
    end for d
end for i

In the algorithm above, $x_{id}^{t+1}$ represents fly $i$ at dimension $d$ and time $t+1$ ; $x_{i_{nd}}^{t}$ presents $x_{i}$ 's best neighbouring fly in ring topology (left or right, using flies indexes), at dimension $d$ and time $t$ ; and $x_{sd}^{t}$ is the swarm's best fly. Using this update equation, the swarm's population update depends on each fly's best neighbour (which is used as the focus $\mu$ , and the difference between the current fly and the best in swarm represents the spread of movement, $\sigma$ ).

Other than the population size $N$ , the only tunable parameter is the disturbance threshold $\Delta$ , which controls the dimension-wise restart in each fly vector. This mechanism is proposed to control the diversity of the swarm.

Other notable minimalist swarm algorithm is Bare bones particle swarms (BB-PSO),^[3] which is based on particle swarm optimisation, along with bare bones differential evolution (BBDE) ^[4] which is a hybrid of the bare bones particle swarm optimiser and differential evolution, aiming to reduce the number of parameters. Alhakbani in her PhD thesis^[5] covers many aspects of the algorithms including several DFO applications in feature selection as well as parameter tuning.

Applications

Some of the recent applications of DFO are listed below:

Optimising support vector machine kernel to classify imbalanced data ^[6]
Quantifying symmetrical complexity in computational aesthetics^[7]
Analysing computational autopoiesis and computational creativity^[8]
Identifying calcifications in medical images^[9]
Building non-identical organic structures for game's space development ^[10]
Deep Neuroevolution: Training Deep Neural Networks for False Alarm Detection in Intensive Care Units ^[11]
Identification of animation key points from 2D-medialness maps ^[12]

References

^ Downes, J. A. (January 1969). "The Swarming and Mating Flight of Diptera". Annual Review of Entomology. 14 (1): 271–298. doi:10.1146/annurev.en.14.010169.001415.
^ al-Rifaie, Mohammad Majid (2014). "Dispersive Flies Optimisation". Proceedings of the 2014 Federated Conference on Computer Science and Information Systems. Vol. 2. pp. 529–538. doi:10.15439/2014f142. ISBN 978-83-60810-58-3. S2CID 3032155.
^ Kennedy, J. (2003). "Bare bones particle swarms". Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706). pp. 80–87. doi:10.1109/SIS.2003.1202251. ISBN 978-0-7803-7914-5. S2CID 37185749.
^ Omran, Mahamed G.H.; Engelbrecht, Andries P.; Salman, Ayed (July 2009). "Bare bones differential evolution" (PDF). European Journal of Operational Research. 196 (1): 128–139. doi:10.1016/j.ejor.2008.02.035. hdl:2263/8794.
^ Alhakbani, Haya (2018). Handling Class Imbalance Using Swarm Intelligence Techniques, Hybrid Data and Algorithmic Level Solutions. London, UK: [PhD Thesis] Goldsmiths, University of London.
^ Alhakbani, H. A.; al-Rifaie, M. M. (2017). "Optimising SVM to classify imbalanced data using dispersive flies optimisation". Proceedings of the 2017 Federated Conference on Computer Science and Information Systems. Vol. 11. pp. 399–402. doi:10.15439/2017F91. ISBN 978-83-946253-7-5. S2CID 22345522.
^ al-Rifaie, Mohammad Majid; Ursyn, Anna; Zimmer, Robert; Javaheri Javid, Mohammad Ali (2017). "On Symmetry, Aesthetics and Quantifying Symmetrical Complexity". Computational Intelligence in Music, Sound, Art and Design. Lecture Notes in Computer Science. Vol. 10198. pp. 17–32. doi:10.1007/978-3-319-55750-2_2. ISBN 978-3-319-55749-6.
^ al-Rifaie, Mohammad Majid; Fol Leymarie, Frédéric; Latham, William; Bishop, Mark (2017). "Swarmic autopoiesis and computational creativity" (PDF). Connection Science. 29 (4): 276–294. Bibcode:2017ConSc..29..276A. doi:10.1080/09540091.2016.1274960. S2CID 5591506.
^ al-Rifaie, Mohammad Majid; Aber, Ahmed (2016). "Dispersive Flies Optimisation and Medical Imaging". Recent Advances in Computational Optimization (PDF). Studies in Computational Intelligence. Vol. 610. pp. 183–203. doi:10.1007/978-3-319-21133-6_11. ISBN 978-3-319-21132-9.
^ King, Michael; al-Rifaie, Mohammad Majid (2017). "Building simple non-identical organic structures with dispersive flies optimisation and a* path-finding". AISB 2017: Games and AI: 336–340.
^ Hooman, O. M. J.; al-Rifaie, M. M.; Nicolaou, M. A. (2018). "Deep Neuroevolution: Training Deep Neural Networks for False Alarm Detection in Intensive Care Units". 2018 26th European Signal Processing Conference (EUSIPCO) (PDF). pp. 1157–1161. doi:10.23919/EUSIPCO.2018.8552944. ISBN 978-9-0827-9701-5. S2CID 52825619.
^ Aparajeya, Prashant; Leymarie, Frederic Fol; al-Rifaie, Mohammad Majid (2019). "Swarm-Based Identification of Animation Key Points from 2D-medialness Maps" (PDF). Computational Intelligence in Music, Sound, Art and Design. Lecture Notes in Computer Science. Vol. 11453. Springer International Publishing. pp. 69–83. doi:10.1007/978-3-030-16667-0_5. ISBN 978-3-030-16666-3. S2CID 106406853.

[1] Downes, J. A. (January 1969). "The Swarming and Mating Flight of Diptera". Annual Review of Entomology. 14 (1): 271–298. doi:10.1146/annurev.en.14.010169.001415.

[2] -Rifaie, Mohammad Majid (2014). "Dispersive Flies Optimisation". Proceedings of the 2014 Federated Conference on Computer Science and Information Systems. Vol. 2. pp. 529–538. doi:10.15439/2014f142. ISBN 978-83-60810-58-3. S2CID 3032155.

[3] Kennedy, J. (2003). "Bare bones particle swarms". Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706). pp. 80–87. doi:10.1109/SIS.2003.1202251. ISBN 978-0-7803-7914-5. S2CID 37185749.

[4] Omran, Mahamed G.H.; Engelbrecht, Andries P.; Salman, Ayed (July 2009). "Bare bones differential evolution" (PDF). European Journal of Operational Research. 196 (1): 128–139. doi:10.1016/j.ejor.2008.02.035. hdl:2263/8794.

[5] Alhakbani, Haya (2018). Handling Class Imbalance Using Swarm Intelligence Techniques, Hybrid Data and Algorithmic Level Solutions. London, UK: [PhD Thesis] Goldsmiths, University of London.

[6] Alhakbani, H. A.; al-Rifaie, M. M. (2017). "Optimising SVM to classify imbalanced data using dispersive flies optimisation". Proceedings of the 2017 Federated Conference on Computer Science and Information Systems. Vol. 11. pp. 399–402. doi:10.15439/2017F91. ISBN 978-83-946253-7-5. S2CID 22345522.

[7] -Rifaie, Mohammad Majid; Ursyn, Anna; Zimmer, Robert; Javaheri Javid, Mohammad Ali (2017). "On Symmetry, Aesthetics and Quantifying Symmetrical Complexity". Computational Intelligence in Music, Sound, Art and Design. Lecture Notes in Computer Science. Vol. 10198. pp. 17–32. doi:10.1007/978-3-319-55750-2_2. ISBN 978-3-319-55749-6.

[8] -Rifaie, Mohammad Majid; Fol Leymarie, Frédéric; Latham, William; Bishop, Mark (2017). "Swarmic autopoiesis and computational creativity" (PDF). Connection Science. 29 (4): 276–294. Bibcode:2017ConSc..29..276A. doi:10.1080/09540091.2016.1274960. S2CID 5591506.

[9] -Rifaie, Mohammad Majid; Aber, Ahmed (2016). "Dispersive Flies Optimisation and Medical Imaging". Recent Advances in Computational Optimization (PDF). Studies in Computational Intelligence. Vol. 610. pp. 183–203. doi:10.1007/978-3-319-21133-6_11. ISBN 978-3-319-21132-9.

[10] King, Michael; al-Rifaie, Mohammad Majid (2017). "Building simple non-identical organic structures with dispersive flies optimisation and a* path-finding". AISB 2017: Games and AI: 336–340.

[11] Hooman, O. M. J.; al-Rifaie, M. M.; Nicolaou, M. A. (2018). "Deep Neuroevolution: Training Deep Neural Networks for False Alarm Detection in Intensive Care Units". 2018 26th European Signal Processing Conference (EUSIPCO) (PDF). pp. 1157–1161. doi:10.23919/EUSIPCO.2018.8552944. ISBN 978-9-0827-9701-5. S2CID 52825619.

[12] Aparajeya, Prashant; Leymarie, Frederic Fol; al-Rifaie, Mohammad Majid (2019). "Swarm-Based Identification of Animation Key Points from 2D-medialness Maps" (PDF). Computational Intelligence in Music, Sound, Art and Design. Lecture Notes in Computer Science. Vol. 11453. Springer International Publishing. pp. 69–83. doi:10.1007/978-3-030-16667-0_5. ISBN 978-3-030-16666-3. S2CID 106406853.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]