By combining anatomically accurate models, physical simulators, and artificial intelligence models trained based on real fruit fly behavior
@HHMIJanelia and @GoogleDeepMind
Scientists at 2000 have created a computerized insect that can walk and fly on complex trajectories like a real fruit fly.
Virtual fruit flies can also use their eyes to control and guide flight
Have realistic physical interactions!
The virtual fruit fly model demonstrates multiple capabilities by combining anatomically accurate models, fast physical simulators, and artificial neural networks trained based on real fruit fly behavior:
1. Walking and flight simulation: Being able to walk and fly on complex trajectories like real fruit flies.
2. Visual control and navigation: Use the virtual fruit fly’s “eyes” to control and guide its flight direction.
3. Highly realistic behavioral simulation: Through the trained neural network, simulate the behavioral patterns of real fruit flies, including walking at different speeds, turning and short stops.
Realistic physical interactions: Models can simulate the physical interactions between fruit flies and their environment, such as aerodynamic behavior and surface grips.
4. Conversion of high-level commands to low-level movements: The neural network can convert high-level commands (such as advancing at a specific speed) into low-level movements that fruit flies actually use.
Details:https://janelia.org/news/artificial-intelligence-brings-a-virtual-fly-to-life
Video: