UAV Swarm Technology

For the 2016 Holiday Season Disney, partnered with Intel, launched a new entertainment show. That show was a swarm of 300 Intel Unmanned Aerial Vehicle’s (UAV’s) connected together by a wireless link. For many, this may have been the first time they had heard of or witnesses the swarming capability of UAVs or even the first time they had watched a UAV in action. The technology behind these swarms is advanced algorithms and a suite of Command and Control systems programmed to fit the use or mission of the swarm. In Disney’s case, they wanted to show holiday type designs and had preprogrammed 3-D images of a dove, Christmas tree, star and other such objects to be portrayed in the night sky by the 300 UAV’s equipped with LED lights. This would have been a great show to see in person, whether you are a UAV hobby enthusiast, tech geek, or just like the lights and spectacle. How can this technology be put to a more practical or useful purpose toward serving the community or humanity, though?

First, we must define what swarm is. Swarm has several ways in which to define it relevant toward its purpose. When applied in warfare, an explanation is provided by Paul Scharre of the Center for a New American Security. He defined swarming as, “large numbers of dispersed individuals or small groups coordinating together and fighting as a coherent whole.” The Naval Postgraduate School's Timothy Chung defines swarm as, "In our context, swarming means a large collection of aerial robots working together to do something meaningful or interesting." However, it can most easily and generally be described with, “Swarm intelligence is the collective behavior of decentralized, self-organized systems, natural or artificial.” Swarm technology can be used by an operator in the loop controlling the swarm via a ground control station or the swarm can be launched with preprogrammed protocols and directives to control behavior and what actions are to be taken in accordance to what is encountered in their environment.

So far there are several studies being conducted and models tested of swarm flight. The U.S. and Chinese Governments have both been very interested in the emerging technology and its applications. However ethical questions have been raised over how exactly this swarm technology would be used and the degree of autonomy it would have. Lethal Autonomous Weapons Systems (LAWS) are in existence already and some have been employed for years, such as missile defense systems that target objects dependent on size, shape, speed, etc., without human interaction. Some organizations have called for a halt to production of these types of weapons systems. In July 2015, some of the world’s top artificial intelligence (AI) and robotics researchers released an open letter calling for “a ban on offensive autonomous weapons beyond meaningful human control.” There are certainly drastic implications toward the way a weaponized military swarm system could operate. There are however other potential arenas this technology could be used for benefit.

For civilian purposes the technology of swarming could be utilized in several of the ways I’ve previously discussed: Fire-fighting, search and rescue, hazard mitigation methods, agriculture, wildlife tracking/preservation. Each of these fields has already considered UAS application and what benefits, through greater precision and efficiency, could be garnered. With swarm technology, there is a great potential for advancing the amount and quality of data gathered and increased productivity. I believe the swarm technology coupled with interoperability is where the true potential lies. Swarm technology has the capability in aiding in search and rescue by increasing the effective sweeping pattern of the search and command/control as these devices will be linked and behave as one unit simultaneously. Firefighting can employ this swarm technology effectively by having multiple points of data gathering surrounding an entire fire as well as potential points of possible breakouts or monitoring firefighters on the ground to maintain contact and ensure the highest chance of success and survival. Hazard mitigation could include swarms to direct traffic ahead of an accident/construction or to help those leaving a natural disaster area. Utilized correctly swarms could direct people in a controlled way to leave the area before the event strikes and avoid further loss of life as in recent past or to direct survivors to rescue centers. In conjunction with other assets in use utilizing interoperability with manned systems, swarm technology has great potential to increase the effectiveness of many efforts.

Swarm technology is evolving and as many other technologies will continue to increase in its capacity to be applied to many different areas of industry. There are several applications for swarm technology civilian entities could use to drastically improve safety and efficiency. Combined with interoperability technology and techniques these methods could provide synergistic advancements in life-saving efforts, data gathering, and civil service.

Resources

http://www.tandfonline.com/doi/pdf/10.1080/00963402.2017.1290879

http://www.npr.org/sections/alltechconsidered/2015/07/23/424685529/follow-the-leader-drones-learn-to-behave-in-swarms

http://news.nationalgeographic.com/news/2013/12/131202-drone-uav-uas-amazon-octocopter-bezos-science-aircraft-unmanned-robot/

http://www.ibtimes.co.uk/disney-intel-launch-christmas-drone-light-shows-florida-disney-world-1592128

Unmanned Vehicle Interoperability

As we find more opportunities for the use of unmanned systems (US) across a wide spectrum of services and roles, the importance of interoperability will continue to grow right alongside the unmanned industry itself. “Interoperability is the ability of computer systems or software to exchange and make use of information”. For example, “interoperability between devices made by different manufacturers.”[1] Or the “ability of a system (such as a weapon) to work with or use parts or equipment of another system.”[2] Both of these definitions are important because unmanned systems not only contain programmable software which can be made to work with other systems but is also a physical device which can have interchangeable parts and payloads.

The future of unmanned systems includes the use of multiple devices or platforms in use simultaneously. Interoperability is essential as some platforms with specific uses will be paired in use with other platforms of differing manufacturers toward meeting the goal of performing and completing the same mission. If the systems in the team or package are made by different companies will the operator be able to swap cameras or other payloads? For ease of use they should. Most computers have USB and SD card inserts. This is a type of interoperability and makes it easier for those using multiple systems or changing to new systems able to transfer data and maintain the type of data storage they have.

One possible scenario and application of US I see is for wildlife tracking. Wildlife tracking is another tool scientists use for data analysis and many other  measurements and theories, such as climate change and effects of pollution or human behavior on one specific species or the environment. Having an airborne platform in an operation packaged  with an underwater system to provide data and share information would be very useful, but interoperability will be necessary. The ability to share information and data will be key but possibly interchanging payloads could be just as important. Operators using the devices from a control station aboard a vessel could deploy the units as necessary or the units may deploy themselves possibly dependent on parameters set by the operator who may be controlling those US from a boat nearby or from dry-land. For instance if a tagged animal were to come within a specified range then the underwater or aerial drone deploys and tracks that target to provide information on the animal or group of animals. These US could be housed and operated from buoys rigged with solar cells to recharge the systems and to extend the range and decrease the time to engage tracked animals saving time and resources while creating valuable data to scientists.

Another potential useful mode of interoperabilty with US is on highways. We have all been in traffic and have all had to deal with accidents or something that creates that traffic. UAS housed alongside the highway could, when necessary or when programmed to, deploy to determine traffic patterns or the reason for high traffic density. These UAS could relay this information to multiple sources including emergency services with incident data for more efficient responses. As well as personal devices to inform phone apps with the most update information for traffic avoidance. Scientists or civil engineers could also use the data gathered to better understand traffic patterns to create more efficient road way systems. The US involved in these types of operations would need to be interoperable though in order to speak to different types of systems that local/state governments or civilian sector scientists might use to analyze the data collected.

As the uses for Unmanned Systems and the industry grows interoperability will grow alongside it. Being able to use these systems with people in, on, and off the loop will be equally as important and will allow for greater utilization and efficient use of the technologies.

---

[1] Google Dictionary

[2] https://www.merriam-webster.com/dictionary/interoperability

Augmented Reality Applications

With Augmented Reality(AR) becoming more popular due to its increased applications and advancements in improving the technology Unmanned Aircraft Systems(UAS) have the potential to immediately integrate these systems to capitalize on a growing capability as well as market trend. Goldman Sachs estimates that by 2025 AR will have reached what the computer systems market share is at currently and is estimated to reach 85 billion in annual revenue by 2025. Including the market growth and expected increases in applications of UAS, the combination of the two technologies seems to be not only the intelligent idea financially but more importantly the ability improve efficiency in many fields and operations. 

Insitu, a subsidiary of Boeing, is already using AR technology incorporated with its Scan Eagle platform to assist Firefighters in assessing, maintaining situational awareness, and thus fighting wildfires to greater effect. The drones outfitted with AR/VR technology can send information back to the user via a 3-dimensional display as a hologram. Combined with thermal scanners and other sensors these UAS provide a real-time look at what the fire is doing. It allows for the user to see things that firefighters on the ground using the naked eye cannot see and UAS operators using other sensors would still not be able to see. The ability to see where the fire is hottest, where it is spreading and where embers are traveling or landing can truly aid in the Forest Firefighters industry. Including this tool in their arsenal could also allow virtual mapping and waypoints to be displayed along with pertinent real-time information immediately from the UAS system and end user down to those fighting the fire directly on the ground. Those firefighters on the ground can see the AR data displayed via goggles, monoculars or HUDS. These technologies have the potential not only to save lives of those fighting the fires but also fleeing from them. As well as saving millions in property damage and materials to actually fight the fire by increasing the effectiveness of the resources that are used.

This is not the only application of AR for UAS. Field Service Technicians for Utility Companies, another extremely dangerous job, have the potential to effectively incorporate AR into their process and system to increase effectiveness and safety. Service Technicians could use UAS to fly parallel to utility lines, similar to the applications and techniques used by railroad companies for security and inspection, to assess for damages and repairs. These service requests could be noted with instructions and the necessary data for technicians via AR as well as having the benefit of ordering the part ahead of time so the service technician comes prepared to complete the job. This cuts costs associated with travel and hours spent on the job looking up work orders, lost paperwork, accessing information via laptop or direct cell communication. This saves the utility companies and the end users which is everyone who uses electricity/cable/internet.

Sources:

http://www.goldmansachs.com/our-thinking/pages/technology-driving-innovation-folder/virtual-and-augmented-reality/report.pdf

http://www.airspacemag.com/articles/drones-augment-reality-180961874/

http://arvrlist.com/augmented-reality-in-asset-repair-utilities/?gclid=EAIaIQobChMIiJvHjPux1gIVA61pCh3kpwVMEAMYAiAAEgIgNvD_BwE

Why I chose UAS

I have always been interested in flight. In elementary school, I was lucky enough to be taken flying in a small Cessna my grandfathers’ friend owned and lucky enough to hang out in the cockpit of a 747 with the pilots before airlines were forced to lock the cockpit door to prevent terrorist actions. Flight is incredible and the way technology is headed unmanned systems will continue to make leaps and bounds with their capabilities and applications. I chose to include unmanned aircraft systems (UAS) as my major because I think it will have a far-reaching impact on much of the worlds day to day lives and the way businesses and people become more efficient. As technology becomes more advanced I look forward to UAS having broader capabilities and being able to have more utility applications. With continuing my education I hope to learn more about how to build platforms and utilize the most up to date materials, concepts, and technology to create systems that have multiple functions and uses. Students in the Lewis University UAS Program take composite material fabrication courses and computer science courses. I would very much like to leverage this knowledge. For instance, in my last blog, I spoke about MARV or a multi asset/role vehicle that could be amphibious and airborne. This platform could assist in search and rescue or day to day inspections for cities in their analysis and upkeep of city infrastructure. With my interest in flight, I am also interested in business and have considered owning my own small business. A fabrication shop where I could manufacture MARV’s to be used in city planning or upkeep would be very helpful to society. I think taking this multi role concept and developing it could lead to meaningful contributions in several aspects of society. 

Hurricane Harvey

Unmanned System Applications

There are many drone hobby enthusiasts or even more knowledgeable Unmanned Aircraft Systems operators who may want to see the landscape for themselves or utilize their skill sets to help in the rescue efforts. Helping in rescue efforts is a commendable action yet at what point do some efforts hamper or directly interfere with organized government groups such as the U.S. Coast Guard or National Guard who are conducting helicopter or fixed wing flights for search and rescue. Quadcopters are a great tool and can be used in numerous ways especially if you include the different detection devices, such as thermal cameras.

One platform that has not been developed, that I know of, is a quadcopter that has submersible capabilities. This would assist in risk management in situations where there are other air assets that are being used in the vicinity for the physical rescue of individuals. Or on the flip side if there are boats being used in the area the UAS could be flown. This UAS, or what I would like to dub, Multi Asset/Role Vehicle (MARV), could fly when needed or to avoid water obstacles or perform searches from higher vantage points. Or could be waterborne, avoiding other airborne assets while performing limited search functions or other functions entirely.

Search and rescue is not just looking for individuals in includes having situational awareness. If a scout MARV could perform reconnaissance on possible waterways for Coast Guard boats to use this cold mitigate other risks. Ensuring waterways are clear of submerged obstacles or locating drowned victims.

As well, these vehicles could submerge to avoid floating obstacles or to inspect infrastructure. During large scale disasters such as Hurricane Harvey it is possible for bridges or other structures to receive significant damage. Though search and rescue efforts are of high priority MARV’s could potentially be used to locate or determine structural damage on key infrastructures, especially if they are on waterways in which search and rescue operations are intended to be on.

While the most beneficial search and rescue may be airborne operations for exploring large areas quickly there are times when it is safest to not have too much air traffic. It is in these situations and for the other capabilities which were pointed out that Unmanned Vehicles could potentially have an extremely significant role in search and rescue efforts.