{"id":379,"date":"2021-07-12T00:00:00","date_gmt":"2021-07-12T00:00:00","guid":{"rendered":"https:\/\/tac.debuzzify.com\/?p=379"},"modified":"2023-06-27T06:30:13","modified_gmt":"2023-06-27T06:30:13","slug":"can-reinforcement-learning-save-whales-dying-from-ship-strikes","status":"publish","type":"post","link":"https:\/\/www.the-analytics.club\/can-reinforcement-learning-save-whales-dying-from-ship-strikes\/","title":{"rendered":"Can Reinforcement Learning Save Whales Dying From Ship Strikes?"},"content":{"rendered":"\n<blockquote class=\"wp-block-quote\">\n<p>AI could help to avoid another whale sinking to the bottom of the ocean.<\/p>\n<\/blockquote>\n\n\n\n\n\n<p>Thousands of whales die every year due to human activities. Besides commercial whaling, there is a spectrum of other ways we contribute to the loss of this magnificent animal. If we don\u2019t act promptly, we are in great danger of whipping this majestic mammal altogether.<\/p>\n\n\n\n<p>Climate change, pollution, bycatching, entanglement, and commercial whaling put a significant threat to the existence of these species. But there is another critical risk for whales&#8217; presence, which is the focus of this article.<\/p>\n\n\n\n<p>Ship strikes.<\/p>\n\n\n\n<p>According to the <a href=\"https:\/\/iwc.int\/ship-strikes\" target=\"_blank\" rel=\"noopener\">International whaling commission<\/a>, there were about 1,200 whales killed between 2007 and 2016. Yet, many experts claim that there could be thousands killed every year.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Why Thousands of Whales Die Every Year\" width=\"720\" height=\"405\" src=\"https:\/\/www.youtube.com\/embed\/skVKgSbve9I?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>Whales haven\u2019t evolved to recognize the approaching vessel traffic. I guess no marine animal has. Also, today\u2019s gigantic commercial vessels can not be stopped with sudden breaks.<\/p>\n\n\n\n<p>Because whales sink to the bottom of the ocean when they die, most deaths go unreported.<\/p>\n\n\n\n<p>But there is hope. Scientists and humanitarians have taken action to reverse the losses. Their contribution is phenomenal. Now it\u2019s our turn. <a href=\"https:\/\/www.the-analytics.club\/welcome-to-the-age-of-citizen-data-scientists\/\" title=\"Welcome to the Age of Citizen Data Scientists\">Data scientists like you and me<\/a> should play a vital role in conserving whales and other animals on this planet.<\/p>\n\n\n\n<p>I\u2019m writing this with a bit of hope that our suggestions could help a whale live its life to its entirety. If this is already happening, that\u2019s great; share it with us in the comments. If not, help this article reach out to the right people.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">How Technology Help saving whale population<\/h2>\n\n\n\n<p>A trivial solution is imposing a narrow traffic scheme. This method has been proven effective in many regions, including the Gulf of Panama.<\/p>\n\n\n\n<p>The Gulf of Panama is home to thousands of humpback whales. A <a href=\"https:\/\/www.bbc.com\/news\/science-environment-18720380\" target=\"_blank\" rel=\"noopener\">narrow shipping line scheme<\/a> reduces the probability that a whale crosses vessel routes. Recent <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0308597X20302049\" target=\"_blank\" rel=\"noopener\">studies<\/a> show that this technique has diminished whale deaths significantly.<\/p>\n\n\n\n<p>Another straightforward way is to impose a <a href=\"https:\/\/www.fisheries.noaa.gov\/national\/endangered-species-conservation\/reducing-vessel-strikes-north-atlantic-right-whales\" target=\"_blank\" rel=\"noopener\">speed limit on vessels<\/a>. This procedure mitigates the risks of collisions and reduces the damage when they occur.<\/p>\n\n\n\n<p>Yet, both of these methods aren\u2019t workable options in the open water. Most sea territories are still unprotected with little or no protocols.<\/p>\n\n\n\n<p>The scientific community also has employed a range of AI-powered techniques. Here are some.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><b>Google AI and National Oceanic and Atmospheric Administration (NOAA) on real-time orca detection.<\/b><\/h4>\n\n\n\n<p><a href=\"https:\/\/venturebeat.com\/2020\/01\/28\/googles-ai-powers-real-time-orca-tracking-in-vancouver-bay\/\" target=\"_blank\" rel=\"noopener\">Google AI<\/a> created a model for detecting an endangered species of killer whales. It uses dozens of underwater microphones to detect orcas\u2019 presence and alert officials.<\/p>\n\n\n\n<p>Google trained the models with 1,800 hours of underwater audio recordings with 68,000 labels. It also conducts further studies to expand this to other kinds of whales and associate the sound signals with orca\u2019s health conditions.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><b>Project CETI by the government of Dominica and the national geographic society.<\/b><\/h4>\n\n\n\n<p><a href=\"https:\/\/www.seas.harvard.edu\/news\/2021\/04\/talking-whales\" target=\"_blank\" rel=\"noopener\">CETI<\/a> is determined to deploy dozens of devices over the next five years. These devices could help us listen, interpret, and communicate back with sperm whales.<\/p>\n\n\n\n<p>According to CETI, this is also the <a href=\"https:\/\/nerdist.com\/article\/project-ceti-ai-driven-effort-communicate-whales\/\" target=\"_blank\" rel=\"noopener\">largest interspecies communication project<\/a> ever.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><b>CNN to recognize Humpback whale songs.<\/b><\/h4>\n\n\n\n<p>Another Google-NOAA collaborated project aims to recognize <a href=\"https:\/\/www.ncei.noaa.gov\/news\/using-ai-listen-and-learn-about-humpback-whales\" target=\"_blank\" rel=\"noopener\">humpback whale songs<\/a>. They used 187,000 hours of acoustic data to train the convolutional neural network. These deep neural networks distinguish between different themes using their frequency and patterns.<\/p>\n\n\n\n<p>Analysis of this study showed drastic reductions in humpback whales in the Hawaiian region.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><b>Canadian government\u2019s right-whale detection.<\/b><\/h4>\n\n\n\n<p>This project uses computer vision to detect whales from aerial drone imagery. The project is aimed at protecting North Atlantic right whales from ship strikes.<\/p>\n\n\n\n<p>This team has proven that deep learning can be used in the detection and classification of whales. They are also looking forward to scaling it up into more locations.<\/p>\n\n\n\n<p>These efforts clearly show that we can have two-way communication with whales. If we could communicate, we could also drive them to a safe zone. That\u2019s the key that caught my attention towards reinforcement learning.<\/p>\n\n\n\n<p>To me, these individual researches seem like pieces of a giant puzzle. Reinforcement Learning could connect the unique components and may solve the riddle.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What is reinforcement learning?<\/h2>\n\n\n\n<p>In simple terms, reinforcement learning (RL) trains an agent to solve a complex problem by rewarding them for correct actions.<\/p>\n\n\n\n<p>To understand it better, you could think of the agent as a child learning to swim. The child gets an instant reward for every action it performs in the pool. Gradually, the child knows what she needs to do to stay afloat, move forward, and breathe. Every time it drowns, the child learns what not to do. That\u2019s learning to solve a problem by constantly interacting with the environment.<\/p>\n\n\n\n<p>Yes, it\u2019s a trial-and-error technique to solve complex problems.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"720\" height=\"405\" src=\"https:\/\/www.the-analytics.club\/wp-content\/uploads\/2023\/06\/image-104.png\" alt=\"What is reinforcement learning\" class=\"wp-image-978\" title=\"\" srcset=\"https:\/\/www.the-analytics.club\/wp-content\/uploads\/2023\/06\/image-104.png 720w, https:\/\/www.the-analytics.club\/wp-content\/uploads\/2023\/06\/image-104-300x169.png 300w\" sizes=\"(max-width: 720px) 100vw, 720px\" \/><\/figure><\/div>\n\n\n<p>In RL, the agent interacts with the environment by taking various actions. As a consequence, the state of the agent changes. These actions may or may not move the agent toward its goals. When it does, that\u2019s the reward the agent gets. The agent\u2019s primary objective is to maximize its total reward. But it needs to figure it out by exploring different alternatives.<\/p>\n\n\n\n<p>RL differs from both supervised and unsupervised learning. The system needs to interact with the environment to collect data and train itself. Yet, it tries to find a generalized set of actions to solve the problem.<\/p>\n\n\n\n<p>Recent success stories of <a href=\"https:\/\/openai.com\/blog\/openai-five\/\" target=\"_blank\" rel=\"noopener\">OpenAI<\/a> and <a href=\"https:\/\/bdtechtalks.com\/2016\/12\/23\/artificial-intelligence-machine-learning-deep-learning-2016\/\" target=\"_blank\" rel=\"noopener\">Deempmind\u2019s AlphaGo AI<\/a> made RL a hot topic. A team of five artificial neural networks, named Open AI Five, defeated human players at Dota 2. It uses RL to teach itself how to play the game. Every day, neural networks train themselves with some 180 years worth of games.<\/p>\n\n\n\n<p>A fascinating point about RL is that its solutions are sometimes creative. Open AI, when playing Dota 2, occasionally <a href=\"https:\/\/www.theverge.com\/2018\/6\/25\/17492918\/openai-dota-2-bot-ai-five-5v5-matches\" target=\"_blank\" rel=\"noopener\">sacrifices<\/a> its team members to win the game. Although winning as a team is the chief goal, humans rarely take such ego-free strategies.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">How could reinforcement learning stop whale-vessel collisions?<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/www.the-analytics.club\/wp-content\/uploads\/2023\/06\/1_9zoxPOuQo2gRNMLLKhzRsA-1024x576.gif\" alt=\"How could reinforcement learning stop whale-vessel collisions\" class=\"wp-image-979\" title=\"\" srcset=\"https:\/\/www.the-analytics.club\/wp-content\/uploads\/2023\/06\/1_9zoxPOuQo2gRNMLLKhzRsA-1024x576.gif 1024w, https:\/\/www.the-analytics.club\/wp-content\/uploads\/2023\/06\/1_9zoxPOuQo2gRNMLLKhzRsA-300x169.gif 300w, https:\/\/www.the-analytics.club\/wp-content\/uploads\/2023\/06\/1_9zoxPOuQo2gRNMLLKhzRsA-768x432.gif 768w, https:\/\/www.the-analytics.club\/wp-content\/uploads\/2023\/06\/1_9zoxPOuQo2gRNMLLKhzRsA-800x450.gif 800w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>&nbsp;<\/p>\n\n\n\n<p>This idea is not a tested hypothesis but one that\u2019s worth discussing.<\/p>\n\n\n\n<p>If whales respond to sonar signals, we can use it to send them warning signals as well. But we don\u2019t know which frequency they would consider as potential threats. And there could be sound patterns as well. This is where RL comes for help.<\/p>\n\n\n\n<p>A tiny device at the tip of the ship\u2019s bow receives and sends sonar signals as our agent. Every time it sends an alert to the ocean, it may attract or chase away whales. The distance between the whales and the ship is the state of the agent. If the sonar detects any whales, that\u2019s a punishment to the agent; in other words, a negative reward.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"720\" height=\"405\" src=\"https:\/\/www.the-analytics.club\/wp-content\/uploads\/2023\/06\/image-105.png\" alt=\"Detecting and warning whales in the open water\" class=\"wp-image-980\" title=\"\" srcset=\"https:\/\/www.the-analytics.club\/wp-content\/uploads\/2023\/06\/image-105.png 720w, https:\/\/www.the-analytics.club\/wp-content\/uploads\/2023\/06\/image-105-300x169.png 300w\" sizes=\"(max-width: 720px) 100vw, 720px\" \/><\/figure><\/div>\n\n\n<p>The agent\u2019s primary goal is to maximize the total reward. In this whale warning case, it\u2019s to chase away any whales in the path. Like Open AI being creative in Dota, the agent could be inventive in chasing whales. Who knows, the agent may gather all whales with one type of signal and then warn them all at once with a different kind.<\/p>\n\n\n\n<p>Studies have proved that <a href=\"https:\/\/www.scientificamerican.com\/article\/whales-monitoring-thermal-acoustic-ship-strikes-sonar\/\" target=\"_blank\" rel=\"noopener\">whales follow sonars<\/a>. This sometimes even causes whales to beach themselves on the shore. The agent could change different frequencies and patterns to communicate with whales. For example, a long beep of 233kHz followed by two clicks may mean something to whales. We don\u2019t know what it is. The agent doesn\u2019t know it either. But the agent\u2019s job is to find out if it chases the whales out of the path.<\/p>\n\n\n\n<p>In addition to the apparent \u201csaving whales\u201d advantage, this could be an excellent solution for many reasons.<\/p>\n\n\n\n<ol>\n<li><b>Sailors don\u2019t have manual duty.<\/b><br>When AI is employed in signaling whales to move out of their path, there is no manual effort involved. Also, because RL could adjust its signaling frequency, no hand-operated business was left for the sailors.<\/li>\n\n\n\n<li><b>Ships don\u2019t have to change paths or slow down too much.<\/b><br>Rules alone don\u2019t work well on the open seas. Existing solutions demand route changes that cargo lines may perceive as uneconomical. Hence there is no guarantee the protocols will be followed correctly.<\/li>\n\n\n\n<li><b>Nobody wants to kill whales for fun; sailors do neither.<\/b><br>Even commercial whalers (Sorry to mention this disturbing act multiple times) may not like killing whales for sport.<\/li>\n<\/ol>\n\n\n\n<p>The solution may sound straightforward. But as with any research, this has a bunch of complications we need to address.<\/p>\n\n\n\n<ol>\n<li><strong>Can a sonar device produce the right frequency to drive whales out of their path?<\/strong><br>There is a hypothesis that says whales follow the sonar signals of ships. But we lack research evidence to prove this. We don\u2019t know which sonar frequency that whales follow and which ones they try to avoid.<\/li>\n\n\n\n<li><strong>What is the long-term impact on whales and other sea animals?<\/strong><br>Some research suggests that <a href=\"https:\/\/www.wildlife.state.nm.us\/download\/conservation\/habitat-handbook\/project-guidelines\/Communication-Tower-Project-Guidelines-USFWS.pdf\" target=\"_blank\" rel=\"noopener\">mobile phone signals cause severe damage to birds&#8217; routines and their health<\/a>. Will our proposed solution leave any permanent trauma on these innocent animals? Are we causing more harm than good?<\/li>\n\n\n\n<li><strong>Could the device\u2019s signal is noticeable along with the noisy engines of the vessels?<\/strong><br>The <a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7141673\/\" target=\"_blank\" rel=\"noopener\">noise of commercial vessels<\/a> could be as high as 110 decibels. This much sound is enough to cause permanent hearing loss in humans. Could the whales pick the sonar amid colossal noise?<\/li>\n\n\n\n<li><strong>Is it ethical?<\/strong><br>No, it\u2019s not. The definition of ethics differs from person to person. As an animal lover, my proposal seems unethical. We shouldn\u2019t cross a whale&#8217;s path. But the international trade doesn&#8217;t seem to slow down. On this front, we have no other options.<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\">Final thoughts<\/h2>\n\n\n\n<p>Whales are magnificent sea mammals that lived on this earth for millions of years. But due to human activities, it\u2019s in the blink of extinction. When a species disappears in the food chain, it leads other animals to demise.<\/p>\n\n\n\n<p>But scientists and environmentalists are making progress in combatting the phenomena. Like in any other arena, AI plays a crucial role in the conservation of whales as well.<\/p>\n\n\n\n<p>Ship strikes are a terrifying cause that claims many whale lives. We discussed some of the ways data science helps avoid this. And we\u2019ve addressed a solution of using reinforcement learning to stop whales from crossing a vessel\u2019s path.<\/p>\n\n\n\n<p>This abstract idea is far from perfect. But everything needs to start somewhere. Perhaps, it\u2019s here. Please share your thoughts and constructively criticize in the comments.<\/p>\n\n\n\n<p>Thanks for spreading the good words. It could save a whale.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-dots\"\/>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>Thanks for the read, friend. It seems you and I have lots of common interests. Say Hi to me on <a href=\"https:\/\/www.linkedin.com\/in\/thuwarakesh\/\" target=\"_blank\" rel=\"nofollow noopener\"><strong>LinkedIn<\/strong><\/a>, <a href=\"https:\/\/twitter.com\/Thuwarakesh\" target=\"_blank\" rel=\"nofollow noopener\"><strong>Twitter<\/strong><\/a>, and <a href=\"https:\/\/thuwarakesh.medium.com\/subscribe\" target=\"_blank\" rel=\"nofollow noopener\"><strong>Medium<\/strong><\/a>. <\/p>\n\n\n\n<p>Not a Medium member yet? Please use this link to <a href=\"https:\/\/thuwarakesh.medium.com\/membership\" target=\"_blank\" rel=\"nofollow noopener\"><strong>become a member<\/strong><\/a> because I earn a commission for referring at no extra cost for you.<\/p>\n<\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>Thousands of whales die every year due to human activities. Besides commercial whaling, there is a spectrum of other ways we contribute to the loss of this magnificent animal. If we don\u2019t act.<\/p>\n","protected":false},"author":2,"featured_media":58,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kad_blocks_custom_css":"","_kad_blocks_head_custom_js":"","_kad_blocks_body_custom_js":"","_kad_blocks_footer_custom_js":"","_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"footnotes":""},"categories":[10],"tags":[],"taxonomy_info":{"category":[{"value":10,"label":"Strategy"}]},"featured_image_src_large":["https:\/\/www.the-analytics.club\/wp-content\/uploads\/2023\/06\/can-reinforcement-learning-save-whales-dying-from-ship-strikes-1024x576.jpg",1024,576,true],"author_info":{"display_name":"Thuwarakesh","author_link":"https:\/\/www.the-analytics.club\/author\/thuwarakesh\/"},"comment_info":0,"category_info":[{"term_id":10,"name":"Strategy","slug":"opinion-strategy","term_group":0,"term_taxonomy_id":10,"taxonomy":"category","description":"","parent":0,"count":32,"filter":"raw","cat_ID":10,"category_count":32,"category_description":"","cat_name":"Strategy","category_nicename":"opinion-strategy","category_parent":0}],"tag_info":false,"_links":{"self":[{"href":"https:\/\/www.the-analytics.club\/wp-json\/wp\/v2\/posts\/379"}],"collection":[{"href":"https:\/\/www.the-analytics.club\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.the-analytics.club\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.the-analytics.club\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.the-analytics.club\/wp-json\/wp\/v2\/comments?post=379"}],"version-history":[{"count":3,"href":"https:\/\/www.the-analytics.club\/wp-json\/wp\/v2\/posts\/379\/revisions"}],"predecessor-version":[{"id":1308,"href":"https:\/\/www.the-analytics.club\/wp-json\/wp\/v2\/posts\/379\/revisions\/1308"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.the-analytics.club\/wp-json\/wp\/v2\/media\/58"}],"wp:attachment":[{"href":"https:\/\/www.the-analytics.club\/wp-json\/wp\/v2\/media?parent=379"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.the-analytics.club\/wp-json\/wp\/v2\/categories?post=379"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.the-analytics.club\/wp-json\/wp\/v2\/tags?post=379"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}