Dispelling the Myths Around Automated Machine Learning
Machine learning continues to make great strides in optimizing data collection and analysis tools for use across a wide range of industries, but now a new strand is emerging: automated machine learning, or AutoML for short.
This promises to be less reliant on data scientists, who are in short supply because of their highly specialized skill set, and can be expensive to hire. However, there are a number of misconceptions about AutoML, the chief one being that it can do away with such data scientists altogether.
Machine learning is an extraordinarily powerful general purpose technology that has a staggering number of applications. It is therefore no wonder people are excited about an evolution of the technology known as auto machine learning.
To understand what AutoML can do, it is important to understand how standard machine learning works.
Machine learning involves several steps: first you need to collect the relevant data, and then clean it in order to learn what you want to learn from it. You then define the feature representation of your data, and put it into a model which is trained to optimize the accuracy in order to achieve your predefined goal. It is a complicated task that requires a lot of human involvement. And not just any human – to get the most from machine learning, you need a team of highly trained data scientists to create, apply and optimize the model, and to be involved at every stage.
The ultimate aim of AutoML is to automate every step in this process, increasing efficiency while reducing cost. If it worked perfectly, it could be used in many different applications in all sorts of industries, revolutionizing multiple sectors of society. This is why it is currently gaining so much attention.
Changing the Role of Data Scientists
However, like many emerging technologies, the reality is rather more complicated.
“How useful AutoML is really depends on the industry, the data type and the model classes involved,” says Min Sun, Chief AI Scientist at Appier. In terms of data collection and cleaning, digital marketing is one area that can benefit from AutoML, because data labels are naturally generated from customers interacting with companies’ marketing campaigns. Mature tools exist to clean those labels, to make sure they are not noisy or biased.
Other industries are less well-placed to benefit in data collection and cleaning, but suitable in automatic feature engineering. For example, self-driving cars need humans to help identify what is a pedestrian and what is a stop sign. Similarly, medical imaging tools require experienced doctors to help spot tumors. However, using neural networks to automatically construct features from raw images has already reduced many data scientists’ efforts.
However, Sun urges scientists not to naively apply AutoML. Regardless of what goal you are trying to achieve, AutoML will not replace human knowledge altogether. Rather, it will change the focus where that knowledge is applied.
“In marketing, you only automate the steps of the process that will be much more effective than if they were carried out by a human manually,” Sun says. “Typically these processes are repetitive or complicated with sufficient data support. In this way, humans can be freed from repetitive tasks and applied their knowledge in areas with less accumulated data.”
So, you cannot get rid of data scientists altogether. This approach that sees humans and machines working hand-in-hand has been termed Semi-AutoML by some. It gives a more realistic appraisal of what the process actually entails.
Weighing Up the Benefits and Costs
As long as companies are informed on what AutoML can do and how it works, they have a lot to gain by using it.
It can be more efficient, because it removes the need to have human experts in the loop, and machines can do this work much quicker than humans. Used in the right way, it can outperform humans too, as it minimizes the risk of human error.
As the processes are automated, it can also scale much more effectively than if the processes were done manually.
However, there are other factors to consider that are often overlooked. Namely, the cost.
The Holy Grail of AutoML is a neural architecture search – this will program an AI to search for the best neural network architecture to solve your given problem. Researchers have demonstrated it is possible to fully automate a neural architecture search (and outperform humans attempting the same task), but it takes an enormous amount of computational power – it could involve a dozen CPUs being trained for several days, for example, which is very expensive. So, any firm looking to leverage AutoML needs to use it smartly by weighing up the potential gain versus the financial cost and time spent.
While AutoML minimizes the risk of human error, it does not eliminate it altogether. AutoML will only optimize the metric you define, so if you define a metric in the wrong way, the model created will not solve your problem. This issue is not unique to AutoML – humans can make the same mistake with standard machine learning, but having humans in the loop can help to correct it, as they will spot that the model behavior is not correct. While removing humans from the process can have big gains in terms of efficiency, if done naively it can also cause more errors to creep in.
Putting It Into Practice
It is a tricky balance to strike. Companies need to weigh up the downsides of intense human involvement with the potential benefits, and decide what is best for their business model. Having a human in the loop at every stage of the process will mean your model will not scale, for example. But at the same time, automating the entire process while building each model will be too time-consuming. “We know that marketers cannot wait days before sending out a campaign, they need to strike in a timely fashion,” Sun says.
Often the best solution now is to leverage a data science platform that uses AutoML in certain areas (what is often called Semi-AutoML as described earlier). By automating certain steps, you can concentrate your computational power where gains in efficiency and reach are not compromised by a reduction in accuracy. This helps marketers tap into the power of AutoML but only where it is really beneficial to the business’ goals. Otherwise you are just using technology for technology’s sake.
AutoML has many benefits for enterprises, and especially for marketers, but only if used correctly. Only by taking a realistic look at how it works, what it involves and what it can do for your organization can you really leverage it to its full potential.
* Want to know whether you can leverage data and AutoML to better understand your customers, enable predictive analytics, and drive ROI? Discover AIXON, Appier’s data science platform. Got a question? We are here to help! Get in touch with our team today for an exclusive consultation.
WE ARE HERE TO HELP
YOU MIGHT ALSO LIKE
Fashion and beauty brands in Southeast Asia (SEA) are becoming heavily dependent on their online presence for revenue generation, driven by a unique mix of cultures, economic maturity and demographics in the region. While there are multiple ways to reach consumers in Southeast Asia, mobile is undeniably the top channel to engage them, as smartphone users account roughly 90 percent of the total internet users in the region, and they spend the most time on the mobile internet compared to the rest of the world. During a panel discussion at the recent FUTR conference in Singapore, Lorenzo Peracchione, Regional E-Commerce Director for SEA, Australia and New Zealand at Sephora, noted that 85 percent of the company’s web traffic in the region comes from mobile devices. To cater to a such diverse audience in an environment where trends are evolving fast, marketers must take advantage of the latest technology such as artificial intelligence (AI) to create unique experiences for customers who are just a click away from switching to another brand or service. Appier’s Chief Revenue Officer Fabrizio Caruso who was also on the panel said, “For marketers, maximum reach, an up-to-date understanding of your customers and what they are likely
Medical science has always been data rich. For centuries, scientists have collected data through experiments, longitudinal studies, research and even day-to-day activities such as taking case notes after meeting with a patient. However, the COVID-19 pandemic has seriously altered the game. While even the biggest medical research programs have dealt with hundreds of thousands of cases, the pandemic affects billions of people. With so much data from many different sources flying in, artificial intelligence, or AI, is being used to help combat this virus. Using AI to Make Data-Driven Decisions Data scientists have been primarily focused on four key issues when trying to interpret page sets of data: volume, velocity, variety and veracity. These ‘four Vs’ are a significant challenge. With COVID-19, data is coming in from all over the world, at different times, from many sources and from systems with varying degrees of certification and accuracy. In December 2019, an artificial intelligence platform called BlueDot, which scans data from hundreds of sources, detected a cluster of pneumonia-like illnesses in Wuhan, China. Today, almost everyone knows this was ground zero for the coronavirus pandemic. Without BlueDot, it may have taken weeks longer for the world to become aware of this
Artificial intelligence (AI) has enormous potential to help you grow a business. It has the power to automate tasks and tap into the power of big data, boosting innovation, insight and decision making. So how can your organization harness its power and reap its many rewards? By becoming an AI-driven enterprise, and putting AI at the heart of everything you do. If that sounds like a tall task, then read on, as we will explain exactly what it means, how you go about it, the challenges you will face and how to overcome them. Hey Siri, Build Me a Business Empire: What AI Can Do for Your Enterprise Most people might know AI from its consumer uses such as personal assistants like Apple’s Siri and Amazon’s Alexa. So how can the same technology help a business achieve its goals? In other words, what exactly is an AI-driven enterprise? “An AI-driven enterprise is one that continuously leverages data and AI techniques to grow and improve its business,” says Charles Ng, VP of AI Enterprise at Appier. “This requires a strong data infrastructure, a data-driven decision-making mindset and a willingness to experiment.” AI can help with practically all aspects of a business,