In our last installment, we looked at how small and mid-sized enterprises and machine learning newbies could get started in using this exciting technology. It’s not as hard as it looks, and machine learning services are making it very accessible. Need another bit of encouragement? You won’t be far behind most in the field.
We may all be talking about neural networks, but “[t]he state of the practice is less futuristic,” opines TechCrunch. Most applications of machine learning, even among the tech leaders, are using the same algorithms and engineering tools from years ago. Regression analysis, decision trees, and similar methods are driving ad targeting, product recommendations, and search results ranking to a greater degree than sexy “deep learning” advancements.
What’s more, there are infrastructure issues yet to be solved. The majority of time devoted to machine learning is spent preparing and monitoring the learning tools. Building the AI is a relatively small part of the picture.
Unfortunately, preparing data is a hassle, and the “bigger” the data, the worse the problems. Using scripts to consolidate duplicates, normalize metrics, and so on, can involve days of manual labor for a single run.
Big data can also lead to big machine learning errors, so monitoring production models is essential. Again we reach an impasse: When moving into unsupervised machine learning, where the correct output isn’t known in advance, traditional testing and validation tools no longer work. So how is IT to determine if the model is making “good” predictions? Dashboards and program alerts fill the gap at the development level, and more capable and specific tools are finally being developed by a few innovators.
The point is that machine learning isn’t breaking any molds for rapid adoption. To the contrary, it’s experienced a slow rise. Neural networks joined the scientific literature in the 1930s, the math was completed by the 1990s, and it’s taken the intervening decades for computers to catch up.
The next obstacle will be developing end-to-end solutions, which will accelerate the transition from the rudimentary machine learning dominating business today to the more futuristic possibilities still mostly dormant in neural networking laboratories. How long such a transition will take is still up for debate.