From machine learning to digital twins, opportunities abound in emerging (and converging) tech trends
New and evolving technologies are rapidly reshaping how we work—offering creative opportunities for developers who are willing to pivot and adopt new skills. We took a look at 11 tech trends experts say are likely to disrupt current IT approaches and create demand for engineers with an eye on the future.
It isn’t all about The Next Big Thing. Future opportunities for developers are emerging from a confluence of cutting-edge technologies, such as AI, VR. augmented reality, IoT, and cloud technology … and, of course, dealing with the security issues that are evolving from these convergences.
If you’re interested in expanding your developer’s toolkit, check out these trending domains—and our tips on how to get ahead by getting started with them.
Internet of things security
After tens of millions of connected devices were hijacked last year, even casual observers could see that unprotected IoT devices create nightmarish security problems.
A recent report from research firm Gartner recommends developers and security teams work together early in the design process to make sure new threats can be addressed as they come up—for example, by providing the ability for IoT devices to download security updates.
Demand is high for engineers with IoT security skills, especially those who understand the vulnerabilities of the hardware and software used by net-connected devices.
“The attack vectors in IoT are largely identical to those of any other distributed network, like computers or cellphones, so the same security knowledge is relevant and critical,” says Richard Whitney, vice president of product at IoT startup Particle. “Study the foundations of crypto and authentication, and you’ll be well on your way.”
Tom Gonser, founder of DocuSign and a partner at Seven Peaks Ventures, says firms need skills in low-level programming for microprocessors. “They’ll also want RF experience with Bluetooth, [Windows Identity Foundation], and spread spectrum components. Leading-edge Linux security options, especially optimized for tiny kernels like Qubes OS, is also valuable.”
Matt Abrams, a partner at Seven Peaks Ventures with Gonser, suggests focusing on “understanding workflows and how to disrupt them. Postquantum computing cryptography is also coming faster than one might expect. They should also understand differential privacy and adversarial networks.”
As we prepare for the next wave of autonomous vehicles, robots, and smart electronics, the demand for AI-savvy engineers is exploding.
“We’re now at a tipping point in large part due to advances in ubiquitous computing, low-cost cloud services, and near unlimited storage,” says Nicola Morini-Bianzino, senior managing director and artificial intelligence lead at Accenture. “AI is being built into everything.”
Morini-Bianzino sees demand for “software engineers, technologists, and research scientists with language translation, speech recognition, computer vision, robotics, natural language processing, knowledge representation, and reasoning expertise. AI … feeds off data, so content and data curators, data scientists, and analytics experts are also crucial.”
Treasure Data’s VP of marketing Kiyoto Tamura envisions AI moving from very specific, mundane operations to much broader—and more exciting—applications.
“In the past, it was more like, ‘Find the optimal route for package delivery … or the most relevant websites for a search query.’ Now, we are starting to see, ‘Play a game of Go really well; drive a car safely,’ etc. All of this is cool, but humans still need to feed objective functions to the computer, and at least for now, this is going to be the case.”
Data scientists, machine learning researchers, and computational linguists are increasingly sought out, says MindMeld CEO Tim Tuttle. He cites a VentureScanner study that counted 910 AI companies emerging from March to October 2016, more than half of which focus on deep learning/machine learning and natural language processing.
“Not only do these categories win in numbers, but they’ve also received the most funding, to the tune of $4.5 billion,” Tuttle says. “With the recent explosion of interest in conversational applications, there has been a mismatch between supply and demand. As a result, subject-matter experts will remain a valuable commodity until academia and industry can rebalance the equation.”
A form of artificial intelligence, machine learning can take massive amounts of data to very quickly find patterns—like facial recognition—and solve problems, like recommending a movie to stream, without being explicitly programmed to do so.
“Cognitive technologies, aided by bots and machine learning, will start to add value as organizations strive to find the ‘signals in the noise,’” says Patrick Spedding, senior director of BI R&D for Rocket Software. “Machine learning is, after all, based on mature analytics capabilities—formerly known as ‘data mining’—which really have been waiting for a suitable platform to become more ‘consumable.’”
How should developers who want to expand into machine learning develop skills in this area?
Abrams, of Seven Peaks Ventures, points to a highly regarded online class: “Andrew Ng’s seminal course on machine learning on Coursera is a great example. Students who took his course via Coursera actually did better in Kaggle competitions than some longtime practitioners.”
Not every developer working in machine learning comes from a computer science background, though it’s helpful, says Solvvy CTO and co-founder Mehdi Samadi, who sees some Ph.D.s without CS degrees being recruited and trained to become machine learning engineers.
“Core contributions in the field of machine learning require running a lot of experiments using the real data, observing from the result of the model, and improving the model,” he says. “Having a CS degree or core engineering background usually would benefit the engineers to be more successful in their job in order to be able to continuously run experiments and improve machine learning models.”
Data science is another hot area, requiring multidisciplinary skills that vary by industry. Requirements can include experience with machine learning and AI to take large amounts of data and shape it in a form that can be used to make business decisions.
“Skilled data scientists are in short supply, period,” says Spedding. “Specifically, I see areas where technology can be designed to ‘assist’ decisions, such as cognitive bots and guided analytics, to be high value-add opportunity areas.”
A thorough understanding of probability and statistics is key for those who want to work in this area, says Gary Kazantsev, who heads up the machine learning group at Bloomberg. “Add in some engineering skills, as the need to be capable to write some code to build a system will never go away, though with the emergence of tools like TensorFlow or Jupyter notebooks, this too is getting a whole lot easier. They also need good research skills—that is, the ability to form a hypothesis and test it, read the current literature, and stay up to date.”
Gunter Ollmann, chief security officer at Vectra, says he currently sees firms treat data scientists separately from engineering and research and development teams. But he doesn’t think that approach will last.
“As the deep learning and machine learning tools improve, and boot camp training courses become more adept at bringing senior engineers up to speed in data science, the division between data science and engineering will disappear. All engineers need to be good at math. Now they need to also master the math of data science. The fusion of skill sets and ability to wield both hammers will be mandatory going forward.”
This means of creating a distributed ledger for transactions offers benefits in transparency and security, though a lack of standardization may slow its adoption across wide industries.
Peter Loop, associate vice president and principal technology architect at Infosys, is bullish on the technology: “Despite misconceptions that blockchain is years away, we’ll see full deployments in financial services, insurance, and health care industries next year. This will completely disrupt our payment systems on an international scale.”
Other emerging tech has a steeper learning curve, says Robert Bardunias, co-founder and chief revenue officer of IRIS.TV, who is excited by the inherent entrepreneurial focus of blockchain.
“These technologies are growing with real operational business applications in mind from day zero, so there’s no need on the development side to try to imagine case use—they are happening and growing in real time,” Bardunias says. “The real overwhelming challenge for those looking to develop skills in these areas will be how to keep up with new developments and evolutions. I remember when I was learning secondary development skills, reading industry trade websites—and magazines, it was a long time ago—were the last thing I wanted to do, but it’s a real part of today’s learning mix as a developer looking to build and maintain a competitive edge in the global market.”
Mesh app and service architecture (MASA)
Demand for apps that seamlessly stay connected as we move through our home, commute, and work are increasingly in demand.
“The purpose of a mesh network or app is that will it be high availability—everything connected to everything,” says Joseph Carson of Thycotic. “If the path is unavailable, it will find another device to establish the connection. We have seen this being used for example with the Tile tracker devices, which has created a community of tracking devices, and with bitcoin being a distributed ledger.”
But some see a lack of device compatibility as a potential bottleneck.
“Each vendor has their own way of trying to drive trust into this system, so they are all walled gardens, if they even exist at all,” says Derek Collison, formerly of Cloud Foundry and CEO of Apcera.
This technology promises a previously unthinkable level of connectedness—if a lack of standards doesn’t get in the way.
“My larger thought here is that AI will generally be trained in the cloud with massive amounts of data from all users,” says Collison. “These algorithms will then continuously update their execution model, which will be shipped to the edge over the air and update firmware on edge devices like our phones, cars, and home. The processing will happen at the edges in hardware; the training will happen in the cloud in software.”
Digital twins: Prepare to fail
Software models tied to physical and virtual sensors can help predict product or service failures so that organizations are able to plan and assign resources to make repairs before the failure occurs. Advances in machine learning and the adoption of IoT technology are helping to bring down costs for this sort of predictive “digital twin” modeling, which boosts efficiency and can bring down operating costs over the life of, say, a jet engine or a power plant.
Matias Woloski, CTO and co-founder of Auth0, says companies can also use digital twins in the concept and design stage, testing new products in simulations, then making changes until the engineers have the product they want. Findings from the digital twin are then used to build the product.
“A few organizations have already launched digital-twin initiatives, although the primary projects leveraging this technology are the ones with large upfront development expense where the cost of failure is too high,” Woloski says.
SpaceTime Insight’s CTO Paul Hofmann says digital twins benefit from machine learning, making them more effective than condition-based models at predicting failures.
“IoT and machine learning systems allow organizations to ensure that its assets aren’t randomly failing, and if they do fail, then organizations can optimize real-time decision making for the best long-term solution.“
Autonomous vehicles, robots, and appliances
New opportunities are seen developing as AI and machine learning smarten up home devices, industrial equipment, cars, and drones. Research firm Gartner estimates that by 2020, automakers will send 61 million data-connected cars off production lines.
“There are entire economies already cropping up in these areas,” says Vince Jeffs, director of strategy and product marketing at Pegasystems. “For example, there are AI startups—and more mature companies—already well-established in the autonomous vehicle space. For example, MobileEye is a company with about $500 million in VC backing that specializes in the little cameras all over the vehicle. Similarly, there are stores for physical robots—for example, SoftBank Robotics specializes in robots used in hotels for concierge. They have about $250 million in VC backing.”
Progress in deep learning has improved computer vision, language processing, and speech, as well as the ability for machines and software to seek a reward and maximize performance, says Wayne Thompson, chief data scientist at SAS: “As a result we will see a new generation of machines that can see the world, hear and read human languages, communicate to humans, and control themselves both mechanically and behaviorally, in an unprecedented way.”
Where some see automation as a job-stealing nightmare, others instead say the technology will lead to a bright, more humane future.
“I’m often asked about the impact of automation,” says Michael Hubbard, global vice president at ServiceNow. “Intelligent automation is a vast opportunity, not a threat. By working hand-in-hand with intelligent technology, we can achieve greater things. It frees us from mundane, repetitive activities—unleashing creativity and letting us build stronger, more productive working relationships. Intelligent automation makes us more human, not less.”
Virtual and augmented realities
After decades of hype, virtual reality and augmented reality finally seem to be having their moment. For those looking to develop products for these technologies, there are opportunities beyond creating isolated gaming experiences.
“While these technologies are not pervasive yet, they definitely have matured in the last few years,” says Anup Nair, VP and CTO of Mphasis Digital. “We see an increasing relevance of [virtual and augmented reality] in the product marketing and immersive selling arenas. The best use cases will come from distribution services [retail, consumer packaged goods, and hospitality], and for a lot of these areas, the surface has just started to be scratched. I think that in the biomedical and health care industries, AR/VR will be really advantageous for both education and communicating complex surgical procedures. We also see AR initiatives targeted toward performing deep analytics in social media command centers of large banks, and on trading floors providing traders infinite real estate for data analysis and collaboration.”
Christian Sasso, adjunct professor of the VR/AR Certificate program at San Jose-based Cogswell College, sees augmented reality as the most important tech trend of the year.
“AR can soon be used to deal with customer service for when an enterprise device needs repairing,” Sasso says. “For instance, a project I’ve been working on uses AR glasses to contact the customer service adviser when a television or monitor stops working. Directly talking to her through the AR interface, the representative can find the information she needs by simply looking at the broken screen, without any need to try and describe the problem over the phone, or go hunting for a serial number.”
The potential for AR and VR is dependent on distribution and won’t be prevalent until we see better, cheaper hardware, says Vishwa Ranjan, head of augmented and virtual reality at Infosys.
“In 2017 we’ll see smartphone companies develop AR- and VR-based features, like image-recognition-based, location-based, and sensor-based technologies, and 360 cameras that will help to push AR and VR out into early adopter’s hands.”
The next stage of AI could eliminate the clunky tools we now use to interact with the digital world. Importantly, these changes are also increasingly making their way into the office.
“The workplace of the future is integrating intelligent apps into the day-to-day workplace to enhance overall productivity. We’re seeing significant levels of automation in IT that are driving 40 to 50 percent productivity improvements,” says Steve Hall, a partner at research firm ISG. “With the broad movement of enterprise workloads to the public cloud and the integration of automation and intelligent applications, IT organizations are being reshaped.”
In the personal realm, Apcera’s Collison thinks we’ll soon use assistants to do more than order online or search the web: “It will be the tool that is an extension of our own brains. We will no longer need to retain information as much; we can be free to drive analytical and critical thinking using these tools as aids.”
What should you work on if you’re interested in developing this sort of assistive tech?
“In a word, the skills most in demand today are depth,” says Gunter Ollmann, chief security officer at Vectra. “An example is mastery of a category of information security (web app security, network forensics, malware disassembly). The superficial, book-read knowledge is increasingly encapsulated in off-the-shelf tools. The subject matter expertise that drives the improvement of those tools and exception handling are the skills most in demand.”
David Parmenter, director of engineering and data for Adobe Document Cloud, says a passion for math and logic—even more than a computer science degree—is key.
“Creativity, the drive to continually learn, customer-centric thinking, resilience in the face of failure—the nature of machine learning output is not a finished product—and strong communication skills are very important soft skills for engineers in this field.
And the winner is … convergence
While AI is probably the most frequently cited breakthrough technology of the year, the most important trend of 2017 may be the merging of emerging, disruptive technologies.
Maarten Ectors of Canonical name-checked a dozen disparate technologies that, when joined, are much more than the sum of their parts: “the cloud, mobile, IoT, artificial intelligence, blockchain, augmented reality, voice interfaces, software-defined radio, Industry 4.0 [automation and data exchange in manufacturing], robotics, edge computing, and autonomous driving.”
Rocket Software’s Spedding says the siloed technologies are converging partly because of a need for businesses to dig themselves out of their own data—for example, analyzing website traffic.
“Add to that the increasing proliferation of new data sources, such as IoT,” he says, “and we see challenges just to keep up with the volume of information available to support business decision-making.”
Spedding sees opportunities for a convergence of cognitive technology, bots, and machine language in making sense of it all. A new generation of digital natives will speed the adoption of these melding technologies, he says, because they expect ease of use, interfaces inspired by gaming, and everyday exposure to augmented and virtual reality.