The Sequence Scope: Closing the Gap Between Deep Learning Software and Hardware
Weekly newsletter that discusses impactful ML research papers, cool tech releases, the money in AI, and real-life implementations.
The Sequence Scope is a summary of the most important published research papers, released technology and startup news in the AI ecosystem in the last week. This compendium is part of TheSequence newsletter. Data scientists, scholars, and developers from Microsoft Research, Intel Corporation, Linux Foundation AI, Google, Lockheed Martin, Cardiff University, Mellon College of Science, Warsaw University of Technology, Universitat Politècnica de València and other companies and universities are already subscribed to TheSequence.
TheSequence explains the main machine learning concepts and keeps you up-to-date with the most relevant projects and…
📝 Editorial: Closing the Gap Between Deep Learning Software and Hardware
The topic of artificial intelligence(AI)-first hardware continues to gain prominence within the deep learning community. These days, it proves to be challenging to write high-performance deep learning models without optimizing for the underlying infrastructure. Specific TensorFlow or PyTorch programs can look very different when executing in different hardware architectures, such as Google TPUs or NVIDIA Jetson chips. This problem becomes worse as it’s highly fragmented across the increasing number of deep learning frameworks and the new ecosystem of specialized deep learning hardware. In general, deep learning seems to have brought back the times in which software development needed to be concerned with the underlying hardware, and those dependencies are increasing rather than decreasing.
Decoupling the dependencies between deep learning software and hardware is one of the existential challenges of the next decade of AI. The good news is that there are some very exciting projects trying to address this challenge. Just this week, AIOps startup OctoML raised a $28M series B to tackle this specific challenge. OctoML builds on top of the open-source Apache TVM machine learning compiler framework, which was designed to bridge the gap between deep learning frameworks and specialized hardware and accelerators. Efforts like OctoML/TVM are often ignored, but they are nothing but essential to continue making deep learning accessible to mainstream developers.
🔎 ML Research
Massively Parallel Graph Computations
Google Research published a paper proposing Adaptive Massively Parallel Computation (AMPC), a model that addresses some of the limitations of Map Reduce to allow the execution of graph algorithms at large scale ->read more on Google Research blog
AutoML for Time Series
IBM Research published a paper detailing the research behind Watson’s AutoAI Time Series ->read more on IBM Research blog
Transformers for Video Intelligence
Facebook AI Research (FAIR) published a paper unveiling TimeSformer, a transformer-based model for video analysis ->read more Facebook AI blog
🤖 Cool AI Tech Releases
Horovod + Ray
Uber published some insightful details about an architecture based on Horovod and Ray to run machine learning models at scale ->read more on Uber blog
💸 Money in AI
- Shield AI raised $90 million to accelerate its work on defense AI technologies. The startup aims to develop best-in-class AI capabilities for conflict zones. Shield AI believes autonomous systems will bolster overall safety in military-active regions.
- AI-enabled SaaS platform Optibus raised a $107 million Series C round. Optibus platform provides analytics for people and vehicles moving directions, navigation, scheduling, rostering, and other guidance.
- No-code AI solution for enterprises Noogata raised a $12 million seed round. The company created domain-dedicated libraries of building blocks that target the most common use cases where AI can have its greatest impact such as e-commerce, retail, customer service and others.
- Tomi AI raised their first $1 million round to enhance digital-marketing effectiveness with the help of AI. They integrate their models with first-party data and connect to ad platform APIs to explicitly boost digital campaign’s ROI.
- ML startup OctoML raised a $28 million Series B funding round. Built on Apache TVM, OctoML aims to accelerate model performance while enabling seamless deployment of models across any hardware platform, cloud provider, or edge device.
- AI patent intelligence company PatSnap raised $300 million in series E funding. The company leverages computer vision, NLP and other AI technology to provide their clients with competitive intelligence as well as patent insights needed to take their products from ideation to commercialization.
- Identity startup Socure raised $100 million in a Series D funding round. Its predictive analytics platform applies AI and ML techniques with trusted online/offline data intelligence from email, phone, address, IP, device, velocity, and the broader internet to verify identities in real-time.
- Global location intelligence startup SafeGraph raised $45 million in a Series B. It uses AI to create and maintain mobility datasets. SafeGraph customers gain access to not only location information, but spatial hierarchy metadata and place traffic data.
- Network-centric AI startup Torch.AI raised $30 million. Using ML models for optical character recognition, natural language processing, sentiment analysis, and more, Torch.AI’s Nexus platform connects disparate apps, systems, cloud services, and databases to enable high-speed data reconciliation and high-speed processing.
- AI-powered knowledge process automation startup DeepSee.ai raised a $22.6 million Series A funding round. Instead of widespread ‘robotic process automation’, the startup offers what they call ‘knowledge process automation’ (KPA). They built KPA to mine unstructured data, operationalize AI-powered insights, and automate results into real-time action for the enterprise.
- AI startup Sherpa raised an additional $8.5 million to their Series A round. Based on proprietary AI algorithms with conversational and predictive abilities, its digital assistant technology learns about the users and anticipates their needs before they ask.