If you haven’t spent any time reading about large language models (LLMs) like DTensor-LLM01, probably you didn’t know that it was “trained on 30 billion tokens.” But what does that actually mean? Let’s break it down—and throw in a helpful diagram to visualize things. 1. What Is a Token? At its core, a token is […]
Category Archives: Tech Blog
Latest News, Research Blog, Tech Blog
[DeepTensor.AI] MGLEP: Multi-Modal Data for Accurate Pandemic Forecasting and Analysis
22
Jul
Jul
Emerging pandemics pose a significant threat to global health, and accurate forecasting and analysis are essential for effective public health management and decision-making. Traditional approaches to pandemic forecasting primarily rely on epidemiological data, overlooking valuable sources of information that could act as sensors or indicators of pandemic patterns. In this paper, we propose a novel […]
25
Nov
Nov
Why Private AI? Private AI focuses on preserving user privacy in artificial intelligence applications. By utilizing techniques like federated learning and homomorphic encryption, it allows machine learning models to operate on encrypted, decentralized data. This ensures that sensitive information remains secure and confidential during the learning process. One typical approach is Microsoft SEAL (Simple Encrypted […]
03
Apr
Apr
Opinion A major new study from Pew Research has found US adults who predominantly get their political news from social media are less likely than other consumers to closely follow major news stories. But what is underpinning this? The study, which analysed surveys conducted between October 2019 and June 2020, argued that US adults who rely most […]