user avatar
The Gradient
@gradientpub
The Gradient cuts through the hype and the cynicism to provide accessible, sophisticated reporting on the latest AI research. sigmoid.social/@thegradient
Stanford, CA
Joined January 2018
Posts
  • Pinned
    user avatar
    Important announcement! Today we launch a new Twitter-like space for the AI community - Sigmoid Social. We hope to ensure the thriving AI Twitter community can live on by maintaining this Mastodon instance going forward. Join here:
  • user avatar
    Researcher @chaitjo describes how the popular Transformer architecture is actually a Graph Neural Network in disguise! This suggests many potential areas of research where NLP can learn from graphs! #nlp #graphs
  • user avatar
    The war between ML frameworks has raged on since the rebirth of deep learning. Who is winning? @cHHillee's data analysis shows clear trends: PyTorch is winning dramatically among researchers, while Tensorflow still dominates industry. #PyTorch #Tensorflow
  • user avatar
    Overhyped claims about AI have contributed to past AI winters. @GaryMarcus fears that we could be headed down that same path again.  Here's what we can do to stop it. #ai #hype
  • user avatar
    Evaluation metrics are crucial to progress in machine learning. In light of recent interest in transfer learning in NLP, @chipro gives a comprehensive overview of some of the most important evaluation metrics in language modeling. #NLProc
  • user avatar
    Graph Neural Networks are one of the most important inventions in modern day machine learning. In our latest piece, Deepmind Oxford professor @mmbronstein gives his thoughts on the future of the field.
  • user avatar
    ImageNet is a mainstay of modern computer vision research. Can we build such a resource for natural language? As @seb_ruder observes, “The time is ripe for practical transfer learning to make inroads into NLP.”
  • user avatar
    "Deep learning has blown past its competition" but will it continue to scale towards increasingly difficult problems? @chenxi116 and Alan discuss what might lie ahead for visual deep learning.
  • user avatar
    On episode 6 of The Gradient podcast, we are excited to have interviewed Deep Learning pioneer @ylecun!🎙️🔊 We touch on his start on #AI research and some exciting recent work on Self-Supervised learning for vision from @FacebookAI. Take a listen:
  • user avatar
    Deep learning has made enormous strides in NLP, but state-of-the-art models are still spurious and brittle. @anmarasovic breaks down the problem and shares three ways we might solve it:
  • user avatar
    Network graphs, like social media, are rich with useful insights. So why is this information often ignored when applying machine learning? "The answer, for the most part, is that it’s notoriously challenging to extract meaningful features from graphs."
  • user avatar
    “As my watercolor teacher used to say: let the medium do it. My sketch simply provides the foundation, and then I let the network do its thing.” Helena Sarin, an artist who works with GANs, reflects on her creative process:
  • user avatar
    Astounding progress in AI has led to speculation AI will cause explosive economic growth. @arjun_ramani3 and @zhengdongwang argue that such “transformative economic impact” from AI is much harder than at first glance.
  • user avatar
    Have you ever heard someone mention Gaussian Processes and not known what they were talking about? @YugeTen gives an intuitive overview of this important, but often underlooked method in ML. #ml