DeepSeek Elastic Compute (DSec)

(arxiv.org)

110 points | by shenli3514 4 hours ago

6 comments

  • yipinwong 35 minutes ago
    The topic isn't as interesting as how 131 authors communicated to get this out.
    • embedding-shape 23 minutes ago
      Is it possible they're doing a research lab "socialism style" and everyone gets equal credit for just being a part of the lab, regardless of actual input into the specific papers? If they're innovating in computer, maybe they're not so afraid of innovating in social/academic structures as well?
      • tonmoy 10 minutes ago
        This is common practice in Biology labs in the west I think
  • vblanco 2 hours ago
    380.000 concurrent sandboxes on 160 Epyc based server nodes. Crazy stuff
    • dangoodmanUT 1 hour ago
      that's only 12 sandboxes per core
      • aabhay 57 minutes ago
        Um, how is that not impressive
  • doc_ick 2 hours ago
    Will admit that I haven’t read it yet, just saw the crazy number of authors and think this may compete for one of the papers with the most authors.
    • justinnk 1 hour ago
      This one [0] about the Higgs boson is hard to beat. Pages 25-32 are just full of around 5150 „authors“, pages 33-37 are their affilliations.

      [0] https://arxiv.org/abs/1207.7214

      • tempay 1 hour ago
        Even without that particularly special case, high-energy physics collaborations have long since broken the idea of authors. There are now many collaborations with hundreds of authors publishing regularly and quite a few that are into the thousands.
        • mentalgear 28 minutes ago
          I like it, represents science's general 'standing on the shoulders of our precedents' far more realistic then the 'genius solo' PR mythos.
    • mendylanda 1 hour ago
      how do you even keep up with the amount of research coming out these days
  • Vaslo 58 minutes ago
    That number of authors though
  • redat00 1 hour ago
    So.. serverless ?
    • redat00 58 minutes ago
      Still very impressive! Love how it's done!
      • tipiirai 50 minutes ago
        Can you give a brief for what this is and why it is impressive?
        • redat00 15 minutes ago
          It just describes the platform they built for scheduling workloads, and running those workloads. After a second thought it is not that impressive and probably doesn't deserve any kind of hype. It's the same kind of setup AWS is running for Lambda, as well as anyone else basically running SLURM clusters out there.

          Still giving them credit because creating such as scheduler/platform from scratch is quite complex, and I know that they probably struggled a lot to get it right.

  • swingboy 3 hours ago
    Is there a lab more innovative than DeepSeek? Imagine if they had the same compute resources that Anthropic and OpenAI have.
    • ProphetOfParado 2 hours ago
      Food for thought: Constraints are the source of creativity.
      • conception 2 hours ago
        Yeah if they had the resources of an OpenAI or anthropic they’d be OpenAI or Anthropic. Scrappy underdogs have to be nimble and innovative.
        • mirekrusin 2 hours ago
          They are as “underdog” as Linux is to Windows.
          • ianm218 23 minutes ago
            Not really, they are underdogs in the true sense of the word.
      • rozim 2 hours ago
        Possibly relevant: 突破技术壁垒, "break the technical barricade" -> overcome an obstacle through innovation (in this case, sub SOTA GPUs at least).

        Native Chinese speakers to confirm....

        • michaellee8 2 hours ago
          your translation is correct, I would say Chinese labs may be able to figure out the current capability of latest frontier models in 3-6 months, but then Anthropic and OpenAI may have already been ASI in that time already. China's main problem is still lack of (good) chips, and that is a hardware issue that is unlikely to be solved for a while. and more effort for efficiency means less effort for actual capability improvements. we have already seen what anthropic can do if they focus on efficiency with opus 5.5
    • impulser_ 2 hours ago
      Short term they might have less compute, but long term they will most definitely have more compute. They don't have to worry about energy, they don't have to worry about people blocking them building data centers the only thing stopping them is there no Chinese manufacturer that can produce a chip as good as Nvidia but I would bet that solved in a year or so.
    • SmartestUnknown 2 hours ago
      Just because other companies don't write papers about what they do doesn't mean they aren't innovative...
      • broodbucket 55 minutes ago
        I'm actually the most innovative, I've written thousands of papers advancing the state of human knowledge. They're just in my basement and I don't show anyone.
      • doc_ick 2 hours ago
        Sure, but we’ll never know what they do or if it is innovate because we won’t know what they do.
    • ijidak 2 hours ago
      "Necessity is the mother of invention."

      Not sure they'd be the same without the constraints.