推理 on Pengcheng's Bloghttps://pengchengneo.github.io/tags/%E6%8E%A8%E7%90%86/Recent content in 推理 on Pengcheng's BlogHugo -- gohugo.iozh-CN© 2026 PengchengFri, 20 Mar 2026 00:00:00 +0000SGLang-JAXhttps://pengchengneo.github.io/projects/sglang-jax/Fri, 20 Mar 2026 00:00:00 +0000https://pengchengneo.github.io/projects/sglang-jax/SGLang 的 JAX 后端实现，支持在 TPU 上运行高效推理。SGLang-JAX: An Open-Source Solution for Native TPU Inferencehttps://pengchengneo.github.io/posts/sglang-jax-tpu-inference/Wed, 29 Oct 2025 00:00:00 +0000https://pengchengneo.github.io/posts/sglang-jax-tpu-inference/SGLang-JAX 是基于 JAX 和 XLA 构建的开源推理引擎，支持 continuous batching 和 speculative decoding，在 TPU 上实现高效原生推理。