Jobs with llama.cpp

Preferred Networks

LLM Inference Optimization Engineer

Posted 1 month, 2 weeks ago

Preferred Networks is an AI company based in Tokyo working across the stack, from AI chips and computing infrastructure to LLMs and products. Preferred Networks is designing in-house chips (MN-Core series) and training LLMs (PLaMo series). We are actively hir…

Roles

LLM Inference Optimization Engineer MN-Core LLM Serving Engine Engineer

Tech stack

LLM Dynamo PLaMo DRAM MN-Core L series KV cache Rust Go vLLM SGLang CuPy Optuna C++ Hugging Face llama.cpp Chainer MN-Core L1000

Location

Tokyo, Remote in Japan

Work setup

full-time · Tokyo or Remote in Japan. Both roles require relocation to Japan and visa/relocation support is available.

Save