The batch method from ChatModels and all the Runnables does not really support the OpenAI batch API.
Observed in langchain-ai/langchain · Python · MIT
What the reporter described: Checked other resources [X] I added a very descriptive title to this issue. [X] I searched the LangChain documentation with the integrated search. [X] I used the GitHub search to find a similar question and didn't find it. [X] I am sure that this is a bug in LangChain rather than my code. [X] The bug is not resolved…
Related friction appears in 8 independent repositories. This is stronger than one backlog item, but still requires direct user validation.