I wouldn't call this a bug but more like asking for opinions; I observed that when editing block because LLM need to spit out the exact block that needs to be replaced, it caused a lot of wasted tokens while doing so.
However LLMs are also very bad at generating proper diff format due to they can't count correctly, so I don't have any alternatives to suggest. Do you know any methods for code replacement that is more accurate yet doesn't need to repeat tokens that need to be deleted?
I wouldn't call this a bug but more like asking for opinions; I observed that when editing block because LLM need to spit out the exact block that needs to be replaced, it caused a lot of wasted tokens while doing so.
However LLMs are also very bad at generating proper diff format due to they can't count correctly, so I don't have any alternatives to suggest. Do you know any methods for code replacement that is more accurate yet doesn't need to repeat tokens that need to be deleted?