How does it compare to other symbolic reasoning approaches? Could the llm just write sympy (python) code. What limitations did you think of when reading the papers? FYI. I didn't read the paper yet.
Writing code helps LLM to reason better. There are two approaches. First - use code in Prolog or Python for validating and inference; this includes running the code and sending the output back to the LLM. Second - use code and use LLM to interpret it as I mentioned here - https://shchegrikovich.substack.com/p/two-methods-and-prolog-to-increase
How does it compare to other symbolic reasoning approaches? Could the llm just write sympy (python) code. What limitations did you think of when reading the papers? FYI. I didn't read the paper yet.
Writing code helps LLM to reason better. There are two approaches. First - use code in Prolog or Python for validating and inference; this includes running the code and sending the output back to the LLM. Second - use code and use LLM to interpret it as I mentioned here - https://shchegrikovich.substack.com/p/two-methods-and-prolog-to-increase
Can RAG help with this problem?
I think RAG can help with additional facts and context, but real issue of logical/symbolic reasoning it won't fix completely.