The JCo libraries and the sapjco.jar file must correlate to the agent's bit range, and not to the OS where it was installed.
As such, check the agent with the command:
cybAgent.exe -v (for Windows)
cybAgent.bin -v (for unix)
Its output will show if the implementation was of 32- or 64-bit, then choose the JCo accordingly.