Are we talking about the "buffer offset" setting in Asio4All? This can't be set to a negative value (afaik) and it will increase the latency - it's meant to give the buffers extra clearance when they can't cope with the current settings.
In other words, no, you can't magically make the latency go away like that.