Servers will tend to always be slower than their single player counterparts... however this usually isn't noticeable at low populations. I do not think that your server could operate any faster than usual, unless you moved the server to another computer.
EDIT: I have one other question: Do minecraft servers with few players in general have less lag than single player servers?