If the modifications are on his server you could be breaking the law by accessing the server without permission regardless of whether he gave you the login details prior to that.
Regarding suing you, I very much doubt he would be successful in attempting to sue you or take you to small claims...