In order to get Jenkins setup on Ubuntu based system I followed the directions provided on Jenkins Wiki.
The one caveat I ran into was that Jenkins runs by default on port 8080. I was already using this port for another service and couldn't get Jenkins started. A quick mucking around in the file directories and I discovered many of Jenkins 'defaults' can be configured in "/etc/default/jenkins". Changing the port to something else that I desired worked like a charm.