I have been fighting with a mix of CLI and GUI tools for linux for ages now. After having a great experience with TortosieSVN for Windows to move to linux and not find anything that suits me was quite a surprise. After google led me to http://www.doknowevil.net/2009/04/28/nautilussvn-finally-an-svn-gui-for-linux-that-doesnt-totally-suck/ i started to use http://rabbitvcs.org/ using the PPA for ubuntu it looks and works great.
If you want a context menu full featured SVN client built into Nautilus and a few other apps check it out
Check out the screenshots at http://wiki.rabbitvcs.org/wiki/about/screenshots