Can I use the portable version of EssentialPIM as the desktop one?

Yes, you can do that. There's couple of minor limitations, though. For instance, the portable version cannot be set as the default email client due to inability to work with Windows registry.