Yes, as long as the database is on the same server, then you only need to configure the other cPanels to connect locally to the database with a valid username and password. The host name would be 'localhost'.
If the database you want is on a different server, then you need to make a remote connection. All the configuration settings would be the same, except you would need to use the database server's IP address in place of 'lcoalhost'.
Read the detailed examples in the related article, "How to connect to the MySQL database".
