Log files

Logs are stored in the directory: /var/log/hipchat. A symlink to this directory exists at /home/admin/logs, as well.

Hipchat Server includes built-in commands to tail, or continuously output, and highlight the content of particular logs:

  • wlog – Web functionality
  • tlog – XMPP Chat Back-end
  • clog – APIv2 Services
  • mlog – Outbound email server

Configuration management is managed by chef-solo. It is run at boot, upgrade, and during service restarts. You can find the chef-solo log file in the following location: /var/log/chef.log

Logs Commands

hipchat log --rotateForce a log rotationThis will force all logs to conform to the log rotation configuration specified in /etc/logrotate.conf and /etc/logrotate.d
hipchat log --purgeTruncates the contents of all logs in /var/logBe sure to backup any logs required for troubleshooting before executing this command.

Log File Reference




/var/log/chef.logchef runs for installing/updating/configuringLogging starts from first boot. Most system configuration changes will trigger a chef run.
/var/log/cumulus.logS3-compatible file service logsRaw logs of attempted access but almost all connections are mediated through nginx
/var/log/hipchat/nginx.lognginx logs AND coral logs

Includes nginx-access entries alongside coral entries. nginx.err.log only logs ERROR and above.

 Any entries in nginx.err.log are indicative of a problem.

/var/log/hipchat/kern.logUbuntu kernel logging 
/var/log/schema_upgrade.logLogs any schema upgrade changes that occur during upgradesUseful for seeing upgrade history.

External directory (Crowd/AD/LDAP) integration and authentication

Related to user authentication and external directory synchronization.
/var/log/hipchat/coral.logAPIv2 logs

Many services rely on coral for authentication, so this log is often referenced while tracing a problem. coral.err.log only logs ERROR and above.

Any entries in coral.err.log are indicative of a problem.

/var/log/hipchat/files.logEntries related to daily cronjob for purging export files 
/var/log/hipchat/web.logWebUI logging (i.e. the php-based administration)

Good starting point for any error messages or stack traces occurring in the web interface. web.err.log only logs ERROR and above.

Any entries in web.err.log are indicative of a problem.

/var/log/hipchat/update.logDetailed output of upgrades (and errors)Critical for troubleshooting upgrade issues, along with chef.log.

Core chat service log

Any errors here are usually pretty critical. tetra.err.log only logs ERROR and above.

Any entries in tetra.err.log are indicative of a problem.

/var/log/hipchat/hup.logLogging of when the services are restarted

Helpful for troubleshooting a broken service/upgrade.

"services starting" is to prevent access to the system before it is fully initialized, the hup.log is the orderly start - the last statement should be "maintenance_mode now OFF".

/var/log/hipchat/hcapp.logHipchat-specific subprocesses:
  • Dory - "Welcome to Hipchat" service
  • Barb - Manages mobile push notifications
  • Scissortail - Import/Export jobs
Entries include associated service name for easy parsing, such as:
grep scissortail hcapp.log
/var/log/hipchat/database.logredis master log, there is another redis log for statsIf this file is huge then most likely sudo /bin/dont-blame-hipchat; chown redis /mnt is required
/var/log/hipchat/daemon.logContain logs for the various daemons, including monit and mysqldUseful for observing emergency service restarts via monit. Entries include daemon names for parsing, similar to hcapp.log
/var/log/hipchat/runtime.logList out server processes, disk space, server status (including CPU, memory, active user counts, etc.)This is a great place to start for root cause analyzes.
Last modified on Nov 30, 2017

Was this helpful?

Provide feedback about this article
Powered by Confluence and Scroll Viewport.