Log files

Logs are stored in the directory: /var/log/hipchat. A symlink to this directory exists at /home/admin/logs, as well.

Hipchat Server includes built-in commands to tail, or continuously output, and highlight the content of particular logs:

  • wlog – Web functionality
  • tlog – XMPP Chat Back-end
  • clog – APIv2 Services
  • mlog – Outbound email server

Configuration management is managed by chef-solo. It is run at boot, upgrade, and during service restarts. You can find the chef-solo log file in the following location: /var/log/chef.log

Logs Commands

CommandUseNotes
hipchat log --rotateForce a log rotationThis will force all logs to conform to the log rotation configuration specified in /etc/logrotate.conf and /etc/logrotate.d
hipchat log --purgeTruncates the contents of all logs in /var/logBe sure to backup any logs required for troubleshooting before executing this command.

Log File Reference

Resource

Use

Notes

/var/log/chef.logchef runs for installing/updating/configuringLogging starts from first boot. Most system configuration changes will trigger a chef run.
/var/log/cumulus.logS3-compatible file service logsRaw logs of attempted access but almost all connections are mediated through nginx
/var/log/hipchat/nginx.lognginx logs AND coral logs

Includes nginx-access entries alongside coral entries. nginx.err.log only logs ERROR and above.

 Any entries in nginx.err.log are indicative of a problem.

/var/log/hipchat/kern.logUbuntu kernel logging 
/var/log/schema_upgrade.logLogs any schema upgrade changes that occur during upgradesUseful for seeing upgrade history.
/var/log/hipchat/atlassian-crowd.log

External directory (Crowd/AD/LDAP) integration and authentication

Related to user authentication and external directory synchronization.
/var/log/hipchat/coral.logAPIv2 logs

Many services rely on coral for authentication, so this log is often referenced while tracing a problem. coral.err.log only logs ERROR and above.

Any entries in coral.err.log are indicative of a problem.

/var/log/hipchat/files.logEntries related to daily cronjob for purging export files 
/var/log/hipchat/web.logWebUI logging (i.e. the php-based administration)

Good starting point for any error messages or stack traces occurring in the web interface. web.err.log only logs ERROR and above.

Any entries in web.err.log are indicative of a problem.

/var/log/hipchat/update.logDetailed output of upgrades (and errors)Critical for troubleshooting upgrade issues, along with chef.log.
/var/log/hipchat/tetra.log

Core chat service log

Any errors here are usually pretty critical. tetra.err.log only logs ERROR and above.

Any entries in tetra.err.log are indicative of a problem.

/var/log/hipchat/hup.logLogging of when the services are restarted

Helpful for troubleshooting a broken service/upgrade.

"services starting" is to prevent access to the system before it is fully initialized, the hup.log is the orderly start - the last statement should be "maintenance_mode now OFF".

/var/log/hipchat/hcapp.logHipchat-specific subprocesses:
  • Dory - "Welcome to Hipchat" service
  • Barb - Manages mobile push notifications
  • Scissortail - Import/Export jobs
Entries include associated service name for easy parsing, such as:
grep scissortail hcapp.log
/var/log/hipchat/database.logredis master log, there is another redis log for statsIf this file is huge then most likely sudo /bin/dont-blame-hipchat; chown redis /mnt is required
/var/log/hipchat/daemon.logContain logs for the various daemons, including monit and mysqldUseful for observing emergency service restarts via monit. Entries include daemon names for parsing, similar to hcapp.log
/var/log/hipchat/runtime.logList out server processes, disk space, server status (including CPU, memory, active user counts, etc.)This is a great place to start for root cause analyzes.
Last modified on Nov 30, 2017

Was this helpful?

Yes
No
Provide feedback about this article
Powered by Confluence and Scroll Viewport.