How do I aggregate data from the morgan logging library?

debugcn Published at Dev

Eric H

I have been using the Morgan logger on my node.js API to get some insights into how routes are performing with sample output such as:

2016-05-17T22:47:59.232Z - performance: GET /login 200 14.767 ms - 1157

I'm looking for a way to aggregate this type of data over a time period - but I'm at a loss as to how to do so. I had signed up for loggly as we had something similar set up in it at a previous company (splunk) - but for the life of me I can't see how I could achieve the output I want with that tool.

What can I do to capture, clean and then perform calculations on this type of data in a near real-time fashion?

The type of questions I'm looking to answer are:

How do routes on an overall average perform month over month?
What are my slowest routes over the last hour/day/week?
What is the min/max/average of each route that gets accessed?
How many requests do I get during a specific hour of the day?

Any help is appreciated, this is new territory for me and google isn't coming up with much.

Eric H

The answer is to use an APM suite such as NewRelic or AppDynamics.

Collected from the Internet

Please contact [email protected] to delete if infringement.

edited at2021-07-18

Comments

0 comments

From Dev

Related Related

Article

How do I aggregate data from the morgan logging library?

How do I aggregate data from the morgan logging library?

How do I aggregate data from many files into one file?

how to remove the logging data from JNativeHook library

How do I fill a child entity with data from DB from inside an aggregate root?

How do i aggregate data from 2 columns referencing another table?

How do I aggregate this data and create a new column with python & pandas?

How do I combine and aggregate Data Frame rows

How do I aggregate JSON data using Jolt by two keys?

I enabled iptables logging from the command line. How do I undo this logging configuration?

How do I prevent Laravel from logging 404 errors?

How can I remove extra data from Python logging file?

How do I access data returned from an array in my model to my controller to display with the table library

How do I add ADTS header when reading m4a raw data from iPod library?

Personal computer hacked: How do I block this user from logging in again? How do I find out how they are logging in?

Personal computer hacked: How do I block this user from logging in again? How do I find out how they are logging in?

Best way to aggregate logging data

How do i load data set part of the MASS library in R?

How do I aggregate non-aggregate values in GROUP BY queries?

How do I link a library to be loaded from the local directory?

How do I disable log messages from the Requests library?

How do i load an image from the IOS photo library to a UIWebView?

How do I import .dll library from subfolder in C#

How do i load an image from the IOS photo library to a UIWebView?

Remove only a library from cocoapod project, how i can do?

How do I fetch images from photo library?

How do I perform an "OR" filter on an aggregate?

How do I extract data from a script?

How do i make a list from this data?

How do I register logging driver for docker?

Kafka: How do I enable client logging?