log analyzer tool for linux - GoAccess

Question: What is GoAccess in linux?
GoAccess is an open source real-time web log analyzer and interactive viewer that runs in a terminal.


Question: How GoAccess works?
It analyse the Log file (access.log) which is cotinue in writes by application.



Question: What are the benefits of GoAccess?

1. Completely Real Time
2. Nearly All Web Log Formats
3. Track Application Response Time
4. Incremental Log Processing
5. Minimal configuration needed
6. Visitors
7. Color Scheme Customizable

Question: Does GoAccess is available for GUI?
Yes, You can watch in Terminal and GUI.


How to install GoAccess in Server?

git clone https://github.com/allinurl/goaccess.git
cd goaccess
autoreconf -fi
./configure --enable-geoip --enable-utf8
make

How to run GoAccess to check the analytics?

goaccess access.log -c

How to check the analytics in HTML page?

goaccess access.log -o report.html --log-format=COMBINED

Now run, https://example.com/report.html



How to check the analytics in HTML page dynamically?

goaccess access.log -o /var/www/html/dynamic.html --log-format=COMBINED --real-time-html

Now run, https://example.com/dynamic.html




Question: Share the Offical website link?
https://goaccess.io/

MySQL Query Optimization Tips and Techniques

1. Choosing Which Version of MySQL
2. Don't join extra tables in MySQL Query.
3. Only get N records which are going to used. Don't get extra records from table which you are not using.
4. Don't fetch extra column from table which are not in use.
5. Don't add spam records in tables
6. Don't get it overload any table like 1GB Size, In this case shift data to another table.
7. Get the understanding of normalization.
8. Use Explain/DESCRIBE to know about table structure and Query. For Example:

DESCRIBE SELECT * FROM `users` WHERE username='web-tech' 

9. Partition your table (MySQL 5.1). Paritioning is a technique for splitting a large table into several smaller ones by a specific (aggregate) key.
10. Partition can be achieve in three way 1. RANGE, HASH and List/Key.
11. Build your indexes to match the queries running. For Example:

    ALTER TABLE `users` ADD INDEX `profile_id` (`profile_id`)

    Know about MySQL Indexing
    
12. Use concatination indexing, if required (When searching like below).

    SELECT * FROM table_name  WHERE field_name1='text1' AND field_name2='text2';

13. No indexing on column which not used in search.
14. Sometime you need to use OPTIMIZE Table. For Example:

    OPTIMIZE TABLE `users`

    Used for defragment tables and update the InnoDB fulltext index
15. Full Text Search can be used, if required.
    http://www.web-technology-experts-notes.in/2013/05/mysql-fulltext-search.html

Best Related Posts are Following:

1. Why error 524 a timeout occurred.
2. Free Boost Web Application By 20% in Simple Steps.
3. Improve Ajax Performance.
4. Reduce the loading time of website.

Why error 524 a timeout occurred

This error is CloudFlare error that denoting your web page is loading slow, due to any of below reason.

• Website is Slow.
• Temporary internet is slow.
• Some function in website is talking long time to respond.
• Any of mysql-query is talking more time to respond.

 In this case either you need to
increase the performance of website
OR
increase the max_execution_time on website.

What is meaning of this Error.
A 524 error states that CloudFlare was able to make a TCP connection to the origin(your website server location), but the origin server did not reply with a HTTP response before the connection timed out.
It means that CloudFlare is able to make a network connection with origin server (your website), but the origin server(webiste) took too long time to respond to the request.


If you get this error first time, then you can refresh the page OR open the website in another browser.

As we know, Most of time website execution limit is 30 seconds but if website is takes more time (more than 30 seconds) to reply, then cloudFlare did not wait and through 524 error.
This error comes when server is on cloudFlare.


If this issue persistent in your website and comes very often then you have to work hard on your website..

If this issue is coming many times then it means your website is loading very slow.
you need to optimize.

How to increase the Performance of website?
1. Optimize the application Flow.

2. Optimize the MySQLI Query.

3 - Make Fewer HTTP Requests (means Less Ajax Call)

4 - Use a Content Delivery Network (CDN)

5 - Add an Expires Header
http://stackoverflow.com/questions/4603076/add-expire-headers-in-php-cant-make-it-work

6 - Gzip Components
http://betterexplained.com/articles/how-to-optimize-your-site-with-gzip-compression/

7 - Put Stylesheets at the Top (CSS Files in head tag)

8 - Put Scripts at the Bottom (Js files in footer)

9 - Avoid CSS Expressions (e.g 100/2)

See full articles http://www.web-technology-experts-notes.in/2013/10/14-steps-to-reduce-the-loading-time-of-website.html

Best Related Posts are Following:

1. Improve Ajax Performance
2. Reduce the loading time of website

Free Boost Web Application By 20% in Simple Steps

Simple Steps to Boost your appliction by 05 - 20%

• echo is faster than print and use echo's for multiple parameters

• Unset your large variables to free memory

• use swtich case instead of if-else

• Don't use @ because Error suppression with @ is very slow.

• Turn on apache mod_deflate, mod_gzip which is available as an Apache module, compresses your data on the fly. It will boost your appliction and can reduce the data to transfer up to 80%

• Incrementing/Decrementing a global variable is 2 times slower than a local variable

• Incrementing/Decrementing an undefined local variable is 8 times slower than a initialized one.

• use require instead of require_once

• comment un-necessary code and remove the commented code

• Avoid count(*) on entire tables, it can lock the entire table.

• Use GROUP BY instead of DISTINCT when appropriate.

• Use INSERT ON DUPLICATE KEY or INSERT IGNORE instead of UPDATE to avoid the SELECT prior to update.

• Use Static Method, Speed improvement is by a factor of 4

• Avoid necessary loops, because it may slow your application.

Best Related Posts are Following:

1. Why error 524 a timeout occurred.
2. Improve Ajax Performance.
3. Reduce the loading time of website.

Improve Ajax Performance

Following are few steps to Improve Ajax Performance

1. First try to Reduce the Number of Ajax Call
2. If same call send again, abort the previous call
3. If ajax call is executing, and user go for another link, then cancel the previous one.
4. Use GET Method, As its Fast but less secure
5. Reduce the Amount of data transmitted
   a. Only Required parameter in Ajax Request
   b. Only Required Response in Ajax Request
6. Optimize your Server  

Best Related Posts are Following:

1. Why error 524 a timeout occurred.
2. Free Boost Web Application By 20% in Simple Steps.
3. Improve Ajax Performance.
4. Reduce the loading time of website.