Questions tagged [logs]
A sequential journal of database write operations that facilitates robust atomic write operations.
249
questions
117
votes
5
answers
233k
views
How to safely change MySQL innodb variable 'innodb_log_file_size'?
So I'm fairly new to tuning InnoDB. I'm slowly changing tables (where necessary) from MyIsam to InnoDB. I've got about 100MB in innodb, so I increased the innodb_buffer_pool_size variable to 128MB:
...
- 23.4k
70
votes
6
answers
205k
views
Disable MySQL binary logging with log_bin variable
Default MySQL config file /etc/mysql/my.cnf installed by some debian package using APT often set log_bin variable, so binlog are enabled:
log_bin = /var/log/mysql/mysql-bin.log
When I want to ...
- 2,328
47
votes
6
answers
349k
views
Can I see Historical Queries run on a SQL Server database?
Someone was running a query on our SQL Server database remotely and their system crashed.
They have no backup of that query and want to see what was run on the server.
Is it possible to find this ...
- 573
23
votes
1
answer
24k
views
log_min_duration_statement setting is ignored
I am running Postgresql 9.1 on Ubuntu. Exact Postgresql version is 9.1+129ubuntu1 as my package manager shows.
I have 2 databases that are actively in use and they are used from a remote server.
I ...
- 459
23
votes
3
answers
58k
views
MySQL InnoDB page_cleaner settings might not be optimal
Seeing this note in mysqld.log:
[Note] InnoDB: page_cleaner: 1000ms intended loop took 15888ms. The settings might not be optimal. (flushed=200 and evicted=0, during the time.)
There seems to be ...
- 342
21
votes
1
answer
56k
views
What exactly are iblog files in mysql
I would like to understand these ibdata files as these play vital role in the crash recovery procedure. I could not find proper resources over the web for this.
- 804
18
votes
3
answers
1k
views
How to store 'n' days of web server logs in Sql Server?
For faster reporting and performance analysis, we want to insert our web server logs into Sql Server. This will allow us to see traffic patterns, issues, slowdowns in near real-time.
We have a daemon ...
- 283
16
votes
3
answers
8k
views
Should a log table get an id field or primary key?
I have a log table that captures the datetime stamp of when certain files were exported to another system.
The exportedLog table currently has three fields:
id (primary key)
messageId ...
- 2,032
14
votes
3
answers
38k
views
How do I output MySQL logs to syslog?
I want to use syslog for logging MySQL(5.1.41) on Ubuntu(10.04 LTS).
I found information that output error log to syslog.
[mysqld_safe]
syslog
But I want to use syslog for logging general logs and ...
- 345
13
votes
2
answers
7k
views
How do I hide sensitive information like plaintext passwords from the logs?
I do not have access to a Postgres installation, so I cannot check.
I am a security guy, and I'm seeing plaintext passwords in the logs:
create user user1 with password 'PLAINTEXT PASSWORD'
How can ...
- 232
13
votes
3
answers
17k
views
How best to maintain SQL log file sizes
I'm somewhat of a new DBA and I'm managing a SQL Server 2012 instance that has a fair amount of activity. I'm running in Full Recovery mode because we need point in time recovery.
Right now, I'm ...
- 705
12
votes
1
answer
4k
views
Performance impact of setting PostgreSQL to log all statements
PostgreSQL 9.2.2 on Windows 7 64-bit.
The setting log_statement in the postgresql.conf file specifies what statements to log (none, DDL, data-modifying, or all). To what extent does setting ...
- 223
11
votes
1
answer
52k
views
mysql logging activity from specific user or ip
I have mysql server.
The server is accessed by my application, and by external auditor (person using mysql workbench).
The auditor has specific user and password and dedicated IP and it is granted ...
- 223
10
votes
3
answers
20k
views
Write to Error Log
Using SQL Server 2008 R2:
How can I write to the SQL Server Error Log? I have a ROLLBACK statement that I'd like to couple with a statement written to the error log for external monitoring.
Example:...
- 603
10
votes
2
answers
13k
views
MySQL binary logs - skip a table
Is there a way to skip a specific table in the binary logs?
I've got binary logs configured as my incremental backup strategy between nightly backups. But we have one huge reference table that we're ...
- 531
9
votes
3
answers
66k
views
How do I truncate the transaction log in a SQL Server 2008 database?
How do I truncate the transaction log in a SQL Server 2008 database?
What are possible best ways?
I tried this from a blog as follows:
1) From the setting database to simple recovery, shrinking ...
- 203
9
votes
3
answers
768
views
Need Help Troubleshooting Sql Server 2005 Deadlock Scenario
I am running into a deadlock scenario where the only participants in the deadlock appear to be a single table and a single stored procedure that deletes from that table. I drew that conclusion based ...
- 93
9
votes
3
answers
24k
views
Transaction Log Maintanance While Using AlwaysOn Availability Group
We are using HADR ( AlwaysOn Availability Group) feature of SQL Server 2012.
Server and AG Configuration as below:
SQL12_SRV1
--> AG1(PRIMARY) - SYNC
-->> DBTest
SQL12_SRV2
--> AG1(SECONDARY)
...
9
votes
1
answer
19k
views
How to view full blocking postgres queries?
I'm using a statement from this page to view blocking queries in Postgres
SELECT bl.pid AS blocked_pid,
a.usename AS blocked_user,
ka.query ...
- 569
8
votes
1
answer
32k
views
MySQL Error: impossible to write to binary log
I have a system (inherited from another development company) and I don't know all its features yet.
Construction:
- web client/application (symfony 1.4)
- DB - MySQL.
Project is deployed on 2 servers:...
- 203
8
votes
2
answers
59k
views
Flush/Clean MySql ib_logfile0 ib_logfile1
Is there a way to flush ib_logfile0 and ib_logfile1 without dumping the tables to a .sql file, deleting, then re-inserting? Somebody entered a couple plain text credit card numbers into the customer ...
- 183
7
votes
2
answers
9k
views
Transaction Log Files Larger Than Data Files [duplicate]
I'm an accidental DBA and need help determining a course of action regarding transaction log files on several databases. I ran Brent Ozar's sp_blitz to see what areas of concern there might be on an ...
- 71
7
votes
2
answers
8k
views
SQL Server 2008 log files have minimum sizes, what gives and how do I make them smaller?
Ok, to start with, I screwed up when I created the databases, using a create script roughly like so: (artificial linebreaks and names/paths for wrapping purposes)
CREATE DATABASE [EXAMPLE] ON ...
- 6,345
7
votes
1
answer
2k
views
SQL Server logs "blob data", viewable with journalctl
What does it mean when I run journalctl -u mssql-server.service and it says B blob data,
Sep 06 17:34:44 x230 systemd[1]: Stopping Microsoft SQL Server Database Engine...
Sep 06 17:34:44 x230 ...
- 62.2k
7
votes
3
answers
2k
views
Replay (re-execute) MySQL SELECT queries from a log file
MySQL Benchmarking
I would like to evaluate the performance of a different MySQL instance by re-executing real queries from log files. I am aware of tools like mysqlslap, that produces random and ...
- 221
7
votes
1
answer
1k
views
How long can the log reader agent run for before a restart will do it some good?
As a developer who has for the first time successfully implemented a replication topology for our production database, I'm monitoring it very closely and fretting over potential problems.
I'm pleased ...
- 293
7
votes
2
answers
4k
views
Investigate peak in MySQL throughput
Recently one of our servers has ran out of memory and crashed. After reviewing the munin graphs, it appears that the only metric (other than memory usage) that peaked just before the crash was the ...
- 349
6
votes
3
answers
4k
views
How do I minimise logging during a large insert?
During a nightly scheduled task I am creating a large table from scratch using select into and then adding a clustered index. I would like to minimise the amount of logging during the whole process as ...
- 39.7k
6
votes
1
answer
7k
views
MySQL audit and general log
May ask for the difference of MySQL Audit log plugin and general log? I looking for any activities done in a MySQL server.
- 105
6
votes
1
answer
3k
views
Azure: Many Failed Login Attempts Logged
I run a SQL Server on an Azure Virtual Machine. I have noticed in the Event Logs of the server lots of failed SQL Login attempts using a ton of different usernames (none of which exist):
Login ...
user73880
6
votes
1
answer
7k
views
MySQL Slave Relay Logging but not logging Binary Log
I have a master slave setup both mysql 5.5, the setup is fine except that the slave won't Binary log to the standard mysql-binlog only to the relay logs. I fear this may be due to my lack of ...
- 63
6
votes
2
answers
590
views
SQL Server Transaction Log Initial Data Load
What is the standard process when initially populating a database with 5GB+ to avoid a large transaction log? From my understanding the log file would jump to a large size after the initial load and ...
- 283
6
votes
2
answers
27k
views
How to enable queries logs in MariaDB
I'm running mysql Ver 15.1 Distrib 5.5.46-MariaDB in CentOS 6.7 server. I'm trying to get queries logged and I'm doing by redirecting log to files as shown below:
#/etc/my.cnf.d/server.cnf
# this is ...
- 1,710
6
votes
1
answer
255
views
IIS access log to SQL normalization
I am looking for insert IIS 6.0 access log ( 5 servers, and over 400MB daily ) to SQL database. What scares me is the size. There is a lot of information you are duplicating (i.e. site name, url, ...
- 191
5
votes
2
answers
744
views
Do I need to leave some extra space available on the disk which my database log files reside, for log backup operations to successfully occur?
If I size my log files to evenly split the entire drive they reside on, leaving no extra space available, will log backups still be able to occur successfully? I have several databases, with one log ...
- 35.2k
5
votes
1
answer
930
views
whats best practice for Log Truncation in SQL Server?
I have a production DB in SQL server and wanted to put the final touches after the functionality is completed. prior to shipping it out i want to make sure i have some clean up in the SQL server DB ...
- 2,032
5
votes
3
answers
357
views
Is there a way to query SQL Server 2005/2008 for location of its log files?
I there a way to query SQL Server 2005+ for the file system location of its various log files. By that I mean the text log files, not database transaction log files?
For example my SQL Agent, Error ...
- 1,326
5
votes
3
answers
4k
views
Log MySQL DB changing queries and users
For security reasons I need a server-side (running Debian 6.0 Squeeze) logging of all queries that may have changed the content of a MySQL DB (v. 5.1) and the user who issued it. I had to rule out
...
- 205
5
votes
2
answers
22k
views
how to list all features installed in a sql server instance?
There are other Installation related questions with similar details here and here.
I could not find anything related to listing the installed features in sql server 2016 though.
I can do it manually ...
- 15.8k
5
votes
2
answers
6k
views
Large files in wamp\bin\mysql\mysql5.5.24\data directory
I have discovered these files located in the wamp\bin\mysql\mysql5.5.24\data folder on my Windows 2008 server.
They are consuming about 22 GB on a 40 GB drive.
I am using a LMS called moodle, that ...
5
votes
2
answers
7k
views
Unable to disable SQL statement logging in PostgreSQL 9.1
I am running PostgreSQL 9.1 on Windows Server 2008 R2. I enabled SQL statement logging to the stderr log by modifying my postgresql.conf file, but now I can't seem to disable the logging without ...
- 51
5
votes
1
answer
750
views
When was second log file created for database?
Is it possible to see when a second log file was created for a database and by who? I have found an additional log file that was created for one of our databases in our environment and I'm trying to ...
- 573
5
votes
1
answer
9k
views
Raise NOTICE, Raise INFO not saved to logs in POSTGRES
I searched a lot on google but no solution found, I am not sure what I am missing here.
My intention here is to store the notice , info from this procedure to postgres logs (txt files) that are ...
- 53
5
votes
1
answer
2k
views
What's the best way to structure logging application data in MySQL
I may be overthinking this but:
I have an API; I want to log calls to the API for stat/debugging purposes. Ideally the speed of reads should be quick but is not essential (as will primarily be read ...
- 225
5
votes
2
answers
2k
views
Extract query fingerprints and tables from large log files using pt-query-digest
I tried to parse a large log file using pt-query-digest but it gives "Out of memory!" when I try to read the file. I have 3GB RAM, 40GB empty space on HDD, the file is 20GB. I did not found anything ...
- 231
4
votes
1
answer
3k
views
Why do I have to backup a transaction log twice for it to shrink?
This question was attempted twice on experts-exchange with no real answer.
I know that I should not shrink the log file - that is not the question.
If you feel like answering that one should not do ...
- 1,365
4
votes
2
answers
2k
views
Can stable (or immutable) functions call volatile functions?
The PostgreSQL documentation states:
Any function with side-effects must be labeled VOLATILE...
Consider the following function:
CREATE OR REPLACE FUNCTION count_items()
RETURNS integer AS
$...
- 833
4
votes
2
answers
57k
views
How to list all past remote login information
Instead of using "Remote Desktop" for connecting to SQL Server, I and my co-workers are using SQL Server Management Studio to apply changes to the remote server (each user has their own credentials).
...
- 141
4
votes
1
answer
22k
views
PostgreSQL: Change log file location
How can I change the location of the log file in PostgreSQL? Can it be done without stopping the cluster?
- 11.5k
4
votes
2
answers
12k
views
SQL Server : log folder too large
Please note that I'm not talking about transaction logs. I'm referring to a folder within SQL Server called 'Log' where ErrorLog and SQLDrmp files exists.
Well, the fact is that this folder is ...
- 217