Raven DB itself uses NLog by default and our solution uses log4net like thousands of other ones. So I decided to experiment with custom log4net appender for our needs because one of the first steps of moving to noSQL direction might be logging, due to simple implementation. Such an approach is far more flexible than logging to text files and might significantly reduce load on SQL servers in case of using ADO.NET appender.
So let's start.
First we need to decide what we are going to store. Since logging event is simple and independent document we can just wrap LoggingEvent.
// The log entry document entity that will be stored to the database.
public class Log : INamedDocument
{
...
public Log(LoggingEvent logEvent)
{
if (logEvent == null)
{
throw new ArgumentNullException("logEvent");
}
this.LoggerName = logEvent.LoggerName;
this.Domain = logEvent.Domain;
this.Identity = logEvent.Identity;
this.ThreadName = logEvent.ThreadName;
this.UserName = logEvent.UserName;
this.MessageObject = logEvent.MessageObject;
this.TimeStamp = logEvent.TimeStamp;
this.Exception = logEvent.ExceptionObject;
this.Message = logEvent.RenderedMessage;
this.Fix = logEvent.Fix.ToString();
...
// Raven doesn't serialize unknown types like log4net's PropertiesDictionary
this.Properties = logEvent.Properties.GetKeys().ToDictionary(key => key, key => logEvent.Properties[key].ToString());
}
public string LoggerName { get; set; }
public string Domain { get; set; }
public string Identity { get; set; }
public string ThreadName { get; set; }
public string UserName { get; set; }
public object MessageObject { get; set; }
public DateTime TimeStamp { get; set; }
public object Exception { get; set; }
public string Message { get; set; }
public string Fix { get; set; }
public IDictionary Properties { get; set; }
....
}
Next step will be choosing which appender template we need and which additional settings Raven requires. I think using of buffering appender makes sense in order not to drive database connection up the wall. As for additional setting of appender we might need connection string (or connection string name) and Raven's settings about max number of request per document session.So our ".config" file would have something like this:
Ok, we have all the prerequisites and we can write some code.
Implementation is simple: on SendBuffer method it adds log events to a document session and saves changes to a DB server. On ActivateOptions it will initialize DB connection, i.e. create document store instance.
public class RavenAppender : BufferingAppenderSkeleton
{
private readonly object lockObject = new object();
private IDocumentStore documentStore;
private IDocumentSession documentSession;
#region Appender configuration properties
///
/// Gets or sets the connection string.
///
///
/// The connection string.
///
public string ConnectionString { get; set; }
///
/// Gets or sets the max number of requests per session.
/// By default the number of remote calls to the server per session is limited to 30.
///
///
/// The max number of requests per session.
///
public int MaxNumberOfRequestsPerSession { get; set; }
#endregion
///
/// Initializes a new instance of the class.
///
public RavenAppender() {}
///
/// Initializes a new instance of the class.
/// Can be used for unit testing
///
///
The document store.
public RavenAppender(IDocumentStore documentStore)
{
if (documentStore == null)
{
throw new ArgumentNullException("documentStore");
}
this.documentStore = documentStore;
}
protected override void SendBuffer(LoggingEvent[] events)
{
if (events == null || !events.Any())
{
return;
}
this.CheckSession();
foreach (var entry in events.Where(e => e != null).Select(e => new Log(e)))
{
this.documentSession.Store(entry);
}
this.Commit();
}
public override void ActivateOptions()
{
try
{
this.InitServer();
}
catch (Exception exception)
{
ErrorHandler.Error("Exception while initializing Raven Appender", exception, ErrorCode.GenericFailure);
// throw;
}
}
protected override void OnClose()
{
this.Flush();
this.Commit();
try
{
if (this.documentSession != null)
{
this.documentSession.Dispose();
}
if (this.documentStore != null && !this.documentStore.WasDisposed)
{
this.documentStore.Dispose();
}
}
catch (Exception e)
{
ErrorHandler.Error("Exception while closing Raven Appender", e, ErrorCode.GenericFailure);
}
base.OnClose();
}
protected virtual void Commit()
{
if (this.documentSession == null)
{
return;
}
try
{
this.documentSession.SaveChanges();
}
catch (Exception e)
{
ErrorHandler.Error("Exception while commiting to the Raven DB", e, ErrorCode.GenericFailure);
}
}
private void CheckSession()
{
if (this.documentSession != null)
{
return;
}
lock (this.lockObject)
{
if (this.documentSession != null)
{
if (this.documentSession.Advanced.NumberOfRequests >= this.documentSession.Advanced.MaxNumberOfRequestsPerSession)
{
this.Commit();
this.documentSession.Dispose();
}
else
{
return;
}
}
this.documentSession = this.documentStore.OpenSession();
this.documentSession.Advanced.UseOptimisticConcurrency = true;
if (this.MaxNumberOfRequestsPerSession > 0)
{
this.documentSession.Advanced.MaxNumberOfRequestsPerSession = this.MaxNumberOfRequestsPerSession;
}
}
}
private void InitServer()
{
if (this.documentStore != null)
{
return;
}
if (string.IsNullOrEmpty(this.ConnectionString))
{
var exception = new InvalidOperationException("Connection string is not specified.");
ErrorHandler.Error("Connection string is not specified.", exception, ErrorCode.GenericFailure);
return;
}
this.documentStore = new DocumentStore
{
ConnectionStringName = this.ConnectionString
};
this.documentStore.Initialize();
}
}
One detail we should care about is max number of requests per session. RavenDB's default limitation is 30 requests per session. On the one hand we have moved this option to the config file on the other hand we just recreate a session when max number of requests is reached.So this is it: simple but effective. With RavenDB indexes it is possible to have extra-analysis or statistics of logged events, for instance, number of error per day / per module, new errors or warnings, etc.
Sources are available on GitHub.
NuGet package: http://nuget.org/List/Packages/log4net.Raven
Update:
 |
| The screenshot of the test Log documents |
