Sending IdP logs to SQL

[Etan Weintraub]

Hi guys-
So a need has come up to get the logs from our IdP over to an MS SQL server. I can do this by processing yesterday's file today and pushing it in to the SQL DB that way, but we're wondering if there is a way to do it directly from Shib, and not be a day behind in the logs.

Anyone done something like this that cares to share a bit of their setup? Run in to any problems?

Thanks in advance for any help you can give.

-Etan E. Weintraub
Sr. Systems Engineer
Directory Architecture
***@Johns Hopkins
Johns Hopkins at Mt. Washington
5801 Smith Ave.
Suite 3110B
Baltimore, MD 21209
Phone: [phone]
E-mail: eweintra-***@public.gmane.org<mailto:eweintra-***@public.gmane.org>

[Chad La Joie]

Look at the JDBC appender for logback. Even if it doesn't do exactly
what you want it would probably serve as a good starting pointing for
developing what you want.

Post by Etan Weintraub
Hi guys-
So a need has come up to get the logs from our IdP over to an MS SQL server.
I can do this by processing yesterday’s file today and pushing it in to the
SQL DB that way, but we’re wondering if there is a way to do it directly
from Shib, and not be a day behind in the logs.
Anyone done something like this that cares to share a bit of their setup?
Run in to any problems?
Thanks in advance for any help you can give.
-Etan E. Weintraub
Sr. Systems Engineer
Directory Architecture
Johns Hopkins at Mt. Washington
5801 Smith Ave.
Suite 3110B
Baltimore, MD 21209
Phone: [phone]

[Etan Weintraub]

I was looking at that, but it's a little confusing as to how to set it up correctly and I had a few specific questions with regard to using it with Shib. Specifically with Shib, would I be able to log both to the local files and to the JDBC appender? What would happen if the SQL server was down? Would Shib croak because it couldn't write to the logs, or keep chugging along?

-Etan E. Weintraub
Sr. Systems Engineer
Directory Architecture
***@Johns Hopkins
Johns Hopkins at Mt. Washington
5801 Smith Ave.
Suite 3110B
Baltimore, MD 21209
Phone: [phone]
E-mail: eweintra-***@public.gmane.org


-----Original Message-----
From: shibboleth-users-request-H4aWS73dXup+***@public.gmane.org [mailto:shibboleth-users-request-H4aWS73dXup+***@public.gmane.org] On Behalf Of Chad La Joie
Sent: Monday, May 23, 2011 9:43 AM
To: shibboleth-users-H4aWS73dXup+***@public.gmane.org
Subject: Re: [Shib-Users] Sending IdP logs to SQL

Look at the JDBC appender for logback. Even if it doesn't do exactly
what you want it would probably serve as a good starting pointing for
developing what you want.

Post by Etan Weintraub
Hi guys-
So a need has come up to get the logs from our IdP over to an MS SQL server.
I can do this by processing yesterday's file today and pushing it in to the
SQL DB that way, but we're wondering if there is a way to do it directly
from Shib, and not be a day behind in the logs.
Anyone done something like this that cares to share a bit of their setup?
Run in to any problems?
Thanks in advance for any help you can give.
-Etan E. Weintraub
Sr. Systems Engineer
Directory Architecture
Johns Hopkins at Mt. Washington
5801 Smith Ave.
Suite 3110B
Baltimore, MD 21209
Phone: [phone]

[Chad La Joie]

I don't know what would happen if the SQL server was down, you'd have
to ask on the Logback list. In regards to your first question though,
yes you can write to multiple appenders at once. Give a read over the
logback docs, it talks about how you do that, how such configuration
options are inherited, etc.

Post by Etan Weintraub
I was looking at that, but it's a little confusing as to how to set it up correctly and I had a few specific questions with regard to using it with Shib. Specifically with Shib, would I be able to log both to the local files and to the JDBC appender? What would happen if the SQL server was down? Would Shib croak because it couldn't write to the logs, or keep chugging along?
-Etan E. Weintraub
Sr. Systems Engineer
Directory Architecture
Johns Hopkins at Mt. Washington
5801 Smith Ave.
Suite 3110B
Baltimore, MD 21209
Phone: [phone]
-----Original Message-----
Sent: Monday, May 23, 2011 9:43 AM
Subject: Re: [Shib-Users] Sending IdP logs to SQL
Look at the JDBC appender for logback.  Even if it doesn't do exactly
what you want it would probably serve as a good starting pointing for
developing what you want.

Post by Etan Weintraub
Hi guys-
So a need has come up to get the logs from our IdP over to an MS SQL server.
I can do this by processing yesterday's file today and pushing it in to the
SQL DB that way, but we're wondering if there is a way to do it directly
from Shib, and not be a day behind in the logs.
Anyone done something like this that cares to share a bit of their setup?
Run in to any problems?
Thanks in advance for any help you can give.
-Etan E. Weintraub
Sr. Systems Engineer
Directory Architecture
Johns Hopkins at Mt. Washington
5801 Smith Ave.
Suite 3110B
Baltimore, MD 21209
Phone: [phone]

--
Chad La Joie
www.itumi.biz
trusted identities, delivered

[Etan Weintraub]

Thanks Chad.

-Etan E. Weintraub
Sr. Systems Engineer
Directory Architecture
***@Johns Hopkins
Johns Hopkins at Mt. Washington
5801 Smith Ave.
Suite 3110B
Baltimore, MD 21209
Phone: [phone]
E-mail: eweintra-***@public.gmane.org


-----Original Message-----
From: shibboleth-users-request-H4aWS73dXup+***@public.gmane.org [mailto:shibboleth-users-request-H4aWS73dXup+***@public.gmane.org] On Behalf Of Chad La Joie
Sent: Monday, May 23, 2011 9:49 AM
To: shibboleth-users-H4aWS73dXup+***@public.gmane.org
Subject: Re: [Shib-Users] Sending IdP logs to SQL

I don't know what would happen if the SQL server was down, you'd have
to ask on the Logback list. In regards to your first question though,
yes you can write to multiple appenders at once. Give a read over the
logback docs, it talks about how you do that, how such configuration
options are inherited, etc.

Post by Etan Weintraub
I was looking at that, but it's a little confusing as to how to set it up correctly and I had a few specific questions with regard to using it with Shib. Specifically with Shib, would I be able to log both to the local files and to the JDBC appender? What would happen if the SQL server was down? Would Shib croak because it couldn't write to the logs, or keep chugging along?
-Etan E. Weintraub
Sr. Systems Engineer
Directory Architecture
Johns Hopkins at Mt. Washington
5801 Smith Ave.
Suite 3110B
Baltimore, MD 21209
Phone: [phone]
-----Original Message-----
Sent: Monday, May 23, 2011 9:43 AM
Subject: Re: [Shib-Users] Sending IdP logs to SQL
Look at the JDBC appender for logback.  Even if it doesn't do exactly
what you want it would probably serve as a good starting pointing for
developing what you want.

Post by Etan Weintraub
Hi guys-
So a need has come up to get the logs from our IdP over to an MS SQL server.
I can do this by processing yesterday's file today and pushing it in to the
SQL DB that way, but we're wondering if there is a way to do it directly
from Shib, and not be a day behind in the logs.
Anyone done something like this that cares to share a bit of their setup?
Run in to any problems?
Thanks in advance for any help you can give.
-Etan E. Weintraub
Sr. Systems Engineer
Directory Architecture
Johns Hopkins at Mt. Washington
5801 Smith Ave.
Suite 3110B
Baltimore, MD 21209
Phone: [phone]

--
Chad La Joie
www.itumi.biz
trusted identities, delivered