Hi All,

 

Has anyone had a case where one parameter in a query string didn't return results?  I'm able to return results for each parameter EXCEPT.

 

00.000.00.00 - - [02/Mar/2013:10:07:27 -0500] "GET /content/yyy/SponsorAds/Redirect/AdRedirect.jsp?ADID=0000&target=http://site.site.com/ HTTP/1.1" 302 - "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" ;session=XXXX-;member=-XXXXX;logonid=XXXX-;SearchTerms=XXXX-

 

The parameter is defined as a query paramter matching ADID where pager starts with "GET"

 

Any help would be great.

 

 

 

Views: 385

Reply to This

Replies to This Discussion

Do you see 'GET ...' on your Page Summary? If not, you should use the general catch-all of "pages that contain /".

The other thing, in the case you show, that's traffic from Googlebot and is quite likely to be classified as Robot/Spider activity and thus not be able to extract parameters from. (Of course, you will likely have human traffic that has this as well, but not this row).

helps?

Hi !

 

We’ve just installed NetInsight 8.6.0.2 on Sol10 with Apache 2.2 and Oracle 10g.

 

The application is writing a webserver type of logs for analysis by NetInsight.

We’re currently tuning the logformat and doing initial customization to a default NetInsight installation.

 

- We face some problems as follows:

 

The LogFile Format definition looks like this (without crlf)

<logformat format="%CUSTOMDATE Y-M-D H:MI:S%|%HOST%|%STATUS%|%USERNAME%|%COOKIE%|%TIMETAKEN%|%BYTES%|

                                    %REQUEST%|

                                    %GWSACTION%|%GWSPRODUCT%|

                                    %REFERRER%|

                                    %USERAGENT%">Logfile-V3</logformat>

 

This is a sample log entry

2013-08-09 09:33:16|10.23.99.103|200|username|JSessionID=xyz.abc1|100|200000|

                                       GET http://x.y.z/request?action=login&lang=1&product=75 HTTP/1.0|

                                       ActionLogin|Product75|

                                       http://x.y.z/fakerefererr|">http://x.y.z/fakerefererr|

                                       Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.106 Safari/535.2

 

 

We did basic customization creating a few parameters as follows:

 

One parameter of type ‘field’ named ‘USERNAME’ associated with ‘view’

++>  On selecting these under ‘Parameter Analysis’, we get a default report as expected.

 

One parameters of type ‘cookie’ named ‘JSessionID’ associated with ‘view’

-->  On selecting these under ‘Parameter Analysis’, we get ‘No data’

 

Three parameters of type ‘querystring’ named ‘action’, ‘lang’, and ‘product’ associated with ‘view’

-->  On selecting these under ‘Parameter Analysis’, we get ‘No data’

-->  We want these parameters to be used as details to each page request

 

Two parameters of type ‘field’ named ‘GWSACTION’ and ‘GWSPRODUCT’ associated with ‘view’

-->  On selecting these under ‘Parameter Analysis’, we get

NetInsight was unable to generate the report.

The following errors occurred:

  1. GetSingleResult failed: Aggregate operation failed (), Can't insert into aggregate table gws_int_r25688051733 -- (ORA-00942: table or view does not exist) (942)
  2. Aggregate operation failed
  3. Can't insert into aggregate table gws_int_r25688051733 -- (ORA-00942: table or view does not exist) (942)

After “nettracker all –clear; nettracker all –update” this changed to ‘No data’

Any idea what we are missing out on ?

 

After several experiments with the logformat and the way the logfile is constructed, finally the parameter in the querystring is being read in as expected (root cause of initial problem remains unclear, though)
Encouraged by this result we have defined a dynamic campaign that is not recognized as such.
Here are some details
log format definition:
<logformat
        format="%CUSTOMDATE Y-M-D H:MI:S%|                %GWSTENANT%|%GWSLANG%|%GWSPRODUCT%|%GWSPORTLET%|%GWSACTION%|%GWSPARAM%|%USERNAME%|%COOKIE%|
                    %HOST%|%STATUS%|%TIMETAKEN%|%BYTES%|
                        %SITE%|%PAGE%|%QUERYSTRING%|
                        %SKIPREQUESTSKIP%|
                        %REFERRER%|
                        %USERAGENT%">
        GWS-Log-V4
</logformat>
 
sample log entry:
2013-08-19 10:23:15|        ru|1|129|bnk_info_MT940|AccountStatement|AccountStatement|demo|JSessionID=E2A51D297459513FA9D2B972D29997F1.gws2str1|
        10.23.99.103|200|100|200000|
        Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; .NET4.0C; .NET4.0E; MS-RTC LM 8; UGIS_AT)
               
campaign definition:           
<campaigns>
        <campaign name="GWSCAMPAIGN" type="dynamic" param="GWSCAMPAIGN" case="mixed">
                <channel name="GWSCHANNEL" ctype="other" type="dynamic" param="GWSCHANNEL" enabledefault="true" default="%NTR_NONE%" other="GWSCHANNEL">
                        <segment name="GWSSEGMENT" type="dynamic" param="GWSSEGMENT" enabledefault="true" default="%NTR_NONE%">
                                <member method="contains">/</member>
                        </segment>
                </channel>
        </campaign>
</campaigns>
 
parameter definitions:
<parameters>
        <parameter type="cookie" case="mixed" store="true" arrayparam="false" coltitle="JSessionID" displayonbr="true" cgidecode="true" associatewith="visit" parameter="jsessionid" name="JSessionID"/>
        <parameter type="field"  case="mixed" store="true" arrayparam="false" coltitle="USERNAME" displayonbr="true" cgidecode="true" associatewith="visit" parameter="username" name="USERNAME"/>
        <parameter type="field"  case="mixed" store="true" arrayparam="false" coltitle="GWSTENANT" displayonbr="true" cgidecode="true" associatewith="visit" parameter="gwstenant" name="GWSTENANT"/>
        <parameter type="field"  case="mixed" store="true" arrayparam="false" coltitle="GWSLANG" displayonbr="true" cgidecode="true" associatewith="visit" parameter="gwslang" name="GWSLANG"/>
        <parameter type="field"  case="mixed" store="true" arrayparam="false" coltitle="GWSPRODUCT" displayonbr="true" cgidecode="true" associatewith="visit" parameter="gwsproduct" name="GWSPRODUCT"/>
        <parameter type="field"  case="mixed" store="true" arrayparam="false" coltitle="GWSPORTLET" displayonbr="true" cgidecode="true" associatewith="view" parameter="gwsportlet" name="GWSPORTLET"/>
        <parameter type="field"  case="mixed" store="true" arrayparam="false" coltitle="GWSACTION" displayonbr="true" cgidecode="true" associatewith="view" parameter="gwsaction" name="GWSACTION"/>
        <parameter type="field"  case="mixed" store="true" arrayparam="false" coltitle="GWSPARAM" displayonbr="true" cgidecode="true" associatewith="view" parameter="gwsparam" name="GWSPARAM"/>
        <parameter type="querystring" case="mixed" store="true" arrayparam="false" coltitle="GWSQUERY" displayonbr="true" cgidecode="true" associatewith="view" parameter="gwsquery" name="GWSQUERY">
                <member method="contains" option="page">/</member>
        </parameter>
</parameters>
Any ideas what goes wrong ?

LogEntry was truncated, here's the full version:

2013-08-19 10:23:15|
    ab|1|129|bnk_info_MT940|AccountStatement|AccountStatement|demo|JSessionID=E2A51D297459513FA9D2B972D29997F1.gws2str1|
    10.23.99.103|200|100|200000|
    http://int.banking.net|/bnk_info_MT940|GWSQUERY=bnk_info&GWSCAMPAIGN=ro&GWSCHANNEL=RBA&GWSSEGMENT=bnk_info|
    GET http://int.banking.net/bnk_info?action=AccountStatement:Account... HTTP/1.0|
    http://int.banking.net|
    Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; .NET4.0C; .NET4.0E; MS-RTC LM 8; X_AT)

I think the forum is breaking some of the fine detail in your posts.

Can you send me a mail with the details (bob dot mitchell at scl dot com) - or upload a file here with the files as plain .txt.

Reply to Discussion

RSS

© 2017   Created by Wendy Ertter.   Powered by

Badges  |  Report an Issue  |  Terms of Service