Cisco Videoscape Distribution Suite Transparent Caching CDR Guide Release 5.6.1 August 2015 CDR Structure Cisco VDS TC generates Cache Detail Records (CDRs) that detail the content that is handled by the system. These records include information on cache in, cache out, and forwarded content. In addition to this information, each HTTP related CDR includes information for its detected service group. The following is a sample CDR record. A description of the parameters in this file are provided in the CDR Parameters section. For more examples, see the CDR Examples section. 19-02-14 13:00:01.829,HTTP,3688F0157F820E4DD3533AE9818773E7DA372C04, 10.201.13.16 , /?Transact ion-Profile=CO_30MB ,SESSION_ENDED,29997220,13,10.103.40.126,50527,10.201.13.16,80,0,0, CACHE_OUT,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,,,,,,,,,,,51DF9719,CDR_EOL Note The ASCII bell character, (hexadecimal value of x'07') differentiates a double quote, beginning or ending a string. Filename The CDR filename follows a predefined naming convention, that indicates the CDR version. Table 1-1 describes the parts of the filename using the filename pang_cdr.log.v43.ce-2.032315_234941.gz as an example. Cisco Systems, Inc. www.cisco.com Cisco has more than 200 offices worldwide. Addresses, phone numbers, and fax numbers are listed on the Cisco website at www.cisco.com/go/offices. Table 1-1 Filename Description Indicator Description pang_cdr.log This text indicates that this file is a CDR file. v43 Identifies the CDR version. In this example, version 4.3. Note This determines the internal structure of the CDR file, which may vary between versions. ce-n Cache engine from which the CDR file originated (n indicates the cache engine number). In the example, this is a file from cache engine 2. 032315_234941 Date and time, indicated by two digits (month, date, year _ hour, minutes, seconds) File Format The format of the CDR file resembles that of the CSV: • All fields are ASCII characters. • Columns are separated by commas. • Nulls are represented by the character 0 (zero) placed between commas. • A bell character () is always printed within the CDR. This is hard coded and cannot be configured to something else. • The line delimiter is new line (\n). CDR Parameters The parameters of the CDR file provide details about the traffic that is handled and delivered by the VDS TC system. Table 1-2 defines the parameters in a CDR record, using the following IPv6 CDR example. The ID # references are not part of the actual CDR record. They have been added to the example to identify the different parameters of the record: 14-05-15 16:00:01.696(ID1),HTTP(ID2),crl.omniroot.com(ID4),/PublicSureServerSV.crl(ID5), FIN(ID6),1448(ID7),0(ID8),41.188.8.175(ID9),52482(ID10),64.18.20.129(ID11),80(ID12), 286(ID13),15(ID14),FORWARD(ID15),0(ID16),286(ID17),0(ID18),0(ID19),0(ID20),0(ID21), 0(ID22),0(ID23),0(ID24),0(ID25),0(ID26),0(ID27),0(ID28),0(ID29),0(ID30),0(ID31), 0(ID32),0(ID33),0(ID34),0(ID35),0(ID36),0(ID37),0(ID38),0(ID39),0(ID40),0(ID41), 1(ID42),1448(ID43),51314(ID44),(ID45),51DF9719(ID46),49999976(ID47),43384832(ID48), 43(ID49),CDR_EOL (ID50) Cisco Videoscape Distribution Suite Transparent Caching CDR Guide 2 OL-32828-02 Table 1-2 CDR Fields ID Name Type Definition Length Nullable Comments 1 Date Time Date This indicates the actual time frame 22 No Format DD-MM-YY HH24:MI:SS.MS. 2 Protocol String 1-10 This is the format that is used for transmitting data from one device to another. No See the Protocol Values table. 3 Hash Hex string The hash is used to generate 40 a unique fixed length data output. This acts as a shortened reference to the original data. Yes E500FDF95C27ACE 5C86068A6BE603A 0-BA857CBBB 4 Host String This is a physical network Up to node that runs both the 256 server and client programs. The host field value from the HTTP Request. Yes This only exists on HTTP and Netflix protocols. For example: xml.alexa.com 5 Request Uri String The HTTP Request - Uri value from the HTTP start line (web address). 6 Session termination reason String The “STR” details possible Variable reasons for session termination. No 7 Transferred bytes Long The transferred byte amount. No 8 Session duration Integer The time measure of a session No Seconds 9 Source IP 4 octets separated by a dot(IPv4) The source IP is the subscriber IP address. No IPv4 or IPv6 source IP addresses. For example,110.100.13. 152 or Up to 1K Yes 16 16 octets separated by a colon (IPv6) For example: /smartart/Text Effects/Texteffect None.swf See the Session Termination Reason table. 0001::2000:0000:000 0:0002:01ce 10 Source port Integer The source port is the subscriber port. 11 Destination IP 4 octets separated by a dot (IPv4) The destination IP is the endpoint IP address of the of the host. No 16 No IPv4 or IPv6 destination IP addresses. 16 octets separated by a colon (IPv6) Cisco Videoscape Distribution Suite Transparent Caching CDR Guide 3 OL-32828-02 Table 1-2 CDR Fields (Continued) ID Name Type Definition Length Nullable Comments 12 Destination port Integer The destination port is the endpoint of the host. No 13 HTTP Service Category ID Integer This is the first category index from the matched HTTP service. This is configured within the Policy Manager. No The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. 14 HTTP Service ID Integer This is the matched HTTP Service index. This is configured within the Policy Manager. No The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. 15 CDR Type String A Cache/Content Data Record field which classifies by type. For more information, see the CDR Types table. No The field classifies the CACHE_OUT, VERIFY and VERIDFY_AT. 16 Application Category ID Integer The matched Application Category index which is configured within the Policy Manager (Application). Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. The Application field provides a high level summary of the content that can be used for reporting and policy creation, such as file sharing and software updates. 17 Service Category ID Integer The matched Service Category Index which is configured within the Policy Manager. Yes The Service Category ID is a legacy configuration based on the policy manager configuration. 18 Internet Side Network Category ID Integer The matched Internet Side Network Category Index which is configured within the Policy Manager. Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. This is associated to a sub-network address. Cisco Videoscape Distribution Suite Transparent Caching CDR Guide 4 OL-32828-02 Table 1-2 CDR Fields (Continued) ID Name Type Definition 19 Subscriber Network Category ID Integer The matched Subscriber Network Category Index which is configured within the Policy Manager. Length Nullable Comments Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. The Subscriber Network is a category used to define the destination IP or subnet of the content. 20 Device Category ID Integer The matched Device Category Index which is configured within the Policy Manager. The User Agent is an HTTP header that specifies the type of browser/ device. 21 HTTP Referrer Category ID (not used, always 0) Integer The matched HTTP Referrer Category Index which is configured within the Policy Manager. Yes This field is not used. The default value of this field is 0. 22 Content Type Integer (MIME) Category ID The matched Content Type (MIME) Category Index which is configured within the Policy Manager. Yes This field is not used. The default value of this field is 0. 23 SmartFilter Category ID The matched SmartFilter Category Index which is configured within the Policy Manager. This is used as a screen to filter/block specific content to the users. Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. 24 Video Stream Integer Bit Rate This contains the video stream bit. Yes 25 Video Stream Integer Resolution This contains the video stream resolution. Yes For YouTube traffic, the rate value is the itag URL parameter value that indicates the video resolution. 26 Bandwidth Policy ID This is a bandwidth policy index. It populates when a Rule with a bandwidth policy is matched. Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. Integer Integer Cisco Videoscape Distribution Suite Transparent Caching CDR Guide 5 OL-32828-02 Table 1-2 CDR Fields (Continued) ID Name Type Definition 27 Admission Policy ID Integer This is an Admission policy index. Length Nullable Comments The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. It populates when a Rule with an Admission policy is matched. This is associated with blocking or re-directing sites. 28 Cache Control Policy ID Integer This is a Cache Control policy index. It populates when a Rule with a Cache Control policy is matched. Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. This policy disables/enables the media cache traffic to be cached in Cisco VDS TC Manager. 29 Webcache Control Policy ID Integer This is a web cache control policy index. It populates when a rule with a web cache control policy is matched. This policy disables the web cache traffic to be cached in Cisco VDS TC Manager. Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. 30 DSCP Policy Integer ID This is a DSCP policy index. It populates when a Rule with a DSCP policy is matched. Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. This policy classifies cache out traffic in DSCP field that exists in the IPv4/IP6 headers. 31 Bandwidth Policy Rule ID Integer This is the matched rule index that applies the bandwidth policy on the current session. Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. 32 Admission Policy Rule ID Integer This is the matched rule index that applies the admission policy on the current session. Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. Cisco Videoscape Distribution Suite Transparent Caching CDR Guide 6 OL-32828-02 Table 1-2 CDR Fields (Continued) ID Name Type Definition Length Nullable Comments 33 Cache Control Policy Rule ID Integer This is the matched rule index which applies the cache control (media cache control) policy on the current session. Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. 34 Web-Cache Control Policy Rule ID Integer This is the matched rule index which applies the webcache control policy on the current session. Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. 35 DSCP Policy Integer Rule ID This is the matched rule index which applies the DSCP policy on the current session. Yes The values can be seen in VDS TC Manager. This field is used by VDS TC Analytics for Traffic Analysis. 36 Cache-In (Number of Requests) Integer This field is used to specify the number of requests cached from in the traffic. Yes This is used in Web-Cache Sessions Only. 37 Cache-In (Number of Bytes) Integer This field is used to specify the number of bytes cached from in the traffic. Yes This is used in Web-Cache Sessions Only. 38 Cache-In (Duration) Integer This field is used to measure the amount of expired time of the incoming cache from the traffic. Yes This is used in Web-Cache Sessions Only. 39 Cache-Out (Number of Requests) Integer This field is used to specify the number of cached -out requests from the traffic. Yes This is used in Web-Cache Sessions Only. 40 Cache-Out (Number of Bytes) Integer This field is used to specify the number of cached -out bytes from the traffic. Yes This is used in Web-Cache Sessions Only. 41 Cache-Out (Duration) Integer This field is used to measure the amount of expired time of the cache -out from the traffic. Yes This is used in Web-Cache Sessions Only. 42 Forward (Number of Requests) Integer The process of forwarding requests directly to the requesting subscriber without caching it. Yes This is used in Web-Cache Sessions Only. Cisco Videoscape Distribution Suite Transparent Caching CDR Guide 7 OL-32828-02 Table 1-2 CDR Fields (Continued) ID Name Type Definition 43 Forward (Number of Bytes) Integer The process of forwarding the number of bytes directly to the requesting subscriber without caching it. Yes This is used in Web-Cache Sessions Only. 44 Forward (Duration) Integer The time expended during the forwarding process. Yes This is used in Web-Cache Sessions Only. 45 Referrer String This is an HTTP header field that identifies the address of the web page linked to the resource being requested. Yes This is used in Web-Cache Sessions Only. 46 HTTP Agent Hash Hex string The HTTP agent hash is used to generate the fixed length output data of the HTTP agent that acts as a shortened reference to the original data. 47 Full File Size Integer Displays available user requested file size in bytes. 48 Cached File Size Displays the amount of bytes cached from the requested user file. 49 Connection_i Integer gnore_reason Displays the reason a connection state changed 50 CDR EOL This is the end of the line for the CDR. Integer String Length Nullable Comments See HTTP Agent Hash section for more information. Yes HTTP Agent Hash There are db files in Cisco VDS TC Release 5.6.1 that contain hash value-to-user agent mappings, such as C75E3DDB, Mozilla/5.0. To determine the user agent that generated the traffic for a CDR entry, you can look up the hash value in field # 46 of the CDR in this db file. Each VDS TC cache engine generates its own hash db file, named http_agents.ce-#.db, where # is the cache engine number. The hash db files for all of the cache engines are automatically copied to the VDS TC management server. Therefore, it is easiest to view these files from the VDS TC management server. Note The size of these db files is limited to a maximum of 10,000 entries. The db files overwrite the least used agents with new entries once a day. To see a list of available hash db files, from the VDS TC management server enter the command /opt/pang/cdrs> ls *db*. After you have the name of a hash db file, to view its contents enter the command more filename. For example: Cisco Videoscape Distribution Suite Transparent Caching CDR Guide 8 OL-32828-02 padmin@mg-1:/opt/pang/cdrs> more http_agents.ce-1.db C75E3DDB, Mozilla/5.0 2898930B, Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.3) Gecko/2008 092417 Firefox/3.0.3 CDA23AB3, Prey/0.5.3 (windows) C5776619, Prey/0.6.0 (windows) 6D4E94E8, Prey/0.6.2 (windows) AB98F1B7, libhttp/1.61 (PlayStation 4) 8C5F7958, libhttp/3.01 (PS Vita) 90CDC52F,$%7BPRODUCT_NAME%7D/1 CFNetwork/548.0.4 Darwin/11.0.0 A8EC6A20,$%7BPRODUCT_NAME%7D/1 CFNetwork/548.1.4 Darwin/11.0.0 37316021,%7BPRODUCT_NAME%7D/1.6.8 CFNetwork/609.1.4 Darwin/13.0.0 F6FFF20B,%7BPRODUCT_NAME%7D/1.6.8 CFNetwork/672.0.8 Darwin/14.0.0 695DB3F6,%D0%92%D0%95%D0%A1%D0%A2%D0%98/3.0.38 CFNetwork/672.0.8 Darwin/14.0.0 F3901CA6,%D0%92%D0%9A%D0%BE%D0%BD%D1%82%D0%B0%D0%BA%D1%82%D0%B5%202/2053 CFNetwo rk/672.0.8 Darwin/14.0.0 516CBC3E,%D0%92%D0%9A%D0%BE%D0%BD%D1%82%D0%B0%D0%BA%D1%82%D0%B5/2124 CFNetwork/6 72.0.8 Darwin/14.0.0 93B32F2E,%D0%9F%D0%BE%D0%B3%D0%BE%D0%B4%D0%B0/1.0 CFNetwork/672.0.2 Darwin/14.0.0 Protocols Table 1-3 lists the CDR protocols that might be referenced in the Protocol field of the CDR. Table 1-3 Protocol Values SNMP ID Field Value Description 1 EDK eDonkey 2 BT BitTorrent 3 GNUTL Gnutella (not supported) 4 ARES Ares 5 HTTP HTTP 6 SILVERLIGHT Silverlight 7 NETFLIX Netflix Session Termination Reason Talbe 1-4 lists the possible reasons that might be displayed in a CDR for session termination. Table 1-4 Session Termination Reason ID Field Value Description 1 SESSION_ENDED Session ended after the entire file is delivered to the downloader. 2 CMDBMISS The request range (in P2P) or file (HTTP) is not in the cache. 3 DOWNLOADER The downloader closed the session. 4 TIMEOUT The session timed out. Cisco Videoscape Distribution Suite Transparent Caching CDR Guide 9 OL-32828-02 Table 1-4 Session Termination Reason ID Field Value Description 5 ERROR An error occurred serving the session. 6 RST One of the sides reset the connection. 7 FIN The connection terminated normally. 8 UPLOADER The uploader closed the session. 9 UNKNOWN None of the above reasons. 10 FORMAT_CHANGED A change of the speed rate for Silverlight traffic. CDR Types Table 1-5 lists the different CDR types that may appear in the CDR Type field of the CDR. Table 1-5 CDR Types ID Field Value Description 1 CACHE_OUT Associated with cache out. 2 CACHE_IN A cache in transaction. 3 FORWARD A forward transaction. 4 VERIFY File verification process occurs upon first time file access. 5 VERIFY_AT This is a verification session that was not completed due to RST or TCP connection time-out from the client or server. CDR Examples CDR Type Examples Note For your reference, the CDR type is noted in bold. CACHE_OUT 14-05-15 15:58:32.000,HTTP,9D8542B1D54BEC17435272B7F6507A76F06B8B2D,10.201.19.11,/?Transaction-Pro file=CO_5MB,SESSION_ENDED,9997236,6,10.109.55.7,54090,10.201.19.11,80,0,0,CACHE_OUT,0,0,0 ,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,,,,,,,,,,,51DF9719,10000000,10000000,6,CDR_EOL Cisco Videoscape Distribution Suite Transparent Caching CDR Guide 10 OL-32828-02 CACHE_IN 13-04-15 20:52:59.593,HTTP,6EA3B731244E5EF05D971F074D056923F09DC915,tp.akam.nflximg.com,/tpa3/690/ 424235690.bif,TIMEOUT,2508772,31,10.10.1.2,61128,63.80.4.66,80,0,0,CACHE_IN,0,0,0,0,335,0 ,0,0,0,0,0,0,0,0,0,0,0,0,0,0,,,,,,,,,,,51DF9719,2508772,2508772,6,CDR_EOL FORWARD 14-05-15 15:58:33.015,HTTP,9E0E23311E296BE2CCC2C1A293EC7897D61F35F4,10.201.22.6,/?Transaction-Prof ile=CI_30MB,FIN,30000106,16,10.112.171.5,12936,10.201.22.6,80,0,0,FORWARD,0,0,0,0,0,0,0,0 ,0,0,0,0,0,0,0,0,0,0,0,0,,,,,,,,,,,51DF9719,29999990,9802343,43,CDR_EOL VERIFY 26-07-15 10:05:21.417,HTTP,37264C5938EC3764E0DC079D55F19597D27ABD47,^G10.201.24.8^G,^G/?Transactio n-Profile=CI_30MB^G,SESSION_ENDED,30999916,1,10.114.0.2,19595,10.201.24.8,80,0,0,VERIFY,0 ,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,,,,,,,,,,,00000000,30999916,,6,CDR_EOL VERIFY_AT 13-04-15 21:40:01.586,HTTP,3582B7CF0BD06219A62BE289F10A56E997EF4A90,tp.akam.nflximg.com,/tpa3/886/ 424236886.bif,TIMEOUT,1513000,31,10.10.1.2,61343,63.80.4.80,80,0,0,VERIFY_AT,0,0,0,0,335, 0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,,,,,,,,,,,51DF9719,1513000,,6,CDR_EOL CDR Protocol Examples Note For your reference, the CDR protocol is noted in bold. Note BitTorrent traffic will have a CDR type of CACHE_OUT. BitTorrent 09-03-14 09:00:49.678,BT,551C93A31984EF42EA495AA5BBD884840F7797E0,,,DOWNLOADER,12494514,19,83.223. 186.231,49758,89.109.103.108,46765,0,0,CACHE_OUT,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0, ,,,,,,,,,,51DF9719,,,43,CDR_EOL Note A termination code of TIMEOUT is normal for BitTorrent traffic. This is because the subscriber will open many TCP sessions to peers to receive different “chunks” of the file. After the file is finished downloading, some TCP connections may remain open until the TCP session times out because of no activity. Cisco Videoscape Distribution Suite Transparent Caching CDR Guide 11 OL-32828-02 29-11-14 15:57:27.826,BT,32D1BE7B9A74745CB3086E44EFC2233F458C9F51,,,TIMEOUT,0,32,201.73.175.82, 14333,79.51.48.145,62982,0,0,CACHE_OUT,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,,,,,,,,,,, 00000000,,,,CDR_EOL Note A termination code of CMDBMISS is also normal for BitTorrent traffic. This is because the subscriber will open many TCP sessions to peers to receive different “chunks” of the file and the requested port range for the additional chunks are not in cache. 29-11-14 15:57:31.156,BT,32D1BE7B9A74745CB3086E44EFC2233F458C9F51,,,CMDBMISS,0,4,201.73.175.82, 54365,89.120.234.16,25332,0,0,CACHE_OUT,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,,,,,,,,,, ,00000000,,,,CDR_EOL HTTP 14-05-15 16:00:02.375,HTTP,A82BFC17BF7E6501BB08F0C8593114A15DCAFC80,10.201.15.26,/?Transaction-Pro file=FWD_50MB,FIN,49999975,22,10.105.163.139,55304,10.201.15.26,80,0,0,FORWARD,0,0,0,0,0, 0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,,,,,,,,,,,51DF9719,,,43,CDR_EOL YouTube Videoplayback Example 09-03-14 12:29:48.368,HTTP,6A53245078C7C58D823FF3ADAF5D1D8700000000,r7---sn-nhpaxua8l.googlevideo. com,/videoplayback?fexp=933508%2C937502%2C919319%2C914005%2C916611%2C901448%2C936912%2C93 6910%2C907231&id=0a819c53dad07035&burst=40&sver=3&ipbits=0&ip=77.127.74.78&gir=yes&signat ure=801E94AAE7BD46CCB83263FA6916EBA75D91635E.6EF2DE834FAC0A520C0D9788C4643D1DE2D5400D&mt= 1384433429&mv=m&itag=135&ms=au&upn=22eThQPTKt0&sparams=algorithm%2Cburst%2Cclen%2Cdur%2Cf actor%2Cgir%2Cid%2Cip%2Cipbits%2Citag%2Clmt%2Csource%2Cupn%2Cexpire&expire=1384454308&cle n=1448385&algorithm=throttlefactor&factor=1.25&source=youtube&dur=15.108&lmt=138436144077 0122&key=yt5&ratebypass=yes,SESSION_ENDED,1187617,4,10.200.5.1,63451,212.199.205.210,80,5 4,7,CACHE_OUT,0,54,0,0,143,0,0,0,749,135,16,0,0,0,0,8,8,8,8,8,,,,,,,,,,,51DF9719,,,43,CDR _EOL Cisco Videoscape Distribution Suite Transparent Caching CDR Guide 12 OL-32828-02
© Copyright 2026 Paperzz