From a8374507caa9c4e9279c30181b1983be1184c52a Mon Sep 17 00:00:00 2001 From: julien Date: Sun, 5 Feb 2012 23:10:09 +0100 Subject: [PATCH 01/76] spec 0.4 as seen by Julien --- pubsubhubbub-core.xml | 575 +++++++++--------------------------------- 1 file changed, 122 insertions(+), 453 deletions(-) diff --git a/pubsubhubbub-core.xml b/pubsubhubbub-core.xml index 0d27bb7..410835d 100644 --- a/pubsubhubbub-core.xml +++ b/pubsubhubbub-core.xml @@ -28,7 +28,7 @@ - PubSubHubbub Core 0.3 -- Working Draft + PubSubHubbub Core 0.4 -- Working Draft Google, Inc @@ -53,14 +53,20 @@ mart@degeneration.co.uk + + + Notifixious Inc. - +
+ julien@superfeedr.com +
+ + + - An open, simple, web-scale pubsub protocol, along with an open source - reference implentation targetting Google App Engine. Notably, however, - nothing in the protocol is centralized, or Google- or App - Engine-specific. Anybody can play. + An open, simple, web-scale and decentralized pubsub protocol. + Anybody can play. As opposed to more developed (and more complex) pubsub specs like Jabber Publish-Subscribe this spec's base profile @@ -93,25 +99,17 @@
- An Atom or RSS feed URL. The - unit to which one can subscribe to changes. This spec currently only - addresses feed URLs that require no additional authorization - headers. + An HTTP resource URL. The + unit to which one can subscribe to changes. The server (URL) which implements both sides of this - protocol. We have implemented this and are running a server at - http://pubsubhubbub.appspot.com that is, at least for now, open - to anybody for use, as either a publisher or subscriber. Any hub MAY - implement its own policies on who can use it. + protocol. Any hub MAY implement its own policies on who can use it. An owner of a topic. Notifies the hub when - the topic feed has been updated. It just notifies that it has been updated, but not how. As in almost all - pubsub systems, the publisher is unaware of the subscribers, if any. - Other pubsub systems might call the publisher the "source". + the topic feed has been updated. As in almost all pubsub systems, the + publisher is unaware of the subscribers, if any. Other pubsub systems + might call the publisher the "source". An entity (person or program) that wants to be notified of changes on a topic. The subscriber must be @@ -136,17 +134,9 @@ sending out notifications to subscribers. A payload describing how a topic's - contents have changed. This difference (or "delta") is computed by the - hub and sent to all subscribers. The format of the notification will - be an Atom or RSS feed served by the publisher with only those entries - present which are new or have changed. The notification can be the - result of a publisher telling the hub of an update, or the hub - proactively polling a topic feed, perhaps for a subscriber subscribing - to a topic that's not pubsub-aware. Note also that a notification to a - subscriber can be a payload consisting of updates for multiple topics. - Hubs MAY choose to send multi-topic notifications as an optimization - for heavy subscribers, but subscribers MUST understand them. See for format details. + contents have changed, or the full cupdated content. + Depending on the topic's content type, the difference (or "delta") may be + computed by the hub and sent to all subscribers.
@@ -154,7 +144,7 @@ (This section is non-normative.) - Publishers POST a ping to their hub(s) URLs when their topic(s) + Publishers notify their hub(s) URLs when their topic(s) change. Subscribers POST to one or more of the advertised hubs for a @@ -168,133 +158,38 @@ delta, it enqueues a notification to all registered subscribers. - -
- Notification and source formats will be Atom or RSS. The - Publisher makes the decision as to include full body, truncated body, or - meta data of most recent event(s). One of: - - - URL + metadata - - URL + metadata + truncated - - URL + metadata + full - - - The trade-off between including all content in outgoing notifications - or having the thundering herd (by clients who fetch the //atom:feed/entry/link in response to a notification) - is up to the publisher. Entries of the most recent events (for recipient - to know whether or not they'd missed any recent items-- like TCP SACK) MAY - be provided as context. Some examples of Atom feed entries follow. - -
- - - - - - - 2008-08-11T02:15:01Z - - - - Heathcliff - - http://publisher.example.com/happycat25.xml - 2008-08-11T02:15:01Z - - What a happy cat. Full content goes here. - - - - - - Heathcliff - - http://publisher.example.com/happycat25.xml - 2008-08-11T02:15:01Z - - What a happy cat! - - - - - - Garfield - - http://publisher.example.com/happycat25.xml - 2008-08-11T02:15:01Z - - - - - Nermal - - http://publisher.example.com/happycat25.xml - 2008-07-10T12:28:13Z - - - -]]> -
-
- A potential subscriber initiates discovery by retrieving the feed to - which it wants to subscribe. A feed that acts as a topic as per this - specification MUST publish, as a child of //atom:feed or //rss:rss/channel , an atom:link element whose rel attribute has the value hub and whose href - attribute contains the hub's endpoint URL. Feeds MAY contain multiple - atom:link[@rel="hub"] elements if the - publisher wishes to notify multiple hubs. When a potential subscriber - encounters one or more such links, that subscriber MAY subscribe to the - feed using one or more hubs URLs as described in . + A potential subscriber initiates discovery by retrieving the topic to + which it wants to subscribe. The HTTP response from the publisher MUST + include at least one X-Hub-Url + HTTP header, as well as exactly one X-Hub-Self-Url + HTTP header. The X-Hub-Url MUST + indicate the exact url of the PubSubHubbub hub designated by the publisher. + If more than one url is specified, it is expected that the publisher pings each + of these urls, so the subscriber may subscribe to one or more of these. + The X-Hub-Self-Url will point to the + permanent URL for the resource being polled. Example: -
- - - - - - .... - - .... - - - .... - - -]]>
- - Hubs MUST use the same URL for both the publishing and subscribing - interfaces, which is why only a single atom:link - element is required to declare a hub. Publishers SHOULD use HTTPS in their hubs' discovery URLs. However, - subscribers that do not support HTTPS MAY + Hubs should provide an HTTPS interface and publishers + SHOULD use HTTPS in their hubs' discovery URLs. + However, subscribers that do not support HTTPS MAY try to fallback to HTTP, which MAY work - depending on the hub's policy. + depending on the hub's policy. If the advertised url is HTTP, + subscriber MAY choose to try HTTPS first.
- Subscribing to a topic URL consists of three parts that may occur + Subscribing to a topic URL consists of four parts that may occur immediately in sequence or have a delay. Requesting a subscription using the hub Confirming the subscription was actually desired + Receiving an acknowledgement from the hub that the subscription was accepted (OPTIONAL). Periodically reconfirming the subscription is still active @@ -302,15 +197,17 @@ changed to indicate the desire to unsubscribe.
- Subscription is initiated by the subscriber making an HTTP POST request to the hub URL. This request + Subscription is initiated by the subscriber making an HTTPS + or HTTP POST request to the hub URL. This request has a Content-Type of application/x-www-form-urlencoded (described in Section 17.13.4 of ) and the following parameters in its body: - REQUIRED. The subscriber's callback URL where notifications should be delivered. + REQUIRED. The subscriber's callback URL + where notifications should be delivered. The subscriber's + callback URL SHOULD be unique for each subscription. REQUIRED. The literal string "subscribe" or "unsubscribe", depending on the goal of the request. @@ -318,10 +215,6 @@ REQUIRED. The topic URL that the subscriber wishes to subscribe to. - REQUIRED. Keyword describing verification - modes supported by this subscriber, as described below. This - parameter may be repeated to indicate multiple supported modes. - OPTIONAL. Number of seconds for which the subscriber would like to have the subscription active. If not present or an empty value, the subscription will be permanent @@ -339,32 +232,8 @@ the request was made over HTTPS. This parameter MUST be less than 200 bytes in length. - OPTIONAL. A subscriber-provided - opaque token that will be echoed back in the verification request to - assist the subscriber in identifying which subscription request is - being verified. If this is not included, no token will be included - in the verification request. - - - - The following keywords are supported for hub.verify: - - - The subscriber supports synchronous - verification, where the verification request must occur before the - subscription request's HTTP response is returned. - - The subscriber supports asynchronous - verification, where the verification request may occur at a later - point after the subscription request has returned. - Where repeated keywords are used, their order indicates the - subscriber's order of preference. Subscribers MUST use at least one of - the modes indicated in the list above, but MAY include additional - keywords defined by extension specifications. Hubs MUST ignore verify - mode keywords that they do not understand. - Hubs MUST ignore additional request parameters they do not understand. @@ -379,14 +248,14 @@
- The topic and callback URLs MUST NOT contain an anchor fragment. - These URLs MAY use HTTP or HTTPS schemes. These URLs MAY have port - numbers specified; however, hubs MAY choose to disallow certain ports - based on their own policies (e.g., security) and return errors for - these requests. The topic URL can otherwise be free-form following - the URI spec. Hubs MUST always decode - non-reserved characters for these URL parameters; see section 2.4 on + The topic and callback URLs MAY use HTTP + or HTTPS schemes. The topic URL MUST + be the one advertised by the publisher in the X-Hub-Self-Url + Header during the discovery phase. (See ). + Hubs MAY refuse subscriptions if the topic url does not correspond to the one + advertised by the publisher. The topic URL can otherwise be free-form + following the URI spec. Hubs MUST always + decode non-reserved characters for these URL parameters; see section 2.4 on "When to Encode or Decode" in the URI spec. @@ -403,35 +272,24 @@ Subscribers MAY choose to use HTTPS for their callback URLs if they care about the privacy of - notifications as they come over the wire from the Hub. The use of - mechanisms (such as XML signatures) to verify the integrity of - notifications coming from the original publisher is out of the scope - of this specification. + notifications as they come over the wire from the Hub (see )
- - The hub MUST respond to a subscription request with an HTTP 204 "No - Content" response to indicate that the request was verified and that - the subscription is active. If the subscription has yet to be verified - (i.e., the hub is using asynchronous verification), the hub MUST - respond with a 202 "Accepted" code. - + + The hub MUST respond to a subscription request with an HTTP 202 "Accepted" + response to indicate that the request was received and will now + be verified () and validated () by the hub. The hub SHOULD perform the + verification of intent as soon as possible. + If a hub finds any errors in the subscription request, an appropriate HTTP error response code (4xx or 5xx) MUST be returned. In the event of an error, hubs SHOULD return a description of the error in the response body as plain text. Hubs MAY decide to reject some callback URLs or topic URLs based on their own policies (e.g., domain authorization, topic URL port numbers). - - In synchronous mode, the verification () MUST be completed before the hub returns a - response. In asynchronous mode, the verification MAY be deferred until - a later time. This is useful to enable hubs to defer work; this could - allow them to alleviate servers under heavy load or do verification - work in batches. -
@@ -467,43 +325,24 @@ present for unsubscribe requests and MUST be ignored by subscribers during unsubscription. - OPTIONAL. The subscriber-provided - opaque token from the corresponding subscription request, if one was - provided. -
The subscriber MUST confirm that the hub.topic - and hub.verify_token correspond - to a pending subscription or unsubscription that it wishes to carry - out. If so, the subscriber MUST respond with an HTTP success (2xx) - code with a response body equal to the correspond to a pending subscription or unsubscription that it + wishes to carry out. If so, the subscriber MUST respond with an HTTP + success (2xx) code with a response body equal to the hub.challenge parameter. If the subscriber does not agree with the action, the subscriber MUST respond with a 404 "Not Found" response. - For synchronous verification, the hub MUST consider other server - response codes (3xx, 4xx, 5xx) to mean that the verification request - has immediately failed and no retries should occur. If the subscriber + The hub MUST consider other server response codes (3xx, 4xx, 5xx) + to mean that the verification request has failed. If the subscriber returns an HTTP success (2xx) but the content body does not match the hub.challenge parameter, the hub MUST also consider verification to have failed. - - For asynchronous verification, the hub MUST consider other server - response codes (3xx, 4xx, and 5xx) to mean that the subscription - action was temporarily not verified. If - the subscriber returns an HTTP success (2xx) but the content body does - not match the hub.challenge parameter, the - hub MUST consider this to be a temporary - failure and retry. The hub SHOULD retry verification a reasonable - number of times over the course of a longer time period (e.g., 6 - hours) until a definite acknowledgement (positive or negative) is - received. If a definite response still cannot be determined after this - retry period, the subscription action verification MUST be abandoned, - leaving the previous subscription state. - + Hubs MAY make the hub.lease_seconds equal to the period the subscriber passed in their subscription request but MAY change the value depending on the hub's policies. To @@ -516,7 +355,42 @@ target="autorefresh">automatic subscription refreshing.
- + +
+ Subscriptions MAY be validated by the Hubs who may require + more details to accept or refuse a subscription. The Hub MAY also + check with the publisher whether the subscription should be accepted. + + If (and when), the subscription has been accepted, + the hub MUST indicate it to the subscriber by performing a notification + of the current state of the resource to the subscriber (see ). + (this is optional in synchronous mode). The subscriber will use this has + an indication that its subscription has been confirmed. + + Additionally, this notification MUST include a X-Hub-Self-Url + HTTP header which indicates to the subscriber to what feed he has been subscribed. + This feed url MAY be different from the feed for which the subscriber has initially subscribed, + as the publisher MAY have considered that this one was better suited for the subscriber. + (This is specifically useful in the context of private content with limited distribution.) + + If (and when), the subscription is denied, the hub will inform the subscriber + by sending an HTTP GET request to the subscriber's + callback URL as given in the subscription request. This request has the following + query string arguments appended (format described in Section 17.13.4 of + ): + + REQUIRED. The literal string "denied". + REQUIRED. The topic URL given in the corresponding + subscription request. + OPTIONAL. The hub may include a reason + for which the subscription has been denied. + + + The subscription may be intentionally denied by the hub at any point (even + if it was previously accepted). The Subscriber SHOULD then consider that + the subscription is not possible anymore. + +
@@ -527,8 +401,8 @@ by sending the subscriber a verification request with hub.mode equal to subscribe. This request MUST match the original verification request - sent to the subscriber (but with a new hub.challenge). + sent to the subscriber (but with a new hub.challenge + ). The response codes returned by the subscriber MUST be interpreted the same way as during a subscriber-initiated verification flow. However, @@ -556,107 +430,21 @@ The publisher MUST inform the hub it previously designated when a topic has been updated. The hub and the publisher CAN agree on any mechanism, as long as the hub is eventually able send the updated payload to the - subscribers. The following sub-sections ( and - ) illustrate a default mechanism that SHOULD be implemented when by - Hub and the Publisher. - -
- When new content is added to a feed, a notification is sent to - the hub by the publisher. The hub MUST accept a POST request to - the hub URL containing the notification. This request MUST have a - Content-Type of application/x-www-form-urlencoded - (described in Section 17.13.4 of ) and the following parameters in - its body: - - - REQUIRED. The literal string "publish". - - REQUIRED. The topic URL of the topic that - has been updated. This field may be repeated to indicate multiple - topics that have been updated. - - - The new content notification is a signal to the hub that there is new - content available. The hub SHOULD arrange for a content fetch request - () to be performed in the near future - to retrieve the new content. If the notification was acceptable, the hub - MUST return a 204 No Content response. If the notification is not - acceptable for some reason, the hub MUST return an appropriate HTTP - error response code (4xx and 5xx). Hubs MUST return a 204 No Content - response even when they do not have any subscribers for all of the - specified topic URLs. -
- -
- When the hub wishes to retrieve new content for a topic, the hub - sends an HTTP GET request to the topic - URL. The hub MUST follow HTTP redirects. The Hub SHOULD use best - practices for caching headers in its requests (e.g., If-None-Match, If-Modified-Since). - - The request SHOULD include the header field User-Agent in the form expected by HTTP. The header MAY have one or more additional - suffixes like (example.com; 20 subscribers) - to indicate the number of subscriptions the hub has active for this - topic. - - If present, the first suffix MUST indicate the total number of - subscriptions the hub has aggregated across all subscriber domains by - means of the X-Hub-On-Behalf-Of header - (). Any additional suffixes - indicate a breakdown of subscriber counts across subscriber domains. - This allows content publishers to distinguish the source of their - subscriber counts and mitigate subscriber count spam. An example header - could be (ignoring line-wrapping): - -
- -User-Agent: MyHub (+http://hub.example.com; 26 subscribers) - (sub.example.com; 4 subscribers) - (other-sub.example.com; 22 subscribers) - -
- - If, after a content fetch, the hub determines that the topic feed - content has changed, the hub MUST send information about the changes to - each of the subscribers to the topic (). Hubs MUST consider new feed - entries, updated entries, or changes to the surrounding feed document as - significant content changes that require content distribution. - -
+ subscribers. +
A content distribution request is an HTTP POST request from hub to the subscriber's - callback URL with the list of new and changed entries. This request MUST - have a Content-Type of application/atom+xml when the request body is an - Atom feed document, or a Content-Type of application/rss+xml when the request body is an - RSS feed document. The behavior for other - content types is not yet defined. Hubs MAY transform the content type - and request body as desired (e.g., for language translation). - - If the document represents a single feed being replicated for the - subscriber, then the feed-level elements SHOULD be preserved aside from - the atom:entry or rss:item elements. However, the atom:id element MUST be reproduced exactly. The - other atom:updated and atom:title elements required by the Atom - specification SHOULD be present. Each atom:entry or rss:item - element in the feed contains the content from an entry in the single - topic that the subscriber has an active subscription for. Essentially, - in the single feed case the subscriber will receive a feed document - that looks like the original but with old content removed. + callback URL with the payload of the notification. This request MUST + have a Content-Type corresponding to the + type of the topic. The hub MAY reduce the payload to a diff if its format + allows it. + + The POST request must include a X-Hub-Self-Url + and a X-Hub-Url HTTP headers that correspond + to topic's url, as well as hub. The successful response from the subscriber's callback URL MUST be an HTTP success (2xx) code. The hub MUST consider all other subscriber @@ -669,17 +457,6 @@ User-Agent: MyHub (+http://hub.example.com; 26 subscribers) receipt of the message, not acknowledgment that it was successfully processed by the subscriber. - The subscriber's callback response MAY include the header field - X-Hub-On-Behalf-Of with an integer value, - possibly approximate, representing the number of subscribers on behalf - of which this feed notification was delivered. This value SHOULD be - aggregated by the hub across all subscribers and used to provide the - subscriber counts in the User-Agent header - field sent to publishers (). Hubs MAY - ignore or respect X-Hub-On-Behalf-Of values - from subscribers depending on their own policies (i.e., to prevent - spam). -
@@ -702,125 +479,17 @@ User-Agent: MyHub (+http://hub.example.com; 26 subscribers) same method as the hub. If the signature does not match, subscribers MUST still return a 2xx success response to acknowledge receipt, but locally ignore the message as invalid. Using this technique along with - HTTPS for subscription requests enables simple subscribers to receive - authenticated content delivery from hubs without the need for - subscribers to run an HTTPS server. - -
+ HTTPS for subscription requests enables + simple subscribers to receive authenticated content delivery from hubs + without the need for subscribers to run an HTTPS server. + + Please note however that this signature only ensures that the payload + was not forged. Since the notification also includes headers, these should + not be considered as safe by the subscriber, unless of course the subscriber + uses HTTPS callbacks. -
- - For Atom feeds only. Pending further review. - - When a subscriber indicates the same callback URL is used for - multiple subscriptions, hubs MAY choose to combine content delivery - requests into a single payload containing an aggregated set of feeds. - This bulk delivery results in fewer requests and more efficient - distribution. If the subscriber indicated a hub.secret value for these overlapping - subscriptions, the secret MUST also be the same for all subscriptions. - This allows the hub to generate a single X-Hub-Signature header to sign the entire payload. - Hubs MUST return an error response (4xx, 5xx) for subscription - requests with overlapping callback URLs and different secret values. - - - With an aggregated set of feeds, the hub SHOULD reproduce all of the - elements from the source feed inside the - corresponding atom:entry in the content - distribution request by using an atom:source - element. However, the atom:id value MUST be - reproduced exactly within the source element. If the source entry does - not have an atom:source element, the hub - MUST create an atom:source element - containing the atom:id element. The hub - SHOULD also include the atom:title element - and an atom:link element with rel="self" values that are functionally - equivalent to the corresponding elements in the original topic feed. - - Example aggregated feed: - -
- - - Aggregated feed - 2008-08-11T02:17:44Z - http://myhub.example.com/aggregated?1232427842-39823 - - - - http://www.example.com/foo - - - Mr. Bar - - - Testing Foo - - http://publisher.example.com/foo24.xml - 2008-08-11T02:15:01Z - - This is some content from the user named foo. - - - - - - http://www.example.com/bar - - - Mr. Bar - - - Testing Bar - - http://publisher.example.com/bar18.xml - 2008-08-11T02:17:44Z - - Some data from the user named bar. - - - - -]]> -
- -
- - -
- (This section is non-normative.) -
- The vast majority of feeds on the web have multiple variants that contain essentially the same content - but appear on different URLs. A common set of variants is http://example.com/feed?format=atom and http://example.com/feed?format=rss. In practice, - these URLs also fail to set their //atom:feed/link[@rel="self"] values properly, - meaning it's difficult for subscribers to discover which feed URL they - truly wanted. Making matters worse, feeds often have redirects - (temporary or permanent) to new hosting locations, analytics providers, - or other feed-processors. To solve this, it's important for Hub - implementations to determine feed URL equivalences using heuristics. - Examples: follow all feed URLs redirects and see if they end up at the - same location; use overlaps in feed HTML alternate links; use the atom:id value across all domains. This specific - problem is considered out of scope of this specification but this - section is meant as a reminder to implementors that feed URL aliasing is - an important issue that hubs should address instead of putting - the burden on publishers and subscribers.
-
- The hub.verify_token parameter in - subscription requests enables subscribers to verify the identity and - intent of the hub making the verification request. Subscribers should - use the token to retrieve internal state to ensure the subscription - request outcome is what they intended. -
From 049463165696e0497194dc194aa67bfe09cd6fc1 Mon Sep 17 00:00:00 2001 From: julien Date: Sun, 5 Feb 2012 23:11:52 +0100 Subject: [PATCH 02/76] usiing the 0.4.xml --- pubsubhubbub-core-0.4.xml | 706 ++++++++++++++++++++++++++++++++++++++ pubsubhubbub-core.xml | 578 ++++++++++++++++++++++++------- 2 files changed, 1159 insertions(+), 125 deletions(-) create mode 100644 pubsubhubbub-core-0.4.xml diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml new file mode 100644 index 0000000..410835d --- /dev/null +++ b/pubsubhubbub-core-0.4.xml @@ -0,0 +1,706 @@ + + + + + + + + + + + + + + + + + + + + + PubSubHubbub Core 0.4 -- Working Draft + + + Google, Inc + +
+ brad@danga.com +
+ + + + Google, Inc + +
+ bslatkin@gmail.com +
+ + + + Six Apart Ltd. + +
+ mart@degeneration.co.uk +
+ + + + Notifixious Inc. + +
+ julien@superfeedr.com +
+ + + + + + An open, simple, web-scale and decentralized pubsub protocol. + Anybody can play. + + As opposed to more developed (and more complex) pubsub specs like Jabber Publish-Subscribe this spec's base profile + (the barrier-to-entry to speak it) is dead simple. The fancy bits required + for high-volume publishers and subscribers are optional. The base profile + is HTTP-based, as opposed to XMPP (see more on this below). + + To dramatically simplify this spec in several places where we had to + choose between supporting A or B, we took it upon ourselves to say "only + A", rather than making it an implementation decision. + + We offer this spec in hopes that it fills a need or at least advances + the state of the discussion in the pubsub space. Polling sucks. We think + a decentralized pubsub layer is a fundamental, missing layer in the + Internet architecture today and its existence, more than just enabling + the obvious lower latency feed readers, would enable many cool + applications, most of which we can't even imagine. But we're looking + forward to decentralized social networking. + + + + +
+ The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", + "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this + document are to be interpreted as described in . Domain name examples use . +
+ +
+ + An HTTP resource URL. The + unit to which one can subscribe to changes. + + The server (URL) which implements both sides of this + protocol. Any hub MAY implement its own policies on who can use it. + + An owner of a topic. Notifies the hub when + the topic feed has been updated. As in almost all pubsub systems, the + publisher is unaware of the subscribers, if any. Other pubsub systems + might call the publisher the "source". + + An entity (person or program) that wants + to be notified of changes on a topic. The subscriber must be + directly network-accessible and is identified by its Subscriber + Callback URL. + + A unique relation to a topic by a + subscriber that indicates it should receive updates for that topic. A + subscription's unique key is the tuple (Topic URL, Subscriber Callback + URL). Subscriptions may (at the hub's decision) have expiration times + akin to DHCP leases which must be periodically renewed. + + The URL at which a subscriber wishes to receive + notifications. + + An event that causes updates to multiple topics. + For each event that happens (e.g. "Brad posted to the Linux + Community."), multiple topics could be affected (e.g. "Brad posted." + and "Linux community has new post"). Publisher events cause topics to + be updated and the hub looks up all subscriptions for affected topics, + sending out notifications to subscribers. + + A payload describing how a topic's + contents have changed, or the full cupdated content. + Depending on the topic's content type, the difference (or "delta") may be + computed by the hub and sent to all subscribers. + +
+ +
+ (This section is non-normative.) + + + Publishers notify their hub(s) URLs when their topic(s) + change. + + Subscribers POST to one or more of the advertised hubs for a + topic they're interested in. Alternatively, some hubs may offer + auto-polling capability, to let {their,any} subscribers subscribe to + topics which don't advertise a hub. + + The hub caches minimal metadata (id, data, entry digest) about + each topic's previous state. When the hub re-fetches a topic feed (on + its own initiative or as a result of a publisher's ping) and finds a + delta, it enqueues a notification to all registered subscribers. + +
+ + +
+ A potential subscriber initiates discovery by retrieving the topic to + which it wants to subscribe. The HTTP response from the publisher MUST + include at least one X-Hub-Url + HTTP header, as well as exactly one X-Hub-Self-Url + HTTP header. The X-Hub-Url MUST + indicate the exact url of the PubSubHubbub hub designated by the publisher. + If more than one url is specified, it is expected that the publisher pings each + of these urls, so the subscriber may subscribe to one or more of these. + The X-Hub-Self-Url will point to the + permanent URL for the resource being polled. + + Example: + + Hubs should provide an HTTPS interface and publishers + SHOULD use HTTPS in their hubs' discovery URLs. + However, subscribers that do not support HTTPS MAY + try to fallback to HTTP, which MAY work + depending on the hub's policy. If the advertised url is HTTP, + subscriber MAY choose to try HTTPS first. + +
+ +
+ Subscribing to a topic URL consists of four parts that may occur + immediately in sequence or have a delay. + + Requesting a subscription using the hub + Confirming the subscription was actually desired + Receiving an acknowledgement from the hub that the subscription was accepted (OPTIONAL). + Periodically reconfirming the subscription is still active + + + Unsubscribing works in the same way, except with a single parameter + changed to indicate the desire to unsubscribe. + +
+ Subscription is initiated by the subscriber making an HTTPS + or HTTP POST request to the hub URL. This request + has a Content-Type of application/x-www-form-urlencoded (described in + Section 17.13.4 of ) and the + following parameters in its body: + + + REQUIRED. The subscriber's callback URL + where notifications should be delivered. The subscriber's + callback URL SHOULD be unique for each subscription. + + REQUIRED. The literal string "subscribe" or + "unsubscribe", depending on the goal of the request. + + REQUIRED. The topic URL that the subscriber + wishes to subscribe to. + + OPTIONAL. Number of seconds for + which the subscriber would like to have the subscription active. If + not present or an empty value, the subscription will be permanent + (or active until automatic + refreshing removes the subscription). Hubs MAY choose to + respect this value or not, depending on their own policies. This + parameter MAY be present for unsubscription requests and MUST be + ignored by the hub in that case. + + OPTIONAL. A subscriber-provided secret + string that will be used to compute an HMAC digest for authorized content distribution. If not + supplied, the HMAC digest will not be present for content + distribution requests. This parameter SHOULD only be specified when + the request was made over HTTPS. This + parameter MUST be less than 200 bytes in length. + + + + Hubs MUST ignore additional request parameters they do not + understand. + + Hubs MUST allow subscribers to re-request subscriptions that are + already activate. Each subsequent request to a hub to subscribe or + unsubscribe MUST override the previous subscription state for a + specific topic URL and callback URL combination once the action is + verified. Any failures to confirm the subscription action MUST leave + the subscription state unchanged. This is required so subscribers can + renew their subscriptions before the lease seconds period is over + without any interruption. + +
+ + The topic and callback URLs MAY use HTTP + or HTTPS schemes. The topic URL MUST + be the one advertised by the publisher in the X-Hub-Self-Url + Header during the discovery phase. (See ). + Hubs MAY refuse subscriptions if the topic url does not correspond to the one + advertised by the publisher. The topic URL can otherwise be free-form + following the URI spec. Hubs MUST always + decode non-reserved characters for these URL parameters; see section 2.4 on + "When to Encode or Decode" in the URI spec. + + The callback URL MAY contain arbitrary query string parameters + (e.g., ?foo=bar&red=fish). Hubs MUST + preserve the query string during subscription verification by + appending new parameters to the end of the list using the & (ampersand) character to join. Existing + parameters with names that overlap with those used by verification + requests will not be overwritten; Hubs MUST only append verification + parameters to the existing list, if any. For event notification, the + callback URL will be POSTed to including any query-string parameters + in the URL portion of the request, not as POST body parameters. + + Subscribers MAY choose to use HTTPS + for their callback URLs if they care about the privacy of + notifications as they come over the wire from the Hub (see ) + +
+ +
+ + The hub MUST respond to a subscription request with an HTTP 202 "Accepted" + response to indicate that the request was received and will now + be verified () and validated () by the hub. The hub SHOULD perform the + verification of intent as soon as possible. + + If a hub finds any errors in the subscription request, an + appropriate HTTP error response code (4xx or 5xx) MUST be returned. In + the event of an error, hubs SHOULD return a description of the error + in the response body as plain text. Hubs MAY decide to reject some + callback URLs or topic URLs based on their own policies (e.g., domain + authorization, topic URL port numbers). +
+ +
+ +
+ In order to prevent an attacker from creating unwanted subscriptions + on behalf of a subscriber (or unsubscribing desired ones), a hub must + ensure that the subscriber did indeed send the subscription request. + + The hub verifies a subscription request by sending an HTTP GET request to the subscriber's callback + URL as given in the subscription request. This request has the following + query string arguments appended (format described in Section 17.13.4 of + ): + + + REQUIRED. The literal string "subscribe" or + "unsubscribe", which matches the original request to the hub from + the subscriber. + + REQUIRED. The topic URL given in the + corresponding subscription request. + + REQUIRED. A hub-generated, random string + that MUST be echoed by the subscriber to verify the + subscription. + + REQUIRED/OPTIONAL. The + hub-determined number of seconds that the subscription will stay + active before expiring, measured from the time the verification + request was made from the hub to the subscriber. Hubs MUST supply + this parameter for subscription requests. This parameter MAY be + present for unsubscribe requests and MUST be ignored by subscribers + during unsubscription. + + + +
+ + The subscriber MUST confirm that the hub.topic + correspond to a pending subscription or unsubscription that it + wishes to carry out. If so, the subscriber MUST respond with an HTTP + success (2xx) code with a response body equal to the hub.challenge parameter. If the subscriber does + not agree with the action, the subscriber MUST respond with a 404 "Not + Found" response. + + The hub MUST consider other server response codes (3xx, 4xx, 5xx) + to mean that the verification request has failed. If the subscriber + returns an HTTP success (2xx) but the content body does not match the + hub.challenge parameter, the hub MUST also + consider verification to have failed. + + Hubs MAY make the hub.lease_seconds + equal to the period the subscriber passed in their subscription + request but MAY change the value depending on the hub's policies. To + sustain a temporary subscription, the subscriber MUST re-request the + subscription on the hub before hub.lease_seconds seconds has elapsed. For + permanent subscriptions with no hub.lease_seconds value specified, the behavior + is different as described in the section on automatic subscription refreshing. + +
+ +
+ Subscriptions MAY be validated by the Hubs who may require + more details to accept or refuse a subscription. The Hub MAY also + check with the publisher whether the subscription should be accepted. + + If (and when), the subscription has been accepted, + the hub MUST indicate it to the subscriber by performing a notification + of the current state of the resource to the subscriber (see ). + (this is optional in synchronous mode). The subscriber will use this has + an indication that its subscription has been confirmed. + + Additionally, this notification MUST include a X-Hub-Self-Url + HTTP header which indicates to the subscriber to what feed he has been subscribed. + This feed url MAY be different from the feed for which the subscriber has initially subscribed, + as the publisher MAY have considered that this one was better suited for the subscriber. + (This is specifically useful in the context of private content with limited distribution.) + + If (and when), the subscription is denied, the hub will inform the subscriber + by sending an HTTP GET request to the subscriber's + callback URL as given in the subscription request. This request has the following + query string arguments appended (format described in Section 17.13.4 of + ): + + REQUIRED. The literal string "denied". + REQUIRED. The topic URL given in the corresponding + subscription request. + OPTIONAL. The hub may include a reason + for which the subscription has been denied. + + + The subscription may be intentionally denied by the hub at any point (even + if it was previously accepted). The Subscriber SHOULD then consider that + the subscription is not possible anymore. + +
+
+ +
+ + Before a subscription expires (i.e., before hub.lease_seconds elapses), Hubs MUST recheck with + subscribers to see if a continued subscription is desired. Hubs do this + by sending the subscriber a verification + request with hub.mode equal to + subscribe. This request MUST match the original verification request + sent to the subscriber (but with a new hub.challenge + ). + + The response codes returned by the subscriber MUST be interpreted the + same way as during a subscriber-initiated verification flow. However, + this refresh request MUST behave like an initial subscription request; + this means that if an auto-refresh response from the subscriber + constantly returns an error, the hub MUST give up on the subscription + verification action altogether and remove the subscription. + + In the case of permanent subscriptions (with no hub.lease_seconds specified in the original + request), the hub.lease_seconds value + supplied by the hub in the verification request to the subscriber SHOULD + represent how many seconds until the hub expects it will next initiate + automatic subscription refreshing to ensure that the subscriber is still + interested in the topic. This behavior provides the best of both worlds: + maximum simplicity of the subscriber through infinitely-long + subscriptions, but still garbage collectable subscriptions for hub + hygiene. + +
+ +
+ +
+ The publisher MUST inform the hub it previously designated when a topic + has been updated. The hub and the publisher CAN agree on any mechanism, as + long as the hub is eventually able send the updated payload to the + subscribers. +
+ +
+ + A content distribution request is an HTTP POST request from hub to the subscriber's + callback URL with the payload of the notification. This request MUST + have a Content-Type corresponding to the + type of the topic. The hub MAY reduce the payload to a diff if its format + allows it. + + The POST request must include a X-Hub-Self-Url + and a X-Hub-Url HTTP headers that correspond + to topic's url, as well as hub. + + The successful response from the subscriber's callback URL MUST be an + HTTP success (2xx) code. The hub MUST consider all other subscriber + response codes as failures; that means subscribers MUST not use HTTP + redirects for moving subscriptions. The response body from the + subscriber MUST be ignored by the hub. Hubs SHOULD retry notifications + repeatedly until successful (up to some reasonable maximum over a + reasonable time period). Subscribers SHOULD respond to notifications as + quickly as possible; their success response code SHOULD only indicate + receipt of the message, not acknowledgment that it was successfully + processed by the subscriber. + +
+ +
+ + If the subscriber supplied a value for hub.secret in their subscription request, the hub + MUST generate an HMAC signature of the payload and include that + signature in the request headers of the content distribution request. + The X-Hub-Signature header's value MUST be + in the form sha1=signature where signature is a 40-byte, hexadecimal representation + of a SHA1 signature. The signature MUST be + computed using the HMAC algorithm with the + request body as the data and the hub.secret + as the key. + + When subscribers receive a content distribution request with the + X-Hub-Signature header specified, they + SHOULD recompute the SHA1 signature with the shared secret using the + same method as the hub. If the signature does not match, subscribers + MUST still return a 2xx success response to acknowledge receipt, but + locally ignore the message as invalid. Using this technique along with + HTTPS for subscription requests enables + simple subscribers to receive authenticated content delivery from hubs + without the need for subscribers to run an HTTPS server. + + Please note however that this signature only ensures that the payload + was not forged. Since the notification also includes headers, these should + not be considered as safe by the subscriber, unless of course the subscriber + uses HTTPS callbacks. + +
+ + + + + + + + + + HMAC: Keyed-Hashing for Message Authentication + + IBM, T.J. Watson Research Center + + + University of California at San Diego, Dept of Computer Science and Engineering + + + IBM T.J. Watson Research Center + + + + + + + + Reserved Top Level DNS Names + + + + + + + + + + + + + + + + Key words for use in RFCs to Indicate Requirement + Levels + + + Alis Technologies + + + + + + + + + Hypertext Transfer Protocol -- HTTP/1.1 + + + UC Irvine + + + + Compaq/W3C + + + + Compaq + + + + W3C/MIT + + + + Xerox + + + + Microsoft + + + + W3C/MIT + + + + + + + + + HTTP Over TLS + + + + + This memo describes how to use Transport Layer Security (TLS) to secure Hypertext Transfer Protocol (HTTP) connections over the Internet. This memo provides information for the Internet community. + + + + + + + + US Secure Hash Algorithm 1 (SHA1) + + + + + + + The purpose of this document is to make the SHA-1 (Secure Hash Algorithm 1) hash algorithm conveniently available to the Internet community. This memo provides information for the Internet community. + + + + + + + + + Uniform Resource Identifiers (URI): Generic Syntax + + + + + + + + + + + + The Atom Syndication Format + + + + + + + + + + + + + + + + + HTML 4.01 Specification + + + + + + + + + + + + + + + + + + + + + + Publish-Subscribe + + + + + + + + + + + + + + + + + RSS 2.0 + + + + + + + + + +
+ Feedback on this specification is welcomed via the + pubsubhubbub mailing list, pubsubhubbub@googlegroups.com. For + more information, see the + PubSubHubbub group on Google Groups. Also, check out the + FAQ + and other + documentation. + + +
+ + diff --git a/pubsubhubbub-core.xml b/pubsubhubbub-core.xml index 410835d..d30554e 100644 --- a/pubsubhubbub-core.xml +++ b/pubsubhubbub-core.xml @@ -28,7 +28,7 @@ - PubSubHubbub Core 0.4 -- Working Draft + PubSubHubbub Core 0.3 -- Working Draft Google, Inc @@ -53,20 +53,14 @@ mart@degeneration.co.uk - - - Notifixious Inc. -
- julien@superfeedr.com -
- - - + - An open, simple, web-scale and decentralized pubsub protocol. - Anybody can play. + An open, simple, web-scale pubsub protocol, along with an open source + reference implentation targetting Google App Engine. Notably, however, + nothing in the protocol is centralized, or Google- or App + Engine-specific. Anybody can play. As opposed to more developed (and more complex) pubsub specs like Jabber Publish-Subscribe this spec's base profile @@ -99,17 +93,25 @@
- An HTTP resource URL. The - unit to which one can subscribe to changes. + An Atom or RSS feed URL. The + unit to which one can subscribe to changes. This spec currently only + addresses feed URLs that require no additional authorization + headers. The server (URL) which implements both sides of this - protocol. Any hub MAY implement its own policies on who can use it. + protocol. We have implemented this and are running a server at + http://pubsubhubbub.appspot.com that is, at least for now, open + to anybody for use, as either a publisher or subscriber. Any hub MAY + implement its own policies on who can use it. An owner of a topic. Notifies the hub when - the topic feed has been updated. As in almost all pubsub systems, the - publisher is unaware of the subscribers, if any. Other pubsub systems - might call the publisher the "source". + the topic feed has been updated. It just notifies that it has been updated, but not how. As in almost all + pubsub systems, the publisher is unaware of the subscribers, if any. + Other pubsub systems might call the publisher the "source". An entity (person or program) that wants to be notified of changes on a topic. The subscriber must be @@ -134,9 +136,17 @@ sending out notifications to subscribers. A payload describing how a topic's - contents have changed, or the full cupdated content. - Depending on the topic's content type, the difference (or "delta") may be - computed by the hub and sent to all subscribers. + contents have changed. This difference (or "delta") is computed by the + hub and sent to all subscribers. The format of the notification will + be an Atom or RSS feed served by the publisher with only those entries + present which are new or have changed. The notification can be the + result of a publisher telling the hub of an update, or the hub + proactively polling a topic feed, perhaps for a subscriber subscribing + to a topic that's not pubsub-aware. Note also that a notification to a + subscriber can be a payload consisting of updates for multiple topics. + Hubs MAY choose to send multi-topic notifications as an optimization + for heavy subscribers, but subscribers MUST understand them. See for format details.
@@ -144,7 +154,7 @@ (This section is non-normative.) - Publishers notify their hub(s) URLs when their topic(s) + Publishers POST a ping to their hub(s) URLs when their topic(s) change. Subscribers POST to one or more of the advertised hubs for a @@ -158,38 +168,133 @@ delta, it enqueues a notification to all registered subscribers. + +
+ Notification and source formats will be Atom or RSS. The + Publisher makes the decision as to include full body, truncated body, or + meta data of most recent event(s). One of: + + + URL + metadata + + URL + metadata + truncated + + URL + metadata + full + + + The trade-off between including all content in outgoing notifications + or having the thundering herd (by clients who fetch the //atom:feed/entry/link in response to a notification) + is up to the publisher. Entries of the most recent events (for recipient + to know whether or not they'd missed any recent items-- like TCP SACK) MAY + be provided as context. Some examples of Atom feed entries follow. + +
+ + + + + + + 2008-08-11T02:15:01Z + + + + Heathcliff + + http://publisher.example.com/happycat25.xml + 2008-08-11T02:15:01Z + + What a happy cat. Full content goes here. + + + + + + Heathcliff + + http://publisher.example.com/happycat25.xml + 2008-08-11T02:15:01Z + + What a happy cat! + + + + + + Garfield + + http://publisher.example.com/happycat25.xml + 2008-08-11T02:15:01Z + + + + + Nermal + + http://publisher.example.com/happycat25.xml + 2008-07-10T12:28:13Z + + + +]]> +
+
- A potential subscriber initiates discovery by retrieving the topic to - which it wants to subscribe. The HTTP response from the publisher MUST - include at least one X-Hub-Url - HTTP header, as well as exactly one X-Hub-Self-Url - HTTP header. The X-Hub-Url MUST - indicate the exact url of the PubSubHubbub hub designated by the publisher. - If more than one url is specified, it is expected that the publisher pings each - of these urls, so the subscriber may subscribe to one or more of these. - The X-Hub-Self-Url will point to the - permanent URL for the resource being polled. + A potential subscriber initiates discovery by retrieving the feed to + which it wants to subscribe. A feed that acts as a topic as per this + specification MUST publish, as a child of //atom:feed or //rss:rss/channel , an atom:link element whose rel attribute has the value hub and whose href + attribute contains the hub's endpoint URL. Feeds MAY contain multiple + atom:link[@rel="hub"] elements if the + publisher wishes to notify multiple hubs. When a potential subscriber + encounters one or more such links, that subscriber MAY subscribe to the + feed using one or more hubs URLs as described in . Example: - Hubs should provide an HTTPS interface and publishers - SHOULD use HTTPS in their hubs' discovery URLs. - However, subscribers that do not support HTTPS MAY +
+ + + + + + .... + + .... + + + .... + + +]]>
+ + Hubs MUST use the same URL for both the publishing and subscribing + interfaces, which is why only a single atom:link + element is required to declare a hub. Publishers SHOULD use HTTPS in their hubs' discovery URLs. However, + subscribers that do not support HTTPS MAY try to fallback to HTTP, which MAY work - depending on the hub's policy. If the advertised url is HTTP, - subscriber MAY choose to try HTTPS first. + depending on the hub's policy.
- Subscribing to a topic URL consists of four parts that may occur + Subscribing to a topic URL consists of three parts that may occur immediately in sequence or have a delay. Requesting a subscription using the hub Confirming the subscription was actually desired - Receiving an acknowledgement from the hub that the subscription was accepted (OPTIONAL). Periodically reconfirming the subscription is still active @@ -197,17 +302,15 @@ changed to indicate the desire to unsubscribe.
- Subscription is initiated by the subscriber making an HTTPS - or HTTP POST request to the hub URL. This request + Subscription is initiated by the subscriber making an HTTP POST request to the hub URL. This request has a Content-Type of application/x-www-form-urlencoded (described in Section 17.13.4 of ) and the following parameters in its body: - REQUIRED. The subscriber's callback URL - where notifications should be delivered. The subscriber's - callback URL SHOULD be unique for each subscription. + REQUIRED. The subscriber's callback URL where notifications should be delivered. REQUIRED. The literal string "subscribe" or "unsubscribe", depending on the goal of the request. @@ -215,6 +318,10 @@ REQUIRED. The topic URL that the subscriber wishes to subscribe to. + REQUIRED. Keyword describing verification + modes supported by this subscriber, as described below. This + parameter may be repeated to indicate multiple supported modes. + OPTIONAL. Number of seconds for which the subscriber would like to have the subscription active. If not present or an empty value, the subscription will be permanent @@ -232,8 +339,32 @@ the request was made over HTTPS. This parameter MUST be less than 200 bytes in length. + OPTIONAL. A subscriber-provided + opaque token that will be echoed back in the verification request to + assist the subscriber in identifying which subscription request is + being verified. If this is not included, no token will be included + in the verification request. + + + + The following keywords are supported for hub.verify: + + + The subscriber supports synchronous + verification, where the verification request must occur before the + subscription request's HTTP response is returned. + + The subscriber supports asynchronous + verification, where the verification request may occur at a later + point after the subscription request has returned. + Where repeated keywords are used, their order indicates the + subscriber's order of preference. Subscribers MUST use at least one of + the modes indicated in the list above, but MAY include additional + keywords defined by extension specifications. Hubs MUST ignore verify + mode keywords that they do not understand. + Hubs MUST ignore additional request parameters they do not understand. @@ -248,14 +379,14 @@
- The topic and callback URLs MAY use HTTP - or HTTPS schemes. The topic URL MUST - be the one advertised by the publisher in the X-Hub-Self-Url - Header during the discovery phase. (See ). - Hubs MAY refuse subscriptions if the topic url does not correspond to the one - advertised by the publisher. The topic URL can otherwise be free-form - following the URI spec. Hubs MUST always - decode non-reserved characters for these URL parameters; see section 2.4 on + The topic and callback URLs MUST NOT contain an anchor fragment. + These URLs MAY use HTTP or HTTPS schemes. These URLs MAY have port + numbers specified; however, hubs MAY choose to disallow certain ports + based on their own policies (e.g., security) and return errors for + these requests. The topic URL can otherwise be free-form following + the URI spec. Hubs MUST always decode + non-reserved characters for these URL parameters; see section 2.4 on "When to Encode or Decode" in the URI spec. @@ -272,24 +403,35 @@ Subscribers MAY choose to use HTTPS for their callback URLs if they care about the privacy of - notifications as they come over the wire from the Hub (see ) + notifications as they come over the wire from the Hub. The use of + mechanisms (such as XML signatures) to verify the integrity of + notifications coming from the original publisher is out of the scope + of this specification.
- - The hub MUST respond to a subscription request with an HTTP 202 "Accepted" - response to indicate that the request was received and will now - be verified () and validated () by the hub. The hub SHOULD perform the - verification of intent as soon as possible. - + + The hub MUST respond to a subscription request with an HTTP 204 "No + Content" response to indicate that the request was verified and that + the subscription is active. If the subscription has yet to be verified + (i.e., the hub is using asynchronous verification), the hub MUST + respond with a 202 "Accepted" code. + If a hub finds any errors in the subscription request, an appropriate HTTP error response code (4xx or 5xx) MUST be returned. In the event of an error, hubs SHOULD return a description of the error in the response body as plain text. Hubs MAY decide to reject some callback URLs or topic URLs based on their own policies (e.g., domain authorization, topic URL port numbers). + + In synchronous mode, the verification () MUST be completed before the hub returns a + response. In asynchronous mode, the verification MAY be deferred until + a later time. This is useful to enable hubs to defer work; this could + allow them to alleviate servers under heavy load or do verification + work in batches. +
@@ -325,24 +467,43 @@ present for unsubscribe requests and MUST be ignored by subscribers during unsubscription. + OPTIONAL. The subscriber-provided + opaque token from the corresponding subscription request, if one was + provided. +
The subscriber MUST confirm that the hub.topic - correspond to a pending subscription or unsubscription that it - wishes to carry out. If so, the subscriber MUST respond with an HTTP - success (2xx) code with a response body equal to the and hub.verify_token correspond + to a pending subscription or unsubscription that it wishes to carry + out. If so, the subscriber MUST respond with an HTTP success (2xx) + code with a response body equal to the hub.challenge parameter. If the subscriber does not agree with the action, the subscriber MUST respond with a 404 "Not Found" response. - The hub MUST consider other server response codes (3xx, 4xx, 5xx) - to mean that the verification request has failed. If the subscriber + For synchronous verification, the hub MUST consider other server + response codes (3xx, 4xx, 5xx) to mean that the verification request + has immediately failed and no retries should occur. If the subscriber returns an HTTP success (2xx) but the content body does not match the hub.challenge parameter, the hub MUST also consider verification to have failed. - + + For asynchronous verification, the hub MUST consider other server + response codes (3xx, 4xx, and 5xx) to mean that the subscription + action was temporarily not verified. If + the subscriber returns an HTTP success (2xx) but the content body does + not match the hub.challenge parameter, the + hub MUST consider this to be a temporary + failure and retry. The hub SHOULD retry verification a reasonable + number of times over the course of a longer time period (e.g., 6 + hours) until a definite acknowledgement (positive or negative) is + received. If a definite response still cannot be determined after this + retry period, the subscription action verification MUST be abandoned, + leaving the previous subscription state. + Hubs MAY make the hub.lease_seconds equal to the period the subscriber passed in their subscription request but MAY change the value depending on the hub's policies. To @@ -355,42 +516,7 @@ target="autorefresh">automatic subscription refreshing.
- -
- Subscriptions MAY be validated by the Hubs who may require - more details to accept or refuse a subscription. The Hub MAY also - check with the publisher whether the subscription should be accepted. - - If (and when), the subscription has been accepted, - the hub MUST indicate it to the subscriber by performing a notification - of the current state of the resource to the subscriber (see ). - (this is optional in synchronous mode). The subscriber will use this has - an indication that its subscription has been confirmed. - - Additionally, this notification MUST include a X-Hub-Self-Url - HTTP header which indicates to the subscriber to what feed he has been subscribed. - This feed url MAY be different from the feed for which the subscriber has initially subscribed, - as the publisher MAY have considered that this one was better suited for the subscriber. - (This is specifically useful in the context of private content with limited distribution.) - - If (and when), the subscription is denied, the hub will inform the subscriber - by sending an HTTP GET request to the subscriber's - callback URL as given in the subscription request. This request has the following - query string arguments appended (format described in Section 17.13.4 of - ): - - REQUIRED. The literal string "denied". - REQUIRED. The topic URL given in the corresponding - subscription request. - OPTIONAL. The hub may include a reason - for which the subscription has been denied. - - - The subscription may be intentionally denied by the hub at any point (even - if it was previously accepted). The Subscriber SHOULD then consider that - the subscription is not possible anymore. - -
+
@@ -401,8 +527,8 @@ by sending the subscriber a verification request with hub.mode equal to subscribe. This request MUST match the original verification request - sent to the subscriber (but with a new hub.challenge - ). + sent to the subscriber (but with a new hub.challenge). The response codes returned by the subscriber MUST be interpreted the same way as during a subscriber-initiated verification flow. However, @@ -427,24 +553,107 @@
- The publisher MUST inform the hub it previously designated when a topic - has been updated. The hub and the publisher CAN agree on any mechanism, as - long as the hub is eventually able send the updated payload to the - subscribers. -
+ A publisher pings the hub with the topic URL(s) which have been updated + and the hub schedules those topics to be fetched and delivered. Because + it's just a ping to notify the hub of the topic URL (without a payload), + no authentication from the publisher is required. + +
+ When new content is added to a feed, a notification is sent to + the hub by the publisher. The hub MUST accept a POST request to + the hub URL containing the notification. This request MUST have a + Content-Type of application/x-www-form-urlencoded + (described in Section 17.13.4 of ) and the following parameters in + its body: + + + REQUIRED. The literal string "publish". + + REQUIRED. The topic URL of the topic that + has been updated. This field may be repeated to indicate multiple + topics that have been updated. + + + The new content notification is a signal to the hub that there is new + content available. The hub SHOULD arrange for a content fetch request + () to be performed in the near future + to retrieve the new content. If the notification was acceptable, the hub + MUST return a 204 No Content response. If the notification is not + acceptable for some reason, the hub MUST return an appropriate HTTP + error response code (4xx and 5xx). Hubs MUST return a 204 No Content + response even when they do not have any subscribers for all of the + specified topic URLs. +
+ +
+ When the hub wishes to retrieve new content for a topic, the hub + sends an HTTP GET request to the topic + URL. The hub MUST follow HTTP redirects. The Hub SHOULD use best + practices for caching headers in its requests (e.g., If-None-Match, If-Modified-Since). + + The request SHOULD include the header field User-Agent in the form expected by HTTP. The header MAY have one or more additional + suffixes like (example.com; 20 subscribers) + to indicate the number of subscriptions the hub has active for this + topic. + + If present, the first suffix MUST indicate the total number of + subscriptions the hub has aggregated across all subscriber domains by + means of the X-Hub-On-Behalf-Of header + (). Any additional suffixes + indicate a breakdown of subscriber counts across subscriber domains. + This allows content publishers to distinguish the source of their + subscriber counts and mitigate subscriber count spam. An example header + could be (ignoring line-wrapping): + +
+ +User-Agent: MyHub (+http://hub.example.com; 26 subscribers) + (sub.example.com; 4 subscribers) + (other-sub.example.com; 22 subscribers) + +
+ + If, after a content fetch, the hub determines that the topic feed + content has changed, the hub MUST send information about the changes to + each of the subscribers to the topic (). Hubs MUST consider new feed + entries, updated entries, or changes to the surrounding feed document as + significant content changes that require content distribution. + +
A content distribution request is an HTTP POST request from hub to the subscriber's - callback URL with the payload of the notification. This request MUST - have a Content-Type corresponding to the - type of the topic. The hub MAY reduce the payload to a diff if its format - allows it. - - The POST request must include a X-Hub-Self-Url - and a X-Hub-Url HTTP headers that correspond - to topic's url, as well as hub. + callback URL with the list of new and changed entries. This request MUST + have a Content-Type of application/atom+xml when the request body is an + Atom feed document, or a Content-Type of application/rss+xml when the request body is an + RSS feed document. The behavior for other + content types is not yet defined. Hubs MAY transform the content type + and request body as desired (e.g., for language translation). + + If the document represents a single feed being replicated for the + subscriber, then the feed-level elements SHOULD be preserved aside from + the atom:entry or rss:item elements. However, the atom:id element MUST be reproduced exactly. The + other atom:updated and atom:title elements required by the Atom + specification SHOULD be present. Each atom:entry or rss:item + element in the feed contains the content from an entry in the single + topic that the subscriber has an active subscription for. Essentially, + in the single feed case the subscriber will receive a feed document + that looks like the original but with old content removed. The successful response from the subscriber's callback URL MUST be an HTTP success (2xx) code. The hub MUST consider all other subscriber @@ -457,6 +666,17 @@ receipt of the message, not acknowledgment that it was successfully processed by the subscriber. + The subscriber's callback response MAY include the header field + X-Hub-On-Behalf-Of with an integer value, + possibly approximate, representing the number of subscribers on behalf + of which this feed notification was delivered. This value SHOULD be + aggregated by the hub across all subscribers and used to provide the + subscriber counts in the User-Agent header + field sent to publishers (). Hubs MAY + ignore or respect X-Hub-On-Behalf-Of values + from subscribers depending on their own policies (i.e., to prevent + spam). +
@@ -479,17 +699,125 @@ same method as the hub. If the signature does not match, subscribers MUST still return a 2xx success response to acknowledge receipt, but locally ignore the message as invalid. Using this technique along with - HTTPS for subscription requests enables - simple subscribers to receive authenticated content delivery from hubs - without the need for subscribers to run an HTTPS server. - - Please note however that this signature only ensures that the payload - was not forged. Since the notification also includes headers, these should - not be considered as safe by the subscriber, unless of course the subscriber - uses HTTPS callbacks. + HTTPS for subscription requests enables simple subscribers to receive + authenticated content delivery from hubs without the need for + subscribers to run an HTTPS server. + +
+
+ + For Atom feeds only. Pending further review. + + When a subscriber indicates the same callback URL is used for + multiple subscriptions, hubs MAY choose to combine content delivery + requests into a single payload containing an aggregated set of feeds. + This bulk delivery results in fewer requests and more efficient + distribution. If the subscriber indicated a hub.secret value for these overlapping + subscriptions, the secret MUST also be the same for all subscriptions. + This allows the hub to generate a single X-Hub-Signature header to sign the entire payload. + Hubs MUST return an error response (4xx, 5xx) for subscription + requests with overlapping callback URLs and different secret values. + + + With an aggregated set of feeds, the hub SHOULD reproduce all of the + elements from the source feed inside the + corresponding atom:entry in the content + distribution request by using an atom:source + element. However, the atom:id value MUST be + reproduced exactly within the source element. If the source entry does + not have an atom:source element, the hub + MUST create an atom:source element + containing the atom:id element. The hub + SHOULD also include the atom:title element + and an atom:link element with rel="self" values that are functionally + equivalent to the corresponding elements in the original topic feed. + + Example aggregated feed: + +
+ + + Aggregated feed + 2008-08-11T02:17:44Z + http://myhub.example.com/aggregated?1232427842-39823 + + + + http://www.example.com/foo + + + Mr. Bar + + + Testing Foo + + http://publisher.example.com/foo24.xml + 2008-08-11T02:15:01Z + + This is some content from the user named foo. + + + + + + http://www.example.com/bar + + + Mr. Bar + + + Testing Bar + + http://publisher.example.com/bar18.xml + 2008-08-11T02:17:44Z + + Some data from the user named bar. + + + + +]]> +
+ +
+ + +
+ (This section is non-normative.) +
+ The vast majority of feeds on the web have multiple variants that contain essentially the same content + but appear on different URLs. A common set of variants is http://example.com/feed?format=atom and http://example.com/feed?format=rss. In practice, + these URLs also fail to set their //atom:feed/link[@rel="self"] values properly, + meaning it's difficult for subscribers to discover which feed URL they + truly wanted. Making matters worse, feeds often have redirects + (temporary or permanent) to new hosting locations, analytics providers, + or other feed-processors. To solve this, it's important for Hub + implementations to determine feed URL equivalences using heuristics. + Examples: follow all feed URLs redirects and see if they end up at the + same location; use overlaps in feed HTML alternate links; use the atom:id value across all domains. This specific + problem is considered out of scope of this specification but this + section is meant as a reminder to implementors that feed URL aliasing is + an important issue that hubs should address instead of putting + the burden on publishers and subscribers.
+
+ The hub.verify_token parameter in + subscription requests enables subscribers to verify the identity and + intent of the hub making the verification request. Subscribers should + use the token to retrieve internal state to ensure the subscription + request outcome is what they intended. +
From 7445e4538185777a3ea0022f42f33a5d01e22387 Mon Sep 17 00:00:00 2001 From: julien Date: Sun, 5 Feb 2012 23:17:00 +0100 Subject: [PATCH 03/76] generated 0.4.html --- pubsubhubbub-core-0.4.html | 729 +++++++++++++++++++++++++++++++++++++ pubsubhubbub-core-0.4.xml | 34 +- 2 files changed, 731 insertions(+), 32 deletions(-) create mode 100644 pubsubhubbub-core-0.4.html diff --git a/pubsubhubbub-core-0.4.html b/pubsubhubbub-core-0.4.html new file mode 100644 index 0000000..cf91acd --- /dev/null +++ b/pubsubhubbub-core-0.4.html @@ -0,0 +1,729 @@ + +Draft: PubSubHubbub Core 0.4 -- Working Draft + + + + + + +
 TOC 
+
+ + + + + + + + +
DraftB. Fitzpatrick
 B. Slatkin
 Google, Inc
 M. Atkins
 Six Apart Ltd.
 M. Genestoux
 Notifixious Inc.
 February 5, 2012
+


PubSubHubbub Core 0.4 -- Working Draft

+ +

Abstract

+ +

An open, simple, web-scale and decentralized pubsub protocol. + Anybody can play. +

+

As opposed to more developed (and more complex) pubsub specs like Jabber Publish-Subscribe (Millard, P., Saint-Andre, P., and R. Meijer, “Publish-Subscribe,” .) [XEP‑0060] this spec's base profile + (the barrier-to-entry to speak it) is dead simple. The fancy bits required + for high-volume publishers and subscribers are optional. The base profile + is HTTP-based, as opposed to XMPP (see more on this below). +

+

To dramatically simplify this spec in several places where we had to + choose between supporting A or B, we took it upon ourselves to say "only + A", rather than making it an implementation decision. +

+

We offer this spec in hopes that it fills a need or at least advances + the state of the discussion in the pubsub space. Polling sucks. We think + a decentralized pubsub layer is a fundamental, missing layer in the + Internet architecture today and its existence, more than just enabling + the obvious lower latency feed readers, would enable many cool + applications, most of which we can't even imagine. But we're looking + forward to decentralized social networking. +


+

Table of Contents

+

+1.  +Notation and Conventions
+2.  +Definitions
+3.  +High-level protocol flow
+4.  +Discovery
+5.  +Subscribing and Unsubscribing
+    5.1.  +Subscriber Sends Subscription Request
+    5.2.  +Hub Verifies Intent of the Subscriber
+    5.3.  +Automatic Subscription Refreshing
+6.  +Publishing
+7.  +Content Distribution
+8.  +Authenticated Content Distribution
+9.  +References
+Appendix A.  +Specification Feedback
+§  +Authors' Addresses
+

+
+ +
+
 TOC 
+

1.  +Notation and Conventions

+ +

The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", + "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this + document are to be interpreted as described in [RFC2119] (Bradner, B., “Key words for use in RFCs to Indicate Requirement Levels,” .). Domain name examples use [RFC2606] (Eastlake, D. and A. Panitz, “Reserved Top Level DNS Names,” .). +

+
+
 TOC 
+

2.  +Definitions

+ +

+
+
Topic:
+
An HTTP resource URL. The + unit to which one can subscribe to changes. +
+
Hub ("the hub"):
+
The server (URL (Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” .) [RFC3986]) which implements both sides of this + protocol. Any hub MAY implement its own policies on who can use it. +
+
Publisher:
+
An owner of a topic. Notifies the hub when + the topic feed has been updated. As in almost all pubsub systems, the + publisher is unaware of the subscribers, if any. Other pubsub systems + might call the publisher the "source". +
+
Subscriber:
+
An entity (person or program) that wants + to be notified of changes on a topic. The subscriber must be + directly network-accessible and is identified by its Subscriber + Callback URL. +
+
Subscription:
+
A unique relation to a topic by a + subscriber that indicates it should receive updates for that topic. A + subscription's unique key is the tuple (Topic URL, Subscriber Callback + URL). Subscriptions may (at the hub's decision) have expiration times + akin to DHCP leases which must be periodically renewed. +
+
Subscriber Callback URL:
+
The URL (Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” .) [RFC3986] at which a subscriber wishes to receive + notifications. +
+
Event:
+
An event that causes updates to multiple topics. + For each event that happens (e.g. "Brad posted to the Linux + Community."), multiple topics could be affected (e.g. "Brad posted." + and "Linux community has new post"). Publisher events cause topics to + be updated and the hub looks up all subscriptions for affected topics, + sending out notifications to subscribers. +
+
Notification:
+
A payload describing how a topic's + contents have changed, or the full cupdated content. + Depending on the topic's content type, the difference (or "delta") may be + computed by the hub and sent to all subscribers. +
+
+ +
+
 TOC 
+

3.  +High-level protocol flow

+ +

(This section is non-normative.) +

+

+
    +
  • Publishers notify their hub(s) URLs when their topic(s) + change. +
    • +
  • Subscribers POST to one or more of the advertised hubs for a + topic they're interested in. Alternatively, some hubs may offer + auto-polling capability, to let {their,any} subscribers subscribe to + topics which don't advertise a hub. +
    • +
  • The hub caches minimal metadata (id, data, entry digest) about + each topic's previous state. When the hub re-fetches a topic feed (on + its own initiative or as a result of a publisher's ping) and finds a + delta, it enqueues a notification to all registered subscribers. +
    • +
+ +
+
 TOC 
+

4.  +Discovery

+ +

A potential subscriber initiates discovery by retrieving the topic to + which it wants to subscribe. The HTTP response from the publisher MUST + include at least one X-Hub-Url + HTTP header, as well as exactly one X-Hub-Self-Url + HTTP header. The X-Hub-Url MUST + indicate the exact url of the PubSubHubbub hub designated by the publisher. + If more than one url is specified, it is expected that the publisher pings each + of these urls, so the subscriber may subscribe to one or more of these. + The X-Hub-Self-Url will point to the + permanent URL for the resource being polled. +

+

Example: +

+

Hubs should provide an HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] interface and publishers + SHOULD use HTTPS (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] in their hubs' discovery URLs. + However, subscribers that do not support HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] MAY + try to fallback to HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616], which MAY work + depending on the hub's policy. If the advertised url is HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616], + subscriber MAY choose to try HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] first. +

+
+
 TOC 
+

5.  +Subscribing and Unsubscribing

+ +

Subscribing to a topic URL consists of four parts that may occur + immediately in sequence or have a delay. +

+

+
    +
  • Requesting a subscription using the hub +
    • +
  • Confirming the subscription was actually desired +
    • +
  • Receiving an acknowledgement from the hub that the subscription was accepted (OPTIONAL). +
    • +
  • Periodically reconfirming the subscription is still active +
    • +
+ +

Unsubscribing works in the same way, except with a single parameter + changed to indicate the desire to unsubscribe. +

+
+
 TOC 
+

5.1.  +Subscriber Sends Subscription Request

+ +

Subscription is initiated by the subscriber making an HTTPS (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] + or HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] POST request to the hub URL. This request + has a Content-Type of application/x-www-form-urlencoded (described in + Section 17.13.4 of [W3C.REC‑html401‑19991224] (Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” December 1999.)) and the + following parameters in its body: +

+

+
+
hub.callback
+
REQUIRED. The subscriber's callback URL + where notifications should be delivered. The subscriber's + callback URL SHOULD be unique for each subscription. +
+
hub.mode
+
REQUIRED. The literal string "subscribe" or + "unsubscribe", depending on the goal of the request. +
+
hub.topic
+
REQUIRED. The topic URL that the subscriber + wishes to subscribe to. +
+
hub.lease_seconds
+
OPTIONAL. Number of seconds for + which the subscriber would like to have the subscription active. If + not present or an empty value, the subscription will be permanent + (or active until automatic + refreshing (Automatic Subscription Refreshing) removes the subscription). Hubs MAY choose to + respect this value or not, depending on their own policies. This + parameter MAY be present for unsubscription requests and MUST be + ignored by the hub in that case. +
+
hub.secret
+
OPTIONAL. A subscriber-provided secret + string that will be used to compute an HMAC digest for authorized content distribution (Authenticated Content Distribution). If not + supplied, the HMAC digest will not be present for content + distribution requests. This parameter SHOULD only be specified when + the request was made over HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818]. This + parameter MUST be less than 200 bytes in length. +
+
+ +

Hubs MUST ignore additional request parameters they do not + understand. +

+

Hubs MUST allow subscribers to re-request subscriptions that are + already activate. Each subsequent request to a hub to subscribe or + unsubscribe MUST override the previous subscription state for a + specific topic URL and callback URL combination once the action is + verified. Any failures to confirm the subscription action MUST leave + the subscription state unchanged. This is required so subscribers can + renew their subscriptions before the lease seconds period is over + without any interruption. +

+
+
 TOC 
+

5.1.1.  +Subscription Parameter Details

+ +

The topic and callback URLs MAY use HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] + or HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] schemes. The topic URL MUST + be the one advertised by the publisher in the X-Hub-Self-Url + Header during the discovery phase. (See Section 4 (Discovery)). + Hubs MAY refuse subscriptions if the topic url does not correspond to the one + advertised by the publisher. The topic URL can otherwise be free-form + following the URI spec (Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” .) [RFC3986]. Hubs MUST always + decode non-reserved characters for these URL parameters; see section 2.4 on + "When to Encode or Decode" in the URI spec (Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” .) [RFC3986]. +

+

The callback URL MAY contain arbitrary query string parameters + (e.g., ?foo=bar&red=fish). Hubs MUST + preserve the query string during subscription verification by + appending new parameters to the end of the list using the & (ampersand) character to join. Existing + parameters with names that overlap with those used by verification + requests will not be overwritten; Hubs MUST only append verification + parameters to the existing list, if any. For event notification, the + callback URL will be POSTed to including any query-string parameters + in the URL portion of the request, not as POST body parameters. +

+

Subscribers MAY choose to use HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] + for their callback URLs if they care about the privacy of + notifications as they come over the wire from the Hub (see Section 8 (Authenticated Content Distribution)) +

+
+
 TOC 
+

5.1.2.  +Subscription Response Details

+ +

The hub MUST respond to a subscription request with an HTTP 202 "Accepted" + response to indicate that the request was received and will now + be verified (Section 5.2 (Hub Verifies Intent of the Subscriber)) and validated (Section 5.2.2 (Subscription Validation)) by the hub. The hub SHOULD perform the + verification of intent as soon as possible. +

+

If a hub finds any errors in the subscription request, an + appropriate HTTP error response code (4xx or 5xx) MUST be returned. In + the event of an error, hubs SHOULD return a description of the error + in the response body as plain text. Hubs MAY decide to reject some + callback URLs or topic URLs based on their own policies (e.g., domain + authorization, topic URL port numbers). +

+
+
 TOC 
+

5.2.  +Hub Verifies Intent of the Subscriber

+ +

In order to prevent an attacker from creating unwanted subscriptions + on behalf of a subscriber (or unsubscribing desired ones), a hub must + ensure that the subscriber did indeed send the subscription request. +

+

The hub verifies a subscription request by sending an HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] GET request to the subscriber's callback + URL as given in the subscription request. This request has the following + query string arguments appended (format described in Section 17.13.4 of + [W3C.REC‑html401‑19991224] (Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” December 1999.)): +

+

+
+
hub.mode
+
REQUIRED. The literal string "subscribe" or + "unsubscribe", which matches the original request to the hub from + the subscriber. +
+
hub.topic
+
REQUIRED. The topic URL given in the + corresponding subscription request. +
+
hub.challenge
+
REQUIRED. A hub-generated, random string + that MUST be echoed by the subscriber to verify the + subscription. +
+
hub.lease_seconds
+
REQUIRED/OPTIONAL. The + hub-determined number of seconds that the subscription will stay + active before expiring, measured from the time the verification + request was made from the hub to the subscriber. Hubs MUST supply + this parameter for subscription requests. This parameter MAY be + present for unsubscribe requests and MUST be ignored by subscribers + during unsubscription. +
+
+ +
+
 TOC 
+

5.2.1.  +Verification Details

+ +

The subscriber MUST confirm that the hub.topic + correspond to a pending subscription or unsubscription that it + wishes to carry out. If so, the subscriber MUST respond with an HTTP + success (2xx) code with a response body equal to the hub.challenge parameter. If the subscriber does + not agree with the action, the subscriber MUST respond with a 404 "Not + Found" response. +

+

The hub MUST consider other server response codes (3xx, 4xx, 5xx) + to mean that the verification request has failed. If the subscriber + returns an HTTP success (2xx) but the content body does not match the + hub.challenge parameter, the hub MUST also + consider verification to have failed. +

+

Hubs MAY make the hub.lease_seconds + equal to the period the subscriber passed in their subscription + request but MAY change the value depending on the hub's policies. To + sustain a temporary subscription, the subscriber MUST re-request the + subscription on the hub before hub.lease_seconds seconds has elapsed. For + permanent subscriptions with no hub.lease_seconds value specified, the behavior + is different as described in the section on automatic subscription refreshing (Automatic Subscription Refreshing). +

+
+
 TOC 
+

5.2.2.  +Subscription Validation

+ +

Subscriptions MAY be validated by the Hubs who may require + more details to accept or refuse a subscription. The Hub MAY also + check with the publisher whether the subscription should be accepted. +

+

If (and when), the subscription has been accepted, + the hub MUST indicate it to the subscriber by performing a notification + of the current state of the resource to the subscriber (see Section 7 (Content Distribution)). + (this is optional in synchronous mode). The subscriber will use this has + an indication that its subscription has been confirmed. +

+

Additionally, this notification MUST include a X-Hub-Self-Url + HTTP header which indicates to the subscriber to what feed he has been subscribed. + This feed url MAY be different from the feed for which the subscriber has initially subscribed, + as the publisher MAY have considered that this one was better suited for the subscriber. + (This is specifically useful in the context of private content with limited distribution.) +

+

If (and when), the subscription is denied, the hub will inform the subscriber + by sending an HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] GET request to the subscriber's + callback URL as given in the subscription request. This request has the following + query string arguments appended (format described in Section 17.13.4 of + [W3C.REC‑html401‑19991224] (Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” December 1999.)): +

+

+
+
hub.mode
+
REQUIRED. The literal string "denied". +
+
hub.topic
+
REQUIRED. The topic URL given in the corresponding + subscription request. +
+
hub.reason
+
OPTIONAL. The hub may include a reason + for which the subscription has been denied. +
+
+ +

The subscription may be intentionally denied by the hub at any point (even + if it was previously accepted). The Subscriber SHOULD then consider that + the subscription is not possible anymore. +

+
+
 TOC 
+

5.3.  +Automatic Subscription Refreshing

+ +

Before a subscription expires (i.e., before hub.lease_seconds elapses), Hubs MUST recheck with + subscribers to see if a continued subscription is desired. Hubs do this + by sending the subscriber a verification + request (Hub Verifies Intent of the Subscriber) with hub.mode equal to + subscribe. This request MUST match the original verification request + sent to the subscriber (but with a new hub.challenge + ). +

+

The response codes returned by the subscriber MUST be interpreted the + same way as during a subscriber-initiated verification flow. However, + this refresh request MUST behave like an initial subscription request; + this means that if an auto-refresh response from the subscriber + constantly returns an error, the hub MUST give up on the subscription + verification action altogether and remove the subscription. +

+

In the case of permanent subscriptions (with no hub.lease_seconds specified in the original + request), the hub.lease_seconds value + supplied by the hub in the verification request to the subscriber SHOULD + represent how many seconds until the hub expects it will next initiate + automatic subscription refreshing to ensure that the subscriber is still + interested in the topic. This behavior provides the best of both worlds: + maximum simplicity of the subscriber through infinitely-long + subscriptions, but still garbage collectable subscriptions for hub + hygiene. +

+
+
 TOC 
+

6.  +Publishing

+ +

The publisher MUST inform the hub it previously designated when a topic + has been updated. The hub and the publisher CAN agree on any mechanism, as + long as the hub is eventually able send the updated payload to the + subscribers. +

+
+
 TOC 
+

7.  +Content Distribution

+ +

A content distribution request is an HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] POST request from hub to the subscriber's + callback URL with the payload of the notification. This request MUST + have a Content-Type corresponding to the + type of the topic. The hub MAY reduce the payload to a diff if its format + allows it. +

+

The POST request must include a X-Hub-Self-Url + and a X-Hub-Url HTTP headers that correspond + to topic's url, as well as hub. +

+

The successful response from the subscriber's callback URL MUST be an + HTTP success (2xx) code. The hub MUST consider all other subscriber + response codes as failures; that means subscribers MUST not use HTTP + redirects for moving subscriptions. The response body from the + subscriber MUST be ignored by the hub. Hubs SHOULD retry notifications + repeatedly until successful (up to some reasonable maximum over a + reasonable time period). Subscribers SHOULD respond to notifications as + quickly as possible; their success response code SHOULD only indicate + receipt of the message, not acknowledgment that it was successfully + processed by the subscriber. +

+
+
 TOC 
+

8.  +Authenticated Content Distribution

+ +

If the subscriber supplied a value for hub.secret in their subscription request, the hub + MUST generate an HMAC signature of the payload and include that + signature in the request headers of the content distribution request. + The X-Hub-Signature header's value MUST be + in the form sha1=signature where signature is a 40-byte, hexadecimal representation + of a SHA1 signature (Eastlake, D. and P. Jones, “US Secure Hash Algorithm 1 (SHA1),” September 2001.) [RFC3174]. The signature MUST be + computed using the HMAC algorithm (Krawczyk, H., Bellare, M., and R. Canetti, “HMAC: Keyed-Hashing for Message Authentication,” .) [RFC2104] with the + request body as the data and the hub.secret + as the key. +

+

When subscribers receive a content distribution request with the + X-Hub-Signature header specified, they + SHOULD recompute the SHA1 signature with the shared secret using the + same method as the hub. If the signature does not match, subscribers + MUST still return a 2xx success response to acknowledge receipt, but + locally ignore the message as invalid. Using this technique along with + HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] for subscription requests enables + simple subscribers to receive authenticated content delivery from hubs + without the need for subscribers to run an HTTPS server. +

+

Please note however that this signature only ensures that the payload + was not forged. Since the notification also includes headers, these should + not be considered as safe by the subscriber, unless of course the subscriber + uses HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] callbacks. +

+
+
 TOC 
+

9. References

+ + + + + + + + + + + + + + + + + + + +
[RFC2104]Krawczyk, H., Bellare, M., and R. Canetti, “HMAC: Keyed-Hashing for Message Authentication,” RFC 2104.
[RFC2119]Bradner, B., “Key words for use in RFCs to Indicate Requirement + Levels,” RFC 2119.
[RFC2606]Eastlake, D. and A. Panitz, “Reserved Top Level DNS Names,” RFC 2606.
[RFC2616]Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” RFC 2616.
[RFC2818]Rescorla, E., “HTTP Over TLS,” RFC 2818, May 2000 (TXT).
[RFC3174]Eastlake, D. and P. Jones, “US Secure Hash Algorithm 1 (SHA1),” RFC 3174, September 2001 (TXT).
[RFC3986]Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” RFC 3986.
[W3C.REC-html401-19991224]Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” World Wide Web Consortium Recommendation REC-html401-19991224, December 1999 (HTML).
[XEP-0060]Millard, P., Saint-Andre, P., and R. Meijer, “Publish-Subscribe,” XSF XEP 0060.
+ +
+
 TOC 
+

Appendix A.  +Specification Feedback

+ +

Feedback on this specification is welcomed via the + pubsubhubbub mailing list, pubsubhubbub@googlegroups.com. For + more information, see the + PubSubHubbub group on Google Groups. Also, check out the + FAQ + and other + documentation. + +

+
+
 TOC 
+

Authors' Addresses

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + +
 Brad Fitzpatrick
 Google, Inc
Email: brad@danga.com
  
 Brett Slatkin
 Google, Inc
Email: bslatkin@gmail.com
  
 Martin Atkins
 Six Apart Ltd.
Email: mart@degeneration.co.uk
  
 Julien Genestoux
 Notifixious Inc.
Email: julien@superfeedr.com
+ diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 410835d..985d100 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -12,7 +12,7 @@ $ xml2rfc pubsubhubbub-core-0.1.xml pubsubhubbub-core-0.1.html --> - + @@ -158,7 +158,6 @@ delta, it enqueues a notification to all registered subscribers. -
A potential subscriber initiates discovery by retrieving the topic to @@ -363,7 +362,7 @@ If (and when), the subscription has been accepted, the hub MUST indicate it to the subscriber by performing a notification - of the current state of the resource to the subscriber (see ). + of the current state of the resource to the subscriber (see ). (this is optional in synchronous mode). The subscriber will use this has an indication that its subscription has been confirmed. @@ -489,8 +488,6 @@ uses HTTPS callbacks.
- - @@ -620,23 +617,6 @@ - - - The Atom Syndication Format - - - - - - - - - - - - - - @@ -677,16 +657,6 @@ - - - RSS 2.0 - - - - - - -
From dd309e22786cc5bb627d61c4e9510fd47806da4d Mon Sep 17 00:00:00 2001 From: julien Date: Wed, 15 Feb 2012 22:19:19 -0800 Subject: [PATCH 04/76] clarified 'content delivery' as per Ralphm's feedback --- pubsubhubbub-core.xml | 101 +++--------------------------------------- 1 file changed, 7 insertions(+), 94 deletions(-) diff --git a/pubsubhubbub-core.xml b/pubsubhubbub-core.xml index d30554e..aff8917 100644 --- a/pubsubhubbub-core.xml +++ b/pubsubhubbub-core.xml @@ -135,18 +135,12 @@ be updated and the hub looks up all subscriptions for affected topics, sending out notifications to subscribers. - A payload describing how a topic's - contents have changed. This difference (or "delta") is computed by the - hub and sent to all subscribers. The format of the notification will - be an Atom or RSS feed served by the publisher with only those entries - present which are new or have changed. The notification can be the - result of a publisher telling the hub of an update, or the hub - proactively polling a topic feed, perhaps for a subscriber subscribing - to a topic that's not pubsub-aware. Note also that a notification to a - subscriber can be a payload consisting of updates for multiple topics. - Hubs MAY choose to send multi-topic notifications as an optimization - for heavy subscribers, but subscribers MUST understand them. See for format details. + A payload which can either be the + topic's full content of the difference (or "delta") computed by the + hub between the previous content of the resource and its current context. + The notification can be the result of a publisher telling the hub of an + update, or the hub proactively polling a topic, perhaps for a subscriber + subscribing to a topic that's not pubsub-aware.
@@ -700,91 +694,10 @@ User-Agent: MyHub (+http://hub.example.com; 26 subscribers) MUST still return a 2xx success response to acknowledge receipt, but locally ignore the message as invalid. Using this technique along with HTTPS for subscription requests enables simple subscribers to receive - authenticated content delivery from hubs without the need for + authenticated notifications from hubs without the need for subscribers to run an HTTPS server. - -
- - For Atom feeds only. Pending further review. - - When a subscriber indicates the same callback URL is used for - multiple subscriptions, hubs MAY choose to combine content delivery - requests into a single payload containing an aggregated set of feeds. - This bulk delivery results in fewer requests and more efficient - distribution. If the subscriber indicated a hub.secret value for these overlapping - subscriptions, the secret MUST also be the same for all subscriptions. - This allows the hub to generate a single X-Hub-Signature header to sign the entire payload. - Hubs MUST return an error response (4xx, 5xx) for subscription - requests with overlapping callback URLs and different secret values. - - - With an aggregated set of feeds, the hub SHOULD reproduce all of the - elements from the source feed inside the - corresponding atom:entry in the content - distribution request by using an atom:source - element. However, the atom:id value MUST be - reproduced exactly within the source element. If the source entry does - not have an atom:source element, the hub - MUST create an atom:source element - containing the atom:id element. The hub - SHOULD also include the atom:title element - and an atom:link element with rel="self" values that are functionally - equivalent to the corresponding elements in the original topic feed. - - Example aggregated feed: - -
- - - Aggregated feed - 2008-08-11T02:17:44Z - http://myhub.example.com/aggregated?1232427842-39823 - - - - http://www.example.com/foo - - - Mr. Bar - - - Testing Foo - - http://publisher.example.com/foo24.xml - 2008-08-11T02:15:01Z - - This is some content from the user named foo. - - - - - - http://www.example.com/bar - - - Mr. Bar - - - Testing Bar - - http://publisher.example.com/bar18.xml - 2008-08-11T02:17:44Z - - Some data from the user named bar. - - - - -]]> -
- -
From 7457abe742307c1bb7f40eaf7feee2250a485c41 Mon Sep 17 00:00:00 2001 From: julien Date: Wed, 15 Feb 2012 22:20:51 -0800 Subject: [PATCH 05/76] Revert "clarified 'content delivery' as per Ralphm's feedback" This reverts commit dd309e22786cc5bb627d61c4e9510fd47806da4d. --- pubsubhubbub-core.xml | 101 +++++++++++++++++++++++++++++++++++++++--- 1 file changed, 94 insertions(+), 7 deletions(-) diff --git a/pubsubhubbub-core.xml b/pubsubhubbub-core.xml index aff8917..d30554e 100644 --- a/pubsubhubbub-core.xml +++ b/pubsubhubbub-core.xml @@ -135,12 +135,18 @@ be updated and the hub looks up all subscriptions for affected topics, sending out notifications to subscribers. - A payload which can either be the - topic's full content of the difference (or "delta") computed by the - hub between the previous content of the resource and its current context. - The notification can be the result of a publisher telling the hub of an - update, or the hub proactively polling a topic, perhaps for a subscriber - subscribing to a topic that's not pubsub-aware. + A payload describing how a topic's + contents have changed. This difference (or "delta") is computed by the + hub and sent to all subscribers. The format of the notification will + be an Atom or RSS feed served by the publisher with only those entries + present which are new or have changed. The notification can be the + result of a publisher telling the hub of an update, or the hub + proactively polling a topic feed, perhaps for a subscriber subscribing + to a topic that's not pubsub-aware. Note also that a notification to a + subscriber can be a payload consisting of updates for multiple topics. + Hubs MAY choose to send multi-topic notifications as an optimization + for heavy subscribers, but subscribers MUST understand them. See for format details.
@@ -694,10 +700,91 @@ User-Agent: MyHub (+http://hub.example.com; 26 subscribers) MUST still return a 2xx success response to acknowledge receipt, but locally ignore the message as invalid. Using this technique along with HTTPS for subscription requests enables simple subscribers to receive - authenticated notifications from hubs without the need for + authenticated content delivery from hubs without the need for subscribers to run an HTTPS server. + +
+ + For Atom feeds only. Pending further review. + + When a subscriber indicates the same callback URL is used for + multiple subscriptions, hubs MAY choose to combine content delivery + requests into a single payload containing an aggregated set of feeds. + This bulk delivery results in fewer requests and more efficient + distribution. If the subscriber indicated a hub.secret value for these overlapping + subscriptions, the secret MUST also be the same for all subscriptions. + This allows the hub to generate a single X-Hub-Signature header to sign the entire payload. + Hubs MUST return an error response (4xx, 5xx) for subscription + requests with overlapping callback URLs and different secret values. + + + With an aggregated set of feeds, the hub SHOULD reproduce all of the + elements from the source feed inside the + corresponding atom:entry in the content + distribution request by using an atom:source + element. However, the atom:id value MUST be + reproduced exactly within the source element. If the source entry does + not have an atom:source element, the hub + MUST create an atom:source element + containing the atom:id element. The hub + SHOULD also include the atom:title element + and an atom:link element with rel="self" values that are functionally + equivalent to the corresponding elements in the original topic feed. + + Example aggregated feed: + +
+ + + Aggregated feed + 2008-08-11T02:17:44Z + http://myhub.example.com/aggregated?1232427842-39823 + + + + http://www.example.com/foo + + + Mr. Bar + + + Testing Foo + + http://publisher.example.com/foo24.xml + 2008-08-11T02:15:01Z + + This is some content from the user named foo. + + + + + + http://www.example.com/bar + + + Mr. Bar + + + Testing Bar + + http://publisher.example.com/bar18.xml + 2008-08-11T02:17:44Z + + Some data from the user named bar. + + + + +]]> +
+ +
From b06a92e03972dc805c7376742dc279b021f3fe89 Mon Sep 17 00:00:00 2001 From: julien Date: Wed, 15 Feb 2012 22:22:39 -0800 Subject: [PATCH 06/76] clarified 'content delivery' as per Ralphm's feedback --- pubsubhubbub-core-0.4.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 985d100..6dcebbe 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -134,7 +134,7 @@ sending out notifications to subscribers. A payload describing how a topic's - contents have changed, or the full cupdated content. + contents have changed, or the full updated content. Depending on the topic's content type, the difference (or "delta") may be computed by the hub and sent to all subscribers. @@ -479,7 +479,7 @@ MUST still return a 2xx success response to acknowledge receipt, but locally ignore the message as invalid. Using this technique along with HTTPS for subscription requests enables - simple subscribers to receive authenticated content delivery from hubs + simple subscribers to receive authenticated notifications from hubs without the need for subscribers to run an HTTPS server. Please note however that this signature only ensures that the payload From 7ac2e599865e6929ecc6b2eb573600b1c4cfd4e9 Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 24 Feb 2012 10:44:41 +0100 Subject: [PATCH 07/76] =?UTF-8?q?using=20Link=20Header=20per=20Evan's=20re?= =?UTF-8?q?quest.=20Fixes=20issue=20#=C3=A92?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- pubsubhubbub-core-0.4.xml | 38 ++++++++++++++++++++++++++------------ 1 file changed, 26 insertions(+), 12 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 6dcebbe..278fba7 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -160,16 +160,15 @@
- A potential subscriber initiates discovery by retrieving the topic to - which it wants to subscribe. The HTTP response from the publisher MUST - include at least one X-Hub-Url - HTTP header, as well as exactly one X-Hub-Self-Url - HTTP header. The X-Hub-Url MUST - indicate the exact url of the PubSubHubbub hub designated by the publisher. + A potential subscriber initiates discovery by retrieving (GET or HEAD request) + the topic to which it wants to subscribe. The HTTP response from the publisher MUST + include at least one Link Header with + rel=hub (a hub link header) as well as exactly one Link Header + with rel=self (the self link header). + The former MUST indicate the exact url of a PubSubHubbub hub designated by the publisher. If more than one url is specified, it is expected that the publisher pings each of these urls, so the subscriber may subscribe to one or more of these. - The X-Hub-Self-Url will point to the - permanent URL for the resource being polled. + The former will point to the permanent URL for the resource being polled. Example: @@ -249,7 +248,7 @@ The topic and callback URLs MAY use HTTP or HTTPS schemes. The topic URL MUST - be the one advertised by the publisher in the X-Hub-Self-Url + be the one advertised by the publisher in a Hub Link Header Header during the discovery phase. (See ). Hubs MAY refuse subscriptions if the topic url does not correspond to the one advertised by the publisher. The topic URL can otherwise be free-form @@ -366,7 +365,7 @@ (this is optional in synchronous mode). The subscriber will use this has an indication that its subscription has been confirmed. - Additionally, this notification MUST include a X-Hub-Self-Url + Additionally, this notification MUST include a Self Link Header HTTP header which indicates to the subscriber to what feed he has been subscribed. This feed url MAY be different from the feed for which the subscriber has initially subscribed, as the publisher MAY have considered that this one was better suited for the subscriber. @@ -441,8 +440,8 @@ type of the topic. The hub MAY reduce the payload to a diff if its format allows it. - The POST request must include a X-Hub-Self-Url - and a X-Hub-Url HTTP headers that correspond + The POST request must include the Self Link Header + and a Hub Link Header that correspond to topic's url, as well as hub. The successful response from the subscriber's callback URL MUST be an @@ -588,6 +587,21 @@ + + + Web Linking + + + + + This document specifies relation types for Web links, and defines a + registry for them. It also defines the use of such links in HTTP + headers with the Link header field. + + + + + US Secure Hash Algorithm 1 (SHA1) From cde42a14af6d999db93bef885561877137ae4d73 Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 24 Feb 2012 10:51:07 +0100 Subject: [PATCH 08/76] pointing to the W3C CG for feedback. Fixes #6 --- pubsubhubbub-core-0.4.xml | 10 +++------- 1 file changed, 3 insertions(+), 7 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 278fba7..b300aab 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -675,14 +675,10 @@
Feedback on this specification is welcomed via the - pubsubhubbub mailing list, pubsubhubbub@googlegroups.com. For + PubSubHubbub W3C Community Group. For more information, see the - PubSubHubbub group on Google Groups. Also, check out the - FAQ - and other - documentation. + target="http://www.w3.org/community/pubsub/">the + W3C PubSubHubbub Community Group.
From 6507fb63b67c727caf1a9847a2486460c5742009 Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 24 Feb 2012 10:56:56 +0100 Subject: [PATCH 09/76] fixing tags --- pubsubhubbub-core-0.4.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index b300aab..87a656f 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -162,8 +162,8 @@
A potential subscriber initiates discovery by retrieving (GET or HEAD request) the topic to which it wants to subscribe. The HTTP response from the publisher MUST - include at least one Link Header with - rel=hub (a hub link header) as well as exactly one Link Header + include at least one Link Header with + rel=hub (a hub link header) as well as exactly one Link Header with rel=self (the self link header). The former MUST indicate the exact url of a PubSubHubbub hub designated by the publisher. If more than one url is specified, it is expected that the publisher pings each From 07a6cf945a2c43746534a4ce86668efae2a808e1 Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 24 Feb 2012 10:58:04 +0100 Subject: [PATCH 10/76] fixing tag issue --- pubsubhubbub-core-0.4.html | 38 ++++++++++++++++++-------------------- pubsubhubbub-core-0.4.xml | 2 +- 2 files changed, 19 insertions(+), 21 deletions(-) diff --git a/pubsubhubbub-core-0.4.html b/pubsubhubbub-core-0.4.html index cf91acd..86bae54 100644 --- a/pubsubhubbub-core-0.4.html +++ b/pubsubhubbub-core-0.4.html @@ -264,7 +264,7 @@

Table of Contents

Notification:
A payload describing how a topic's - contents have changed, or the full cupdated content. + contents have changed, or the full updated content. Depending on the topic's content type, the difference (or "delta") may be computed by the hub and sent to all subscribers.
@@ -299,16 +299,15 @@

Table of Contents

4.  Discovery

-

A potential subscriber initiates discovery by retrieving the topic to - which it wants to subscribe. The HTTP response from the publisher MUST - include at least one X-Hub-Url - HTTP header, as well as exactly one X-Hub-Self-Url - HTTP header. The X-Hub-Url MUST - indicate the exact url of the PubSubHubbub hub designated by the publisher. +

A potential subscriber initiates discovery by retrieving (GET or HEAD request) + the topic to which it wants to subscribe. The HTTP response from the publisher MUST + include at least one Link Header (Nottingham, M., “Web Linking,” October 2010.) [RFC5988] with + rel=hub (a hub link header) as well as exactly one Link Header (Nottingham, M., “Web Linking,” October 2010.) [RFC5988] + with rel=self (the self link header). + The former MUST indicate the exact url of a PubSubHubbub hub designated by the publisher. If more than one url is specified, it is expected that the publisher pings each of these urls, so the subscriber may subscribe to one or more of these. - The X-Hub-Self-Url will point to the - permanent URL for the resource being polled. + The former will point to the permanent URL for the resource being polled.

Example:

@@ -407,7 +406,7 @@

Table of Contents

The topic and callback URLs MAY use HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] or HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] schemes. The topic URL MUST - be the one advertised by the publisher in the X-Hub-Self-Url + be the one advertised by the publisher in a Hub Link Header Header during the discovery phase. (See Section 4 (Discovery)). Hubs MAY refuse subscriptions if the topic url does not correspond to the one advertised by the publisher. The topic URL can otherwise be free-form @@ -528,7 +527,7 @@

Table of Contents

(this is optional in synchronous mode). The subscriber will use this has an indication that its subscription has been confirmed.

-

Additionally, this notification MUST include a X-Hub-Self-Url +

Additionally, this notification MUST include a Self Link Header HTTP header which indicates to the subscriber to what feed he has been subscribed. This feed url MAY be different from the feed for which the subscriber has initially subscribed, as the publisher MAY have considered that this one was better suited for the subscriber. @@ -610,8 +609,8 @@

Table of Contents

type of the topic. The hub MAY reduce the payload to a diff if its format allows it.

-

The POST request must include a X-Hub-Self-Url - and a X-Hub-Url HTTP headers that correspond +

The POST request must include the Self Link Header + and a Hub Link Header that correspond to topic's url, as well as hub.

The successful response from the subscriber's callback URL MUST be an @@ -647,7 +646,7 @@

Table of Contents

MUST still return a 2xx success response to acknowledge receipt, but locally ignore the message as invalid. Using this technique along with HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] for subscription requests enables - simple subscribers to receive authenticated content delivery from hubs + simple subscribers to receive authenticated notifications from hubs without the need for subscribers to run an HTTPS server.

Please note however that this signature only ensures that the payload @@ -674,6 +673,8 @@

9. References

Eastlake, D. and P. Jones, “US Secure Hash Algorithm 1 (SHA1),” RFC 3174, September 2001 (TXT). [RFC3986] Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” RFC 3986. +[RFC5988] +Nottingham, M., “Web Linking,” RFC 5988, October 2010 (TXT). [W3C.REC-html401-19991224] Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” World Wide Web Consortium Recommendation REC-html401-19991224, December 1999 (HTML). [XEP-0060] @@ -686,12 +687,9 @@

9. References

Specification Feedback

Feedback on this specification is welcomed via the - pubsubhubbub mailing list, pubsubhubbub@googlegroups.com. For - more information, see the - PubSubHubbub group on Google Groups. Also, check out the - FAQ - and other - documentation. + PubSubHubbub W3C Community Group. For + more information, see the + W3C PubSubHubbub Community Group.


diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 87a656f..c507c29 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -587,7 +587,7 @@ - + Web Linking From 667b02dc04cfbaf29404f46fc4e3c47585b1a301 Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 24 Feb 2012 16:30:37 +0100 Subject: [PATCH 11/76] Ralphm's comment about fallback. For some reason I couldn't merge --- pubsubhubbub-core-0.4.xml | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index c507c29..f987f97 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -179,6 +179,13 @@ depending on the hub's policy. If the advertised url is HTTP, subscriber MAY choose to try HTTPS first. + + In the absence of HTTP Link headers, subscribers MAY fall back to + other methods to discover the hub(s) and the canonical URI of the topic. + If the topic is a Atom or RSS feed, it MAY use embedded link elements + as described in Appendix B of Web Linking. + Similarly, for HTML pages, it MAY use embedded link elements as described + in Appendix A of Web Linking.
From 7b128137a17d99e566ededc64be00acc04bb040e Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 24 Feb 2012 16:31:17 +0100 Subject: [PATCH 12/76] regenerating the html --- pubsubhubbub-core-0.4.html | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/pubsubhubbub-core-0.4.html b/pubsubhubbub-core-0.4.html index 86bae54..e75a515 100644 --- a/pubsubhubbub-core-0.4.html +++ b/pubsubhubbub-core-0.4.html @@ -318,6 +318,13 @@

Table of Contents

depending on the hub's policy. If the advertised url is HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616], subscriber MAY choose to try HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] first.

+

In the absence of HTTP Link headers, subscribers MAY fall back to + other methods to discover the hub(s) and the canonical URI of the topic. + If the topic is a Atom or RSS feed, it MAY use embedded link elements + as described in Appendix B of Web Linking (Nottingham, M., “Web Linking,” October 2010.) [RFC5988]. + Similarly, for HTML pages, it MAY use embedded link elements as described + in Appendix A of Web Linking (Nottingham, M., “Web Linking,” October 2010.) [RFC5988]. +


 TOC 

5.  From 5bcf9b954c71413f1a09ff2432b11f3f07ede375 Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 30 Mar 2012 20:27:36 +0200 Subject: [PATCH 13/76] using 202 as per Jay's comments --- pubsubhubbub-core.xml | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/pubsubhubbub-core.xml b/pubsubhubbub-core.xml index d30554e..8829a4e 100644 --- a/pubsubhubbub-core.xml +++ b/pubsubhubbub-core.xml @@ -478,7 +478,7 @@ The subscriber MUST confirm that the hub.topic and hub.verify_token correspond to a pending subscription or unsubscription that it wishes to carry - out. If so, the subscriber MUST respond with an HTTP success (2xx) + out. If so, the subscriber MUST respond with an HTTP success (202) code with a response body equal to the hub.challenge parameter. If the subscriber does not agree with the action, the subscriber MUST respond with a 404 "Not @@ -487,14 +487,14 @@ For synchronous verification, the hub MUST consider other server response codes (3xx, 4xx, 5xx) to mean that the verification request has immediately failed and no retries should occur. If the subscriber - returns an HTTP success (2xx) but the content body does not match the + returns an HTTP success (202) but the content body does not match the hub.challenge parameter, the hub MUST also consider verification to have failed. For asynchronous verification, the hub MUST consider other server response codes (3xx, 4xx, and 5xx) to mean that the subscription action was temporarily not verified. If - the subscriber returns an HTTP success (2xx) but the content body does + the subscriber returns an HTTP success (202) but the content body does not match the hub.challenge parameter, the hub MUST consider this to be a temporary failure and retry. The hub SHOULD retry verification a reasonable @@ -656,7 +656,7 @@ User-Agent: MyHub (+http://hub.example.com; 26 subscribers) that looks like the original but with old content removed. The successful response from the subscriber's callback URL MUST be an - HTTP success (2xx) code. The hub MUST consider all other subscriber + HTTP success (202) code. The hub MUST consider all other subscriber response codes as failures; that means subscribers MUST not use HTTP redirects for moving subscriptions. The response body from the subscriber MUST be ignored by the hub. Hubs SHOULD retry notifications @@ -697,7 +697,7 @@ User-Agent: MyHub (+http://hub.example.com; 26 subscribers) X-Hub-Signature header specified, they SHOULD recompute the SHA1 signature with the shared secret using the same method as the hub. If the signature does not match, subscribers - MUST still return a 2xx success response to acknowledge receipt, but + MUST still return a 202 success response to acknowledge receipt, but locally ignore the message as invalid. Using this technique along with HTTPS for subscription requests enables simple subscribers to receive authenticated content delivery from hubs without the need for From 137a382b4b5fcf7222fb9d871baed6d594b37e22 Mon Sep 17 00:00:00 2001 From: julien Date: Tue, 3 Apr 2012 09:59:36 +0200 Subject: [PATCH 14/76] fixing the initial for Julien Genestoux --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index f987f97..47ec32a 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -54,7 +54,7 @@ - + Notifixious Inc.
From 2e64f126de043e134d473a8cb53464535879a7e2 Mon Sep 17 00:00:00 2001 From: julien Date: Wed, 2 May 2012 12:31:48 +0200 Subject: [PATCH 15/76] Laurent Walter Groix comments --- pubsubhubbub-core-0.4.html | 15 +++------------ pubsubhubbub-core-0.4.xml | 13 ++----------- 2 files changed, 5 insertions(+), 23 deletions(-) diff --git a/pubsubhubbub-core-0.4.html b/pubsubhubbub-core-0.4.html index e75a515..0fdfa40 100644 --- a/pubsubhubbub-core-0.4.html +++ b/pubsubhubbub-core-0.4.html @@ -146,7 +146,7 @@  Google, Inc  M. Atkins  Six Apart Ltd. - M. Genestoux + J. Genestoux  Notifixious Inc.  February 5, 2012 @@ -307,16 +307,7 @@

Table of Contents

The former MUST indicate the exact url of a PubSubHubbub hub designated by the publisher. If more than one url is specified, it is expected that the publisher pings each of these urls, so the subscriber may subscribe to one or more of these. - The former will point to the permanent URL for the resource being polled. -

-

Example: -

-

Hubs should provide an HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] interface and publishers - SHOULD use HTTPS (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] in their hubs' discovery URLs. - However, subscribers that do not support HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] MAY - try to fallback to HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616], which MAY work - depending on the hub's policy. If the advertised url is HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616], - subscriber MAY choose to try HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] first. + The latter will point to the permanent URL for the resource being polled.

In the absence of HTTP Link headers, subscribers MAY fall back to other methods to discover the hub(s) and the canonical URI of the topic. @@ -622,7 +613,7 @@

Table of Contents

The successful response from the subscriber's callback URL MUST be an HTTP success (2xx) code. The hub MUST consider all other subscriber - response codes as failures; that means subscribers MUST not use HTTP + response codes as failures; that means subscribers MUST NOT use HTTP redirects for moving subscriptions. The response body from the subscriber MUST be ignored by the hub. Hubs SHOULD retry notifications repeatedly until successful (up to some reasonable maximum over a diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 47ec32a..2a408a3 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -168,16 +168,7 @@ The former MUST indicate the exact url of a PubSubHubbub hub designated by the publisher. If more than one url is specified, it is expected that the publisher pings each of these urls, so the subscriber may subscribe to one or more of these. - The former will point to the permanent URL for the resource being polled. - - Example: - - Hubs should provide an HTTPS interface and publishers - SHOULD use HTTPS in their hubs' discovery URLs. - However, subscribers that do not support HTTPS MAY - try to fallback to HTTP, which MAY work - depending on the hub's policy. If the advertised url is HTTP, - subscriber MAY choose to try HTTPS first. + The latter will point to the permanent URL for the resource being polled. In the absence of HTTP Link headers, subscribers MAY fall back to @@ -453,7 +444,7 @@ The successful response from the subscriber's callback URL MUST be an HTTP success (2xx) code. The hub MUST consider all other subscriber - response codes as failures; that means subscribers MUST not use HTTP + response codes as failures; that means subscribers MUST NOT use HTTP redirects for moving subscriptions. The response body from the subscriber MUST be ignored by the hub. Hubs SHOULD retry notifications repeatedly until successful (up to some reasonable maximum over a From 654ab27b2804df5705a311d32bb2b2faa705bb37 Mon Sep 17 00:00:00 2001 From: julien Date: Wed, 2 May 2012 14:20:56 +0200 Subject: [PATCH 16/76] adding From: header mention, as well as Location: for denied subscriptions --- pubsubhubbub-core-0.4.xml | 37 +++++++++++++++++++++++++------------ 1 file changed, 25 insertions(+), 12 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 2a408a3..ffd3346 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -241,6 +241,13 @@ the subscription state unchanged. This is required so subscribers can renew their subscriptions before the lease seconds period is over without any interruption. + + Subscribers MAY also include additional HTTP Query params, as well as HTTP Headers + if they are required by the hub, or the publisher. In the context + of social web applications, it is considered good practice to include a From + HTTP header (as described in section 14.22 of Hypertext Transfer Protocol). + This header should indicate on behalf of which user the subscription is being performed. +

@@ -326,7 +333,7 @@
The subscriber MUST confirm that the hub.topic - correspond to a pending subscription or unsubscription that it + corresponds to a pending subscription or unsubscription that it wishes to carry out. If so, the subscriber MUST respond with an HTTP success (2xx) code with a response body equal to the hub.challenge parameter. If the subscriber does @@ -357,18 +364,18 @@ more details to accept or refuse a subscription. The Hub MAY also check with the publisher whether the subscription should be accepted. - If (and when), the subscription has been accepted, - the hub MUST indicate it to the subscriber by performing a notification - of the current state of the resource to the subscriber (see ). - (this is optional in synchronous mode). The subscriber will use this has - an indication that its subscription has been confirmed. - Additionally, this notification MUST include a Self Link Header - HTTP header which indicates to the subscriber to what feed he has been subscribed. - This feed url MAY be different from the feed for which the subscriber has initially subscribed, - as the publisher MAY have considered that this one was better suited for the subscriber. - (This is specifically useful in the context of private content with limited distribution.) - + If (and when), the subscription is accepted, the hub will inform the subscriber + by sending an HTTP GET request to the subscriber's + callback URL as given in the subscription request. This request has the following + query string arguments appended (format described in Section 17.13.4 of + ): + + REQUIRED. The literal string "accepted". + REQUIRED. The topic URL given in the corresponding + subscription request. + + If (and when), the subscription is denied, the hub will inform the subscriber by sending an HTTP GET request to the subscriber's callback URL as given in the subscription request. This request has the following @@ -382,6 +389,12 @@ for which the subscription has been denied. + Hubs may provide an additional HTTP Location header (as described in section 14.30 + of Hypertext Transfer Protocol) to indicate that the + subscriber may retry subscribing to a different hub.topic. This will allow + for limited distribution to specific groups, users in the context of social web + applications. + The subscription may be intentionally denied by the hub at any point (even if it was previously accepted). The Subscriber SHOULD then consider that the subscription is not possible anymore. From df2d64ce5ec1380939eaeeb79d0f930c6003555f Mon Sep 17 00:00:00 2001 From: julien Date: Wed, 2 May 2012 14:21:26 +0200 Subject: [PATCH 17/76] regenerated the 0.4 html --- pubsubhubbub-core-0.4.html | 42 +++++++++++++++++++++++++++----------- 1 file changed, 30 insertions(+), 12 deletions(-) diff --git a/pubsubhubbub-core-0.4.html b/pubsubhubbub-core-0.4.html index 0fdfa40..cb23484 100644 --- a/pubsubhubbub-core-0.4.html +++ b/pubsubhubbub-core-0.4.html @@ -397,6 +397,13 @@

Table of Contents

renew their subscriptions before the lease seconds period is over without any interruption.

+

Subscribers MAY also include additional HTTP Query params, as well as HTTP Headers + if they are required by the hub, or the publisher. In the context + of social web applications, it is considered good practice to include a From + HTTP header (as described in section 14.22 of Hypertext Transfer Protocol (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616]). + This header should indicate on behalf of which user the subscription is being performed. + +


 TOC 

5.1.1.  @@ -490,7 +497,7 @@

Table of Contents

Verification Details

The subscriber MUST confirm that the hub.topic - correspond to a pending subscription or unsubscription that it + corresponds to a pending subscription or unsubscription that it wishes to carry out. If so, the subscriber MUST respond with an HTTP success (2xx) code with a response body equal to the hub.challenge parameter. If the subscriber does not agree with the action, the subscriber MUST respond with a 404 "Not @@ -519,18 +526,23 @@

Table of Contents

more details to accept or refuse a subscription. The Hub MAY also check with the publisher whether the subscription should be accepted.

-

If (and when), the subscription has been accepted, - the hub MUST indicate it to the subscriber by performing a notification - of the current state of the resource to the subscriber (see Section 7 (Content Distribution)). - (this is optional in synchronous mode). The subscriber will use this has - an indication that its subscription has been confirmed. -

-

Additionally, this notification MUST include a Self Link Header - HTTP header which indicates to the subscriber to what feed he has been subscribed. - This feed url MAY be different from the feed for which the subscriber has initially subscribed, - as the publisher MAY have considered that this one was better suited for the subscriber. - (This is specifically useful in the context of private content with limited distribution.) +

If (and when), the subscription is accepted, the hub will inform the subscriber + by sending an HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] GET request to the subscriber's + callback URL as given in the subscription request. This request has the following + query string arguments appended (format described in Section 17.13.4 of + [W3C.REC‑html401‑19991224] (Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” December 1999.)):

+

+
+
hub.mode
+
REQUIRED. The literal string "accepted". +
+
hub.topic
+
REQUIRED. The topic URL given in the corresponding + subscription request. +
+
+

If (and when), the subscription is denied, the hub will inform the subscriber by sending an HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] GET request to the subscriber's callback URL as given in the subscription request. This request has the following @@ -552,6 +564,12 @@

Table of Contents

+

Hubs may provide an additional HTTP Location header (as described in section 14.30 + of Hypertext Transfer Protocol (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616]) to indicate that the + subscriber may retry subscribing to a different hub.topic. This will allow + for limited distribution to specific groups, users in the context of social web + applications. +

The subscription may be intentionally denied by the hub at any point (even if it was previously accepted). The Subscriber SHOULD then consider that the subscription is not possible anymore. From 66d902a5c5e8a6a5dea8666b49a9ef5132436361 Mon Sep 17 00:00:00 2001 From: julien Date: Wed, 2 May 2012 14:25:55 +0200 Subject: [PATCH 18/76] adding host-meta discovery fallback mechanism --- pubsubhubbub-core-0.4.xml | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index ffd3346..fd261c0 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -176,7 +176,9 @@ If the topic is a Atom or RSS feed, it MAY use embedded link elements as described in Appendix B of Web Linking. Similarly, for HTML pages, it MAY use embedded link elements as described - in Appendix A of Web Linking. + in Appendix A of Web Linking. Finally, publishers + MAY also use the Well-Known Uniform Resource Identifiers + .host-meta to include the <Link> element.

From 54d2b2165f08ce4672f239ee36fa4f8ef30138e2 Mon Sep 17 00:00:00 2001 From: julien Date: Wed, 2 May 2012 14:31:07 +0200 Subject: [PATCH 19/76] adding reference to RFC5785 --- pubsubhubbub-core-0.4.html | 6 +++++- pubsubhubbub-core-0.4.xml | 18 ++++++++++++++++++ 2 files changed, 23 insertions(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.html b/pubsubhubbub-core-0.4.html index cb23484..4386f3f 100644 --- a/pubsubhubbub-core-0.4.html +++ b/pubsubhubbub-core-0.4.html @@ -314,7 +314,9 @@

Table of Contents

If the topic is a Atom or RSS feed, it MAY use embedded link elements as described in Appendix B of Web Linking (Nottingham, M., “Web Linking,” October 2010.) [RFC5988]. Similarly, for HTML pages, it MAY use embedded link elements as described - in Appendix A of Web Linking (Nottingham, M., “Web Linking,” October 2010.) [RFC5988]. + in Appendix A of Web Linking (Nottingham, M., “Web Linking,” October 2010.) [RFC5988]. Finally, publishers + MAY also use the Well-Known Uniform Resource Identifiers (Nottingham, M. and E. Hammer-Lahav, “Defining Well-Known Uniform Resource Identifiers (URIs),” .) [RFC5785] + .host-meta to include the <Link> element.


 TOC 
@@ -689,6 +691,8 @@

9. References

Eastlake, D. and P. Jones, “US Secure Hash Algorithm 1 (SHA1),” RFC 3174, September 2001 (TXT). [RFC3986] Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” RFC 3986. +[RFC5785] +Nottingham, M. and E. Hammer-Lahav, “Defining Well-Known Uniform Resource Identifiers (URIs),” RFC 5785. [RFC5988] Nottingham, M., “Web Linking,” RFC 5988, October 2010 (TXT). [W3C.REC-html401-19991224] diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index fd261c0..8e3fca8 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -643,6 +643,24 @@ + + + + Defining Well-Known Uniform Resource Identifiers (URIs) + + + + + + + + + + + + From d097c90c9ed30a7adfe5d9a10b57f9eeea60a5e6 Mon Sep 17 00:00:00 2001 From: julien Date: Wed, 30 May 2012 10:27:46 +0200 Subject: [PATCH 20/76] mentionning an XML based feed, rather than RSS/Atom --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 8e3fca8..4a93d9d 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -173,7 +173,7 @@ In the absence of HTTP Link headers, subscribers MAY fall back to other methods to discover the hub(s) and the canonical URI of the topic. - If the topic is a Atom or RSS feed, it MAY use embedded link elements + If the topic is an XML based feed, it MAY use embedded link elements as described in Appendix B of Web Linking. Similarly, for HTML pages, it MAY use embedded link elements as described in Appendix A of Web Linking. Finally, publishers From 86331adda774c934e824f62fef8072dad8cea4f8 Mon Sep 17 00:00:00 2001 From: julien Date: Wed, 30 May 2012 10:28:28 +0200 Subject: [PATCH 21/76] rebuilt the HTML feed --- pubsubhubbub-core-0.4.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.html b/pubsubhubbub-core-0.4.html index 4386f3f..5703969 100644 --- a/pubsubhubbub-core-0.4.html +++ b/pubsubhubbub-core-0.4.html @@ -311,7 +311,7 @@

Table of Contents

In the absence of HTTP Link headers, subscribers MAY fall back to other methods to discover the hub(s) and the canonical URI of the topic. - If the topic is a Atom or RSS feed, it MAY use embedded link elements + If the topic is an XML based feed, it MAY use embedded link elements as described in Appendix B of Web Linking (Nottingham, M., “Web Linking,” October 2010.) [RFC5988]. Similarly, for HTML pages, it MAY use embedded link elements as described in Appendix A of Web Linking (Nottingham, M., “Web Linking,” October 2010.) [RFC5988]. Finally, publishers From d7119f0ca634fc39fc3bc69fad8023a88e4cbecd Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 4 Jun 2012 09:54:30 +0200 Subject: [PATCH 22/76] activate is now activated. Thank you Alkis --- pubsubhubbub-core.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core.xml b/pubsubhubbub-core.xml index 8829a4e..bab7d77 100644 --- a/pubsubhubbub-core.xml +++ b/pubsubhubbub-core.xml @@ -369,7 +369,7 @@ understand. Hubs MUST allow subscribers to re-request subscriptions that are - already activate. Each subsequent request to a hub to subscribe or + already activated. Each subsequent request to a hub to subscribe or unsubscribe MUST override the previous subscription state for a specific topic URL and callback URL combination once the action is verified. Any failures to confirm the subscription action MUST leave From 840b1277521f742d158108e3e2b343b6ad472ca6 Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 4 Jun 2012 10:07:46 +0200 Subject: [PATCH 23/76] activate is now activated. Thank you Alkis --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 4a93d9d..0211080 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -236,7 +236,7 @@ understand. Hubs MUST allow subscribers to re-request subscriptions that are - already activate. Each subsequent request to a hub to subscribe or + already activated. Each subsequent request to a hub to subscribe or unsubscribe MUST override the previous subscription state for a specific topic URL and callback URL combination once the action is verified. Any failures to confirm the subscription action MUST leave From 66f23fadca2d131006cd8cb051f87b333d09b716 Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 4 Jun 2012 10:12:55 +0200 Subject: [PATCH 24/76] minor working changes to clarify things. Thanks alkis --- pubsubhubbub-core-0.4.xml | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 0211080..17fd0ef 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -450,12 +450,12 @@ target="RFC2616">HTTP POST request from hub to the subscriber's callback URL with the payload of the notification. This request MUST have a Content-Type corresponding to the - type of the topic. The hub MAY reduce the payload to a diff if its format - allows it. + type of the topic. The hub MAY reduce the payload to a diff between two + consecutive versions if its format allows it. The POST request must include the Self Link Header and a Hub Link Header that correspond - to topic's url, as well as hub. + to topic's url, as well as hub url respectively. The successful response from the subscriber's callback URL MUST be an HTTP success (2xx) code. The hub MUST consider all other subscriber From 5eae0492f2fdb5de18dcfc0f32ca2d51099ca705 Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 4 Jun 2012 10:19:32 +0200 Subject: [PATCH 25/76] removed permanent subscriptions mentions. All subscriptions have an expiration --- pubsubhubbub-core-0.4.xml | 26 +++++--------------------- 1 file changed, 5 insertions(+), 21 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 17fd0ef..b542198 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -215,11 +215,10 @@ OPTIONAL. Number of seconds for which the subscriber would like to have the subscription active. If - not present or an empty value, the subscription will be permanent - (or active until automatic - refreshing removes the subscription). Hubs MAY choose to - respect this value or not, depending on their own policies. This - parameter MAY be present for unsubscription requests and MUST be + not present or an empty value, hubs SHOULD provide a default value + upon verification of intent.Hubs MAY + choose to respect this value or not, depending on their own policies. + This parameter MAY be present for unsubscription requests and MUST be ignored by the hub in that case. OPTIONAL. A subscriber-provided secret @@ -353,11 +352,7 @@ request but MAY change the value depending on the hub's policies. To sustain a temporary subscription, the subscriber MUST re-request the subscription on the hub before hub.lease_seconds seconds has elapsed. For - permanent subscriptions with no hub.lease_seconds value specified, the behavior - is different as described in the section on automatic subscription refreshing. + style="verb">hub.lease_seconds seconds has elapsed.

@@ -422,17 +417,6 @@ constantly returns an error, the hub MUST give up on the subscription verification action altogether and remove the subscription. - In the case of permanent subscriptions (with no hub.lease_seconds specified in the original - request), the hub.lease_seconds value - supplied by the hub in the verification request to the subscriber SHOULD - represent how many seconds until the hub expects it will next initiate - automatic subscription refreshing to ensure that the subscriber is still - interested in the topic. This behavior provides the best of both worlds: - maximum simplicity of the subscriber through infinitely-long - subscriptions, but still garbage collectable subscriptions for hub - hygiene. -
From 2aa6302ef1f8e0cafebbfce51febce2459528abe Mon Sep 17 00:00:00 2001 From: alkis Date: Mon, 4 Jun 2012 19:45:59 +0300 Subject: [PATCH 26/76] Require that hubs respond with a hub.lease_seconds. --- pubsubhubbub-core-0.4.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index b542198..eb3cb03 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -215,8 +215,8 @@ OPTIONAL. Number of seconds for which the subscriber would like to have the subscription active. If - not present or an empty value, hubs SHOULD provide a default value - upon verification of intent.Hubs MAY + not present or an empty value, hubs MUST provide a value upon + verification of intent.Hubs MAY choose to respect this value or not, depending on their own policies. This parameter MAY be present for unsubscription requests and MUST be ignored by the hub in that case. From a3ea1748e14a3f038a387a73b3b33fc3ded818cd Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 18 Jun 2012 16:27:48 +0200 Subject: [PATCH 27/76] url is now URL --- pubsubhubbub-core-0.4.xml | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index b542198..8394b52 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -165,9 +165,9 @@ include at least one Link Header with rel=hub (a hub link header) as well as exactly one Link Header with rel=self (the self link header). - The former MUST indicate the exact url of a PubSubHubbub hub designated by the publisher. - If more than one url is specified, it is expected that the publisher pings each - of these urls, so the subscriber may subscribe to one or more of these. + The former MUST indicate the exact URL of a PubSubHubbub hub designated by the publisher. + If more than one URL is specified, it is expected that the publisher pings each + of these URLs, so the subscriber may subscribe to one or more of these. The latter will point to the permanent URL for the resource being polled. @@ -256,7 +256,7 @@ or HTTPS schemes. The topic URL MUST be the one advertised by the publisher in a Hub Link Header Header during the discovery phase. (See ). - Hubs MAY refuse subscriptions if the topic url does not correspond to the one + Hubs MAY refuse subscriptions if the topic URL does not correspond to the one advertised by the publisher. The topic URL can otherwise be free-form following the URI spec. Hubs MUST always decode non-reserved characters for these URL parameters; see section 2.4 on @@ -439,7 +439,7 @@ The POST request must include the Self Link Header and a Hub Link Header that correspond - to topic's url, as well as hub url respectively. + to topic's URL, as well as hub URL respectively. The successful response from the subscriber's callback URL MUST be an HTTP success (2xx) code. The hub MUST consider all other subscriber From 899e595af627c33f8a787c0b72bfc6a2c3796f32 Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 18 Jun 2012 16:36:15 +0200 Subject: [PATCH 28/76] s/HTTP Query params/request parameters/ --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 8394b52..81bebf9 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -243,7 +243,7 @@ renew their subscriptions before the lease seconds period is over without any interruption. - Subscribers MAY also include additional HTTP Query params, as well as HTTP Headers + Subscribers MAY also include additional HTTP request parameters, as well as HTTP Headers if they are required by the hub, or the publisher. In the context of social web applications, it is considered good practice to include a From HTTP header (as described in section 14.22 of Hypertext Transfer Protocol). From 6bd2223202965dceb44dcd764f264d564b897221 Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 18 Jun 2012 16:41:44 +0200 Subject: [PATCH 29/76] rephrased based on Roman's comments --- pubsubhubbub-core-0.4.xml | 11 ++++++----- 1 file changed, 6 insertions(+), 5 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 417460f..6192d68 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -243,11 +243,12 @@ renew their subscriptions before the lease seconds period is over without any interruption. - Subscribers MAY also include additional HTTP request parameters, as well as HTTP Headers - if they are required by the hub, or the publisher. In the context - of social web applications, it is considered good practice to include a From - HTTP header (as described in section 14.22 of Hypertext Transfer Protocol). - This header should indicate on behalf of which user the subscription is being performed. + Subscribers MAY also include additional HTTP request parameters, as well + as HTTP Headers if they are required by the hub, or the publisher. + In the context of social web applications, it is considered good + practice to include a From HTTP header (as described in section 14.22 + of Hypertext Transfer Protocol) to indicate + on behalf of which user the subscription is being performed.
From b3814b88b17ed4519bd52d7a0b801ab80077ed97 Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 18 Jun 2012 16:55:15 +0200 Subject: [PATCH 30/76] fixed Hub vs Self Link --- pubsubhubbub-core-0.4.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 6192d68..1479348 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -255,8 +255,8 @@ The topic and callback URLs MAY use HTTP or HTTPS schemes. The topic URL MUST - be the one advertised by the publisher in a Hub Link Header - Header during the discovery phase. (See ). + be the one advertised by the publisher in a Self Link Header + during the discovery phase. (See ). Hubs MAY refuse subscriptions if the topic URL does not correspond to the one advertised by the publisher. The topic URL can otherwise be free-form following the URI spec. Hubs MUST always From 6f2a740c3774d89026433d86ef2e84ac87164741 Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 18 Jun 2012 16:56:57 +0200 Subject: [PATCH 31/76] wills are MUST --- pubsubhubbub-core-0.4.xml | 7 +++---- 1 file changed, 3 insertions(+), 4 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 1479348..1c74a43 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -362,8 +362,7 @@ more details to accept or refuse a subscription. The Hub MAY also check with the publisher whether the subscription should be accepted. - - If (and when), the subscription is accepted, the hub will inform the subscriber + If (and when), the subscription is accepted, the hub MUST inform the subscriber by sending an HTTP GET request to the subscriber's callback URL as given in the subscription request. This request has the following query string arguments appended (format described in Section 17.13.4 of @@ -374,7 +373,7 @@ subscription request. - If (and when), the subscription is denied, the hub will inform the subscriber + If (and when), the subscription is denied, the hub MUST inform the subscriber by sending an HTTP GET request to the subscriber's callback URL as given in the subscription request. This request has the following query string arguments appended (format described in Section 17.13.4 of @@ -389,7 +388,7 @@ Hubs may provide an additional HTTP Location header (as described in section 14.30 of Hypertext Transfer Protocol) to indicate that the - subscriber may retry subscribing to a different hub.topic. This will allow + subscriber may retry subscribing to a different hub.topic. This allows for limited distribution to specific groups, users in the context of social web applications. From 9e21e2d12ba5b5aa5130f9ddd0098f8e75ac83fd Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 25 Jun 2012 14:43:56 +0200 Subject: [PATCH 32/76] SHOULD is not necessary but added a good practice --- pubsubhubbub-core-0.4.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 1c74a43..1668be4 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -204,8 +204,8 @@ REQUIRED. The subscriber's callback URL - where notifications should be delivered. The subscriber's - callback URL SHOULD be unique for each subscription. + where notifications should be delivered. It is considered good practice + to use a unique callback url for each subscription. REQUIRED. The literal string "subscribe" or "unsubscribe", depending on the goal of the request. From c5e4ea22fefe7217b4e8c413f71ad16cbd35e76b Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 25 Jun 2012 14:45:38 +0200 Subject: [PATCH 33/76] removed a confusing statement about publihser's required headers/params --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 1668be4..686963c 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -244,7 +244,7 @@ without any interruption. Subscribers MAY also include additional HTTP request parameters, as well - as HTTP Headers if they are required by the hub, or the publisher. + as HTTP Headers if they are required by the hub. In the context of social web applications, it is considered good practice to include a From HTTP header (as described in section 14.22 of Hypertext Transfer Protocol) to indicate From 3fed2f18a3a54c8c46e79e014ad67adda727f7bb Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 25 Jun 2012 15:00:37 +0200 Subject: [PATCH 34/76] wording: removed intentionnaly per Roman's comments and upcased MAY --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 686963c..3f8ccfc 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -392,7 +392,7 @@ for limited distribution to specific groups, users in the context of social web applications. - The subscription may be intentionally denied by the hub at any point (even + The subscription MAY be denied by the hub at any point (even if it was previously accepted). The Subscriber SHOULD then consider that the subscription is not possible anymore. From 779a7efb41dece7fad105883acc6269027bea969 Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 13 Aug 2012 18:46:52 +0200 Subject: [PATCH 35/76] removed automatic subscription renewal --- pubsubhubbub-core-0.4.xml | 138 ++++++++++++++++---------------------- 1 file changed, 59 insertions(+), 79 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 3f8ccfc..49eb9ba 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -53,7 +53,7 @@ mart@degeneration.co.uk - + Notifixious Inc. @@ -65,7 +65,7 @@ - An open, simple, web-scale and decentralized pubsub protocol. + An open, simple, web-scale and decentralized pubsub protocol. Anybody can play. As opposed to more developed (and more complex) pubsub specs like An owner of a topic. Notifies the hub when - the topic feed has been updated. As in almost all pubsub systems, the - publisher is unaware of the subscribers, if any. Other pubsub systems + the topic feed has been updated. As in almost all pubsub systems, the + publisher is unaware of the subscribers, if any. Other pubsub systems might call the publisher the "source". An entity (person or program) that wants @@ -134,8 +134,8 @@ sending out notifications to subscribers. A payload describing how a topic's - contents have changed, or the full updated content. - Depending on the topic's content type, the difference (or "delta") may be + contents have changed, or the full updated content. + Depending on the topic's content type, the difference (or "delta") may be computed by the hub and sent to all subscribers.
@@ -160,11 +160,11 @@
- A potential subscriber initiates discovery by retrieving (GET or HEAD request) + A potential subscriber initiates discovery by retrieving (GET or HEAD request) the topic to which it wants to subscribe. The HTTP response from the publisher MUST - include at least one Link Header with + include at least one Link Header with rel=hub (a hub link header) as well as exactly one Link Header - with rel=self (the self link header). + with rel=self (the self link header). The former MUST indicate the exact URL of a PubSubHubbub hub designated by the publisher. If more than one URL is specified, it is expected that the publisher pings each of these URLs, so the subscriber may subscribe to one or more of these. @@ -203,7 +203,7 @@ following parameters in its body: - REQUIRED. The subscriber's callback URL + REQUIRED. The subscriber's callback URL where notifications should be delivered. It is considered good practice to use a unique callback url for each subscription. @@ -216,8 +216,8 @@ OPTIONAL. Number of seconds for which the subscriber would like to have the subscription active. If not present or an empty value, hubs MUST provide a value upon - verification of intent.Hubs MAY - choose to respect this value or not, depending on their own policies. + verification of intent.Hubs MAY + choose to respect this value or not, depending on their own policies. This parameter MAY be present for unsubscription requests and MUST be ignored by the hub in that case. @@ -242,25 +242,25 @@ the subscription state unchanged. This is required so subscribers can renew their subscriptions before the lease seconds period is over without any interruption. - - Subscribers MAY also include additional HTTP request parameters, as well - as HTTP Headers if they are required by the hub. - In the context of social web applications, it is considered good - practice to include a From HTTP header (as described in section 14.22 + + Subscribers MAY also include additional HTTP request parameters, as well + as HTTP Headers if they are required by the hub. + In the context of social web applications, it is considered good + practice to include a From HTTP header (as described in section 14.22 of Hypertext Transfer Protocol) to indicate on behalf of which user the subscription is being performed.
- The topic and callback URLs MAY use HTTP - or HTTPS schemes. The topic URL MUST + The topic and callback URLs MAY use HTTP + or HTTPS schemes. The topic URL MUST be the one advertised by the publisher in a Self Link Header during the discovery phase. (See ). Hubs MAY refuse subscriptions if the topic URL does not correspond to the one - advertised by the publisher. The topic URL can otherwise be free-form - following the URI spec. Hubs MUST always - decode non-reserved characters for these URL parameters; see section 2.4 on + advertised by the publisher. The topic URL can otherwise be free-form + following the URI spec. Hubs MUST always + decode non-reserved characters for these URL parameters; see section 2.4 on "When to Encode or Decode" in the URI spec. @@ -282,13 +282,13 @@
- - The hub MUST respond to a subscription request with an HTTP 202 "Accepted" - response to indicate that the request was received and will now - be verified () and validated () by the hub. The hub SHOULD perform the + + The hub MUST respond to a subscription request with an HTTP 202 "Accepted" + response to indicate that the request was received and will now + be verified () and validated () by the hub. The hub SHOULD perform the verification of intent as soon as possible. - + If a hub finds any errors in the subscription request, an appropriate HTTP error response code (4xx or 5xx) MUST be returned. In the event of an error, hubs SHOULD return a description of the error @@ -335,19 +335,19 @@
The subscriber MUST confirm that the hub.topic - corresponds to a pending subscription or unsubscription that it - wishes to carry out. If so, the subscriber MUST respond with an HTTP + corresponds to a pending subscription or unsubscription that it + wishes to carry out. If so, the subscriber MUST respond with an HTTP success (2xx) code with a response body equal to the hub.challenge parameter. If the subscriber does not agree with the action, the subscriber MUST respond with a 404 "Not Found" response. - The hub MUST consider other server response codes (3xx, 4xx, 5xx) + The hub MUST consider other server response codes (3xx, 4xx, 5xx) to mean that the verification request has failed. If the subscriber returns an HTTP success (2xx) but the content body does not match the hub.challenge parameter, the hub MUST also consider verification to have failed. - + Hubs MAY make the hub.lease_seconds equal to the period the subscriber passed in their subscription request but MAY change the value depending on the hub's policies. To @@ -356,75 +356,55 @@ style="verb">hub.lease_seconds seconds has elapsed.
- +
- Subscriptions MAY be validated by the Hubs who may require + Subscriptions MAY be validated by the Hubs who may require more details to accept or refuse a subscription. The Hub MAY also check with the publisher whether the subscription should be accepted. - + If (and when), the subscription is accepted, the hub MUST inform the subscriber - by sending an HTTP GET request to the subscriber's + by sending an HTTP GET request to the subscriber's callback URL as given in the subscription request. This request has the following - query string arguments appended (format described in Section 17.13.4 of + query string arguments appended (format described in Section 17.13.4 of ): REQUIRED. The literal string "accepted". - REQUIRED. The topic URL given in the corresponding + REQUIRED. The topic URL given in the corresponding subscription request. - + If (and when), the subscription is denied, the hub MUST inform the subscriber - by sending an HTTP GET request to the subscriber's + by sending an HTTP GET request to the subscriber's callback URL as given in the subscription request. This request has the following - query string arguments appended (format described in Section 17.13.4 of + query string arguments appended (format described in Section 17.13.4 of ): REQUIRED. The literal string "denied". - REQUIRED. The topic URL given in the corresponding + REQUIRED. The topic URL given in the corresponding subscription request. OPTIONAL. The hub may include a reason for which the subscription has been denied. - - Hubs may provide an additional HTTP Location header (as described in section 14.30 - of Hypertext Transfer Protocol) to indicate that the + + Hubs may provide an additional HTTP Location header (as described in section 14.30 + of Hypertext Transfer Protocol) to indicate that the subscriber may retry subscribing to a different hub.topic. This allows - for limited distribution to specific groups, users in the context of social web + for limited distribution to specific groups, users in the context of social web applications. - + The subscription MAY be denied by the hub at any point (even if it was previously accepted). The Subscriber SHOULD then consider that the subscription is not possible anymore. - -
-
- -
- - Before a subscription expires (i.e., before hub.lease_seconds elapses), Hubs MUST recheck with - subscribers to see if a continued subscription is desired. Hubs do this - by sending the subscriber a verification - request with hub.mode equal to - subscribe. This request MUST match the original verification request - sent to the subscriber (but with a new hub.challenge - ). - - The response codes returned by the subscriber MUST be interpreted the - same way as during a subscriber-initiated verification flow. However, - this refresh request MUST behave like an initial subscription request; - this means that if an auto-refresh response from the subscriber - constantly returns an error, the hub MUST give up on the subscription - verification action altogether and remove the subscription. +
- The publisher MUST inform the hub it previously designated when a topic - has been updated. The hub and the publisher CAN agree on any mechanism, as - long as the hub is eventually able send the updated payload to the + The publisher MUST inform the hub it previously designated when a topic + has been updated. The hub and the publisher CAN agree on any mechanism, as + long as the hub is eventually able send the updated payload to the subscribers.
@@ -433,10 +413,10 @@ A content distribution request is an HTTP POST request from hub to the subscriber's callback URL with the payload of the notification. This request MUST - have a Content-Type corresponding to the + have a Content-Type corresponding to the type of the topic. The hub MAY reduce the payload to a diff between two consecutive versions if its format allows it. - + The POST request must include the Self Link Header and a Hub Link Header that correspond to topic's URL, as well as hub URL respectively. @@ -474,10 +454,10 @@ same method as the hub. If the signature does not match, subscribers MUST still return a 2xx success response to acknowledge receipt, but locally ignore the message as invalid. Using this technique along with - HTTPS for subscription requests enables - simple subscribers to receive authenticated notifications from hubs + HTTPS for subscription requests enables + simple subscribers to receive authenticated notifications from hubs without the need for subscribers to run an HTTPS server. - + Please note however that this signature only ensures that the payload was not forged. Since the notification also includes headers, these should not be considered as safe by the subscriber, unless of course the subscriber @@ -627,7 +607,7 @@ - + Defining Well-Known Uniform Resource Identifiers (URIs) @@ -644,7 +624,7 @@ - + @@ -693,7 +673,7 @@ PubSubHubbub W3C Community Group. For more information, see the - W3C PubSubHubbub Community Group. + W3C PubSubHubbub Community Group. From 495bd334bf4fff3631641cbdbe4f65c5fedd9f42 Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 13 Aug 2012 18:59:04 +0200 Subject: [PATCH 36/76] performaing validation before verification to avoid 'silent' failures, as per discussion with Roman on https://groups.google.com/forum/#!msg/pubsubhubbub/wUOWcqQmjlQ/iggMELGTtMwJ --- pubsubhubbub-core-0.4.xml | 72 ++++++++++++++++++--------------------- 1 file changed, 33 insertions(+), 39 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 49eb9ba..c5b7d4e 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -299,6 +299,39 @@ +
+ Subscriptions MAY be validated by the Hubs who may require + more details to accept or refuse a subscription. The Hub MAY also + check with the publisher whether the subscription should be accepted. + + If (and when), the subscription is accepted, the hub MUST perform the verification of intent of the subscriber. + + If (and when), the subscription is denied, the hub MUST inform the subscriber + by sending an HTTP GET request to the subscriber's + callback URL as given in the subscription request. This request has the following + query string arguments appended (format described in Section 17.13.4 of + ): + + REQUIRED. The literal string "denied". + REQUIRED. The topic URL given in the corresponding + subscription request. + OPTIONAL. The hub may include a reason + for which the subscription has been denied. + + + Hubs may provide an additional HTTP Location header (as described in section 14.30 + of Hypertext Transfer Protocol) to indicate that the + subscriber may retry subscribing to a different hub.topic. This allows + for limited distribution to specific groups, users in the context of social web + applications. + + The subscription MAY be denied by the hub at any point (even + if it was previously accepted). The Subscriber SHOULD then consider that + the subscription is not possible anymore. + +
+
In order to prevent an attacker from creating unwanted subscriptions on behalf of a subscriber (or unsubscribing desired ones), a hub must @@ -357,46 +390,7 @@
-
- Subscriptions MAY be validated by the Hubs who may require - more details to accept or refuse a subscription. The Hub MAY also - check with the publisher whether the subscription should be accepted. - - If (and when), the subscription is accepted, the hub MUST inform the subscriber - by sending an HTTP GET request to the subscriber's - callback URL as given in the subscription request. This request has the following - query string arguments appended (format described in Section 17.13.4 of - ): - - REQUIRED. The literal string "accepted". - REQUIRED. The topic URL given in the corresponding - subscription request. - - If (and when), the subscription is denied, the hub MUST inform the subscriber - by sending an HTTP GET request to the subscriber's - callback URL as given in the subscription request. This request has the following - query string arguments appended (format described in Section 17.13.4 of - ): - - REQUIRED. The literal string "denied". - REQUIRED. The topic URL given in the corresponding - subscription request. - OPTIONAL. The hub may include a reason - for which the subscription has been denied. - - - Hubs may provide an additional HTTP Location header (as described in section 14.30 - of Hypertext Transfer Protocol) to indicate that the - subscriber may retry subscribing to a different hub.topic. This allows - for limited distribution to specific groups, users in the context of social web - applications. - - The subscription MAY be denied by the hub at any point (even - if it was previously accepted). The Subscriber SHOULD then consider that - the subscription is not possible anymore. - -
From 66d6bdfcd9fa874ad483eeef1fdc8916e1a5b5f0 Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 13 Aug 2012 19:01:26 +0200 Subject: [PATCH 37/76] regenrating html --- pubsubhubbub-core-0.4.html | 241 +++++++++++++++---------------------- 1 file changed, 97 insertions(+), 144 deletions(-) diff --git a/pubsubhubbub-core-0.4.html b/pubsubhubbub-core-0.4.html index 5703969..4f769fc 100644 --- a/pubsubhubbub-core-0.4.html +++ b/pubsubhubbub-core-0.4.html @@ -154,7 +154,7 @@


PubSubHubbub Core 0.4 -- Working Draft

Abstract

-

An open, simple, web-scale and decentralized pubsub protocol. +

An open, simple, web-scale and decentralized pubsub protocol. Anybody can play.

As opposed to more developed (and more complex) pubsub specs like Jabber Publish-Subscribe (Millard, P., Saint-Andre, P., and R. Meijer, “Publish-Subscribe,” .) [XEP‑0060] this spec's base profile @@ -188,10 +188,10 @@

Table of Contents

Subscribing and Unsubscribing
    5.1.  Subscriber Sends Subscription Request
-    5.2.  +    5.2.  +Subscription Validation
+    5.3.  Hub Verifies Intent of the Subscriber
-    5.3.  -Automatic Subscription Refreshing
6.  Publishing
7.  @@ -233,8 +233,8 @@

Table of Contents

Publisher:
An owner of a topic. Notifies the hub when - the topic feed has been updated. As in almost all pubsub systems, the - publisher is unaware of the subscribers, if any. Other pubsub systems + the topic feed has been updated. As in almost all pubsub systems, the + publisher is unaware of the subscribers, if any. Other pubsub systems might call the publisher the "source".
Subscriber:
@@ -264,8 +264,8 @@

Table of Contents

Notification:
A payload describing how a topic's - contents have changed, or the full updated content. - Depending on the topic's content type, the difference (or "delta") may be + contents have changed, or the full updated content. + Depending on the topic's content type, the difference (or "delta") may be computed by the hub and sent to all subscribers.
@@ -299,14 +299,14 @@

Table of Contents

4.  Discovery

-

A potential subscriber initiates discovery by retrieving (GET or HEAD request) +

A potential subscriber initiates discovery by retrieving (GET or HEAD request) the topic to which it wants to subscribe. The HTTP response from the publisher MUST - include at least one Link Header (Nottingham, M., “Web Linking,” October 2010.) [RFC5988] with + include at least one Link Header (Nottingham, M., “Web Linking,” October 2010.) [RFC5988] with rel=hub (a hub link header) as well as exactly one Link Header (Nottingham, M., “Web Linking,” October 2010.) [RFC5988] - with rel=self (the self link header). - The former MUST indicate the exact url of a PubSubHubbub hub designated by the publisher. - If more than one url is specified, it is expected that the publisher pings each - of these urls, so the subscriber may subscribe to one or more of these. + with rel=self (the self link header). + The former MUST indicate the exact URL of a PubSubHubbub hub designated by the publisher. + If more than one URL is specified, it is expected that the publisher pings each + of these URLs, so the subscriber may subscribe to one or more of these. The latter will point to the permanent URL for the resource being polled.

In the absence of HTTP Link headers, subscribers MAY fall back to @@ -355,9 +355,9 @@

Table of Contents

hub.callback
-
REQUIRED. The subscriber's callback URL - where notifications should be delivered. The subscriber's - callback URL SHOULD be unique for each subscription. +
REQUIRED. The subscriber's callback URL + where notifications should be delivered. It is considered good practice + to use a unique callback url for each subscription.
hub.mode
REQUIRED. The literal string "subscribe" or @@ -370,11 +370,10 @@

Table of Contents

hub.lease_seconds
OPTIONAL. Number of seconds for which the subscriber would like to have the subscription active. If - not present or an empty value, the subscription will be permanent - (or active until automatic - refreshing (Automatic Subscription Refreshing) removes the subscription). Hubs MAY choose to - respect this value or not, depending on their own policies. This - parameter MAY be present for unsubscription requests and MUST be + not present or an empty value, hubs MUST provide a value upon + verification of intent (Hub Verifies Intent of the Subscriber).Hubs MAY + choose to respect this value or not, depending on their own policies. + This parameter MAY be present for unsubscription requests and MUST be ignored by the hub in that case.
hub.secret
@@ -391,7 +390,7 @@

Table of Contents

understand.

Hubs MUST allow subscribers to re-request subscriptions that are - already activate. Each subsequent request to a hub to subscribe or + already activated. Each subsequent request to a hub to subscribe or unsubscribe MUST override the previous subscription state for a specific topic URL and callback URL combination once the action is verified. Any failures to confirm the subscription action MUST leave @@ -399,11 +398,12 @@

Table of Contents

renew their subscriptions before the lease seconds period is over without any interruption.

-

Subscribers MAY also include additional HTTP Query params, as well as HTTP Headers - if they are required by the hub, or the publisher. In the context - of social web applications, it is considered good practice to include a From - HTTP header (as described in section 14.22 of Hypertext Transfer Protocol (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616]). - This header should indicate on behalf of which user the subscription is being performed. +

Subscribers MAY also include additional HTTP request parameters, as well + as HTTP Headers if they are required by the hub. + In the context of social web applications, it is considered good + practice to include a From HTTP header (as described in section 14.22 + of Hypertext Transfer Protocol (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616]) to indicate + on behalf of which user the subscription is being performed.


@@ -411,14 +411,14 @@

Table of Contents

5.1.1.  Subscription Parameter Details

-

The topic and callback URLs MAY use HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] - or HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] schemes. The topic URL MUST - be the one advertised by the publisher in a Hub Link Header - Header during the discovery phase. (See Section 4 (Discovery)). - Hubs MAY refuse subscriptions if the topic url does not correspond to the one - advertised by the publisher. The topic URL can otherwise be free-form - following the URI spec (Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” .) [RFC3986]. Hubs MUST always - decode non-reserved characters for these URL parameters; see section 2.4 on +

The topic and callback URLs MAY use HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] + or HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] schemes. The topic URL MUST + be the one advertised by the publisher in a Self Link Header + during the discovery phase. (See Section 4 (Discovery)). + Hubs MAY refuse subscriptions if the topic URL does not correspond to the one + advertised by the publisher. The topic URL can otherwise be free-form + following the URI spec (Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” .) [RFC3986]. Hubs MUST always + decode non-reserved characters for these URL parameters; see section 2.4 on "When to Encode or Decode" in the URI spec (Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” .) [RFC3986].

The callback URL MAY contain arbitrary query string parameters @@ -440,9 +440,9 @@

Table of Contents

5.1.2.  Subscription Response Details

-

The hub MUST respond to a subscription request with an HTTP 202 "Accepted" - response to indicate that the request was received and will now - be verified (Section 5.2 (Hub Verifies Intent of the Subscriber)) and validated (Section 5.2.2 (Subscription Validation)) by the hub. The hub SHOULD perform the +

The hub MUST respond to a subscription request with an HTTP 202 "Accepted" + response to indicate that the request was received and will now + be verified (Section 5.3 (Hub Verifies Intent of the Subscriber)) and validated (Section 5.2 (Subscription Validation)) by the hub. The hub SHOULD perform the verification of intent as soon as possible.

If a hub finds any errors in the subscription request, an @@ -452,9 +452,51 @@

Table of Contents

callback URLs or topic URLs based on their own policies (e.g., domain authorization, topic URL port numbers).

-
+
 TOC 

5.2.  +Subscription Validation

+ +

Subscriptions MAY be validated by the Hubs who may require + more details to accept or refuse a subscription. The Hub MAY also + check with the publisher whether the subscription should be accepted. +

+

If (and when), the subscription is accepted, the hub MUST perform the verification of intent (Hub Verifies Intent of the Subscriber) of the subscriber. +

+

If (and when), the subscription is denied, the hub MUST inform the subscriber + by sending an HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] GET request to the subscriber's + callback URL as given in the subscription request. This request has the following + query string arguments appended (format described in Section 17.13.4 of + [W3C.REC‑html401‑19991224] (Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” December 1999.)): +

+

+
+
hub.mode
+
REQUIRED. The literal string "denied". +
+
hub.topic
+
REQUIRED. The topic URL given in the corresponding + subscription request. +
+
hub.reason
+
OPTIONAL. The hub may include a reason + for which the subscription has been denied. +
+
+ +

Hubs may provide an additional HTTP Location header (as described in section 14.30 + of Hypertext Transfer Protocol (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616]) to indicate that the + subscriber may retry subscribing to a different hub.topic. This allows + for limited distribution to specific groups, users in the context of social web + applications. +

+

The subscription MAY be denied by the hub at any point (even + if it was previously accepted). The Subscriber SHOULD then consider that + the subscription is not possible anymore. +

+
+
 TOC 
+

5.3.  Hub Verifies Intent of the Subscriber

In order to prevent an attacker from creating unwanted subscriptions @@ -495,17 +537,17 @@

Table of Contents


 TOC 
-

5.2.1.  +

5.3.1.  Verification Details

The subscriber MUST confirm that the hub.topic - corresponds to a pending subscription or unsubscription that it - wishes to carry out. If so, the subscriber MUST respond with an HTTP + corresponds to a pending subscription or unsubscription that it + wishes to carry out. If so, the subscriber MUST respond with an HTTP success (2xx) code with a response body equal to the hub.challenge parameter. If the subscriber does not agree with the action, the subscriber MUST respond with a 404 "Not Found" response.

-

The hub MUST consider other server response codes (3xx, 4xx, 5xx) +

The hub MUST consider other server response codes (3xx, 4xx, 5xx) to mean that the verification request has failed. If the subscriber returns an HTTP success (2xx) but the content body does not match the hub.challenge parameter, the hub MUST also @@ -515,105 +557,16 @@

Table of Contents

equal to the period the subscriber passed in their subscription request but MAY change the value depending on the hub's policies. To sustain a temporary subscription, the subscriber MUST re-request the - subscription on the hub before hub.lease_seconds seconds has elapsed. For - permanent subscriptions with no hub.lease_seconds value specified, the behavior - is different as described in the section on automatic subscription refreshing (Automatic Subscription Refreshing). -

-
-
 TOC 
-

5.2.2.  -Subscription Validation

- -

Subscriptions MAY be validated by the Hubs who may require - more details to accept or refuse a subscription. The Hub MAY also - check with the publisher whether the subscription should be accepted. -

-

If (and when), the subscription is accepted, the hub will inform the subscriber - by sending an HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] GET request to the subscriber's - callback URL as given in the subscription request. This request has the following - query string arguments appended (format described in Section 17.13.4 of - [W3C.REC‑html401‑19991224] (Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” December 1999.)): -

-

-
-
hub.mode
-
REQUIRED. The literal string "accepted". -
-
hub.topic
-
REQUIRED. The topic URL given in the corresponding - subscription request. -
-
- -

If (and when), the subscription is denied, the hub will inform the subscriber - by sending an HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] GET request to the subscriber's - callback URL as given in the subscription request. This request has the following - query string arguments appended (format described in Section 17.13.4 of - [W3C.REC‑html401‑19991224] (Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” December 1999.)): -

-

-
-
hub.mode
-
REQUIRED. The literal string "denied". -
-
hub.topic
-
REQUIRED. The topic URL given in the corresponding - subscription request. -
-
hub.reason
-
OPTIONAL. The hub may include a reason - for which the subscription has been denied. -
-
- -

Hubs may provide an additional HTTP Location header (as described in section 14.30 - of Hypertext Transfer Protocol (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616]) to indicate that the - subscriber may retry subscribing to a different hub.topic. This will allow - for limited distribution to specific groups, users in the context of social web - applications. -

-

The subscription may be intentionally denied by the hub at any point (even - if it was previously accepted). The Subscriber SHOULD then consider that - the subscription is not possible anymore. -

-
-
 TOC 
-

5.3.  -Automatic Subscription Refreshing

- -

Before a subscription expires (i.e., before hub.lease_seconds elapses), Hubs MUST recheck with - subscribers to see if a continued subscription is desired. Hubs do this - by sending the subscriber a verification - request (Hub Verifies Intent of the Subscriber) with hub.mode equal to - subscribe. This request MUST match the original verification request - sent to the subscriber (but with a new hub.challenge - ). -

-

The response codes returned by the subscriber MUST be interpreted the - same way as during a subscriber-initiated verification flow. However, - this refresh request MUST behave like an initial subscription request; - this means that if an auto-refresh response from the subscriber - constantly returns an error, the hub MUST give up on the subscription - verification action altogether and remove the subscription. -

-

In the case of permanent subscriptions (with no hub.lease_seconds specified in the original - request), the hub.lease_seconds value - supplied by the hub in the verification request to the subscriber SHOULD - represent how many seconds until the hub expects it will next initiate - automatic subscription refreshing to ensure that the subscriber is still - interested in the topic. This behavior provides the best of both worlds: - maximum simplicity of the subscriber through infinitely-long - subscriptions, but still garbage collectable subscriptions for hub - hygiene. + subscription on the hub before hub.lease_seconds seconds has elapsed.


 TOC 

6.  Publishing

-

The publisher MUST inform the hub it previously designated when a topic - has been updated. The hub and the publisher CAN agree on any mechanism, as - long as the hub is eventually able send the updated payload to the +

The publisher MUST inform the hub it previously designated when a topic + has been updated. The hub and the publisher CAN agree on any mechanism, as + long as the hub is eventually able send the updated payload to the subscribers.


@@ -623,13 +576,13 @@

Table of Contents

A content distribution request is an HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] POST request from hub to the subscriber's callback URL with the payload of the notification. This request MUST - have a Content-Type corresponding to the - type of the topic. The hub MAY reduce the payload to a diff if its format - allows it. + have a Content-Type corresponding to the + type of the topic. The hub MAY reduce the payload to a diff between two + consecutive versions if its format allows it.

The POST request must include the Self Link Header and a Hub Link Header that correspond - to topic's url, as well as hub. + to topic's URL, as well as hub URL respectively.

The successful response from the subscriber's callback URL MUST be an HTTP success (2xx) code. The hub MUST consider all other subscriber @@ -663,8 +616,8 @@

Table of Contents

same method as the hub. If the signature does not match, subscribers MUST still return a 2xx success response to acknowledge receipt, but locally ignore the message as invalid. Using this technique along with - HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] for subscription requests enables - simple subscribers to receive authenticated notifications from hubs + HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] for subscription requests enables + simple subscribers to receive authenticated notifications from hubs without the need for subscribers to run an HTTPS server.

Please note however that this signature only ensures that the payload @@ -709,7 +662,7 @@

9. References

Feedback on this specification is welcomed via the PubSubHubbub W3C Community Group. For more information, see the - W3C PubSubHubbub Community Group. + W3C PubSubHubbub Community Group.


From 7ecb9a2559cd04c4faf7a8ec736737f39fabf3f7 Mon Sep 17 00:00:00 2001 From: julien Date: Tue, 21 Aug 2012 11:40:20 +0200 Subject: [PATCH 38/76] upcasing URL --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index c5b7d4e..cb2268c 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -205,7 +205,7 @@ REQUIRED. The subscriber's callback URL where notifications should be delivered. It is considered good practice - to use a unique callback url for each subscription. + to use a unique callback URL for each subscription. REQUIRED. The literal string "subscribe" or "unsubscribe", depending on the goal of the request. From a078c3ba2d0fcf9422589d2abfd9986436b4d491 Mon Sep 17 00:00:00 2001 From: julien Date: Tue, 21 Aug 2012 11:41:03 +0200 Subject: [PATCH 39/76] fixing whitepace --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index cb2268c..2702317 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -216,7 +216,7 @@ OPTIONAL. Number of seconds for which the subscriber would like to have the subscription active. If not present or an empty value, hubs MUST provide a value upon - verification of intent.Hubs MAY + verification of intent. Hubs MAY choose to respect this value or not, depending on their own policies. This parameter MAY be present for unsubscription requests and MUST be ignored by the hub in that case. From 548da2756b5730c068a39c23ac3a5b3215903e6c Mon Sep 17 00:00:00 2001 From: julien Date: Tue, 21 Aug 2012 11:43:19 +0200 Subject: [PATCH 40/76] changed the step by step for subscriptions --- pubsubhubbub-core-0.4.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 2702317..601b957 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -186,8 +186,8 @@ immediately in sequence or have a delay. Requesting a subscription using the hub - Confirming the subscription was actually desired - Receiving an acknowledgement from the hub that the subscription was accepted (OPTIONAL). + Validating the subscription with the publisher (OPTIONAL) + Confirming the subscription was actually desired by the subscriber Periodically reconfirming the subscription is still active From d6768015c27ff87b31c29ff4ae57e247618fd938 Mon Sep 17 00:00:00 2001 From: julien Date: Tue, 21 Aug 2012 11:46:38 +0200 Subject: [PATCH 41/76] the hub will not validate unsubscriptions --- pubsubhubbub-core-0.4.xml | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 601b957..5581f0e 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -192,7 +192,8 @@ Unsubscribing works in the same way, except with a single parameter - changed to indicate the desire to unsubscribe. + changed to indicate the desire to unsubscribe. Also, the Hub will not validate + unsubscription requests with the publisher.
Subscription is initiated by the subscriber making an HTTPS From ad31023956ff72bb086515ed9538226a3f51ba5e Mon Sep 17 00:00:00 2001 From: julien Date: Tue, 21 Aug 2012 11:55:59 +0200 Subject: [PATCH 42/76] rephrased and reordered --- pubsubhubbub-core-0.4.xml | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 5581f0e..a4ef289 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -212,7 +212,7 @@ "unsubscribe", depending on the goal of the request. REQUIRED. The topic URL that the subscriber - wishes to subscribe to. + wishes to subscribe to or unsubscribe from. OPTIONAL. Number of seconds for which the subscriber would like to have the subscription active. If @@ -286,9 +286,9 @@ The hub MUST respond to a subscription request with an HTTP 202 "Accepted" response to indicate that the request was received and will now - be verified () and validated () by the hub. The hub SHOULD perform the - verification of intent as soon as possible. + be validated () and verified + () and by the hub. The hub SHOULD perform the + validation and verification of intent as soon as possible. If a hub finds any errors in the subscription request, an appropriate HTTP error response code (4xx or 5xx) MUST be returned. In From 1efd9416a58ada12d6b4d808af6c952b3b0e4ea0 Mon Sep 17 00:00:00 2001 From: julien Date: Tue, 21 Aug 2012 12:03:41 +0200 Subject: [PATCH 43/76] s/period/value/ --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index a4ef289..6481e8f 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -383,7 +383,7 @@ consider verification to have failed. Hubs MAY make the hub.lease_seconds - equal to the period the subscriber passed in their subscription + equal to the value the subscriber passed in their subscription request but MAY change the value depending on the hub's policies. To sustain a temporary subscription, the subscriber MUST re-request the subscription on the hub before Date: Tue, 21 Aug 2012 12:04:10 +0200 Subject: [PATCH 44/76] removed subscription --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 6481e8f..dfd9741 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -385,7 +385,7 @@ Hubs MAY make the hub.lease_seconds equal to the value the subscriber passed in their subscription request but MAY change the value depending on the hub's policies. To - sustain a temporary subscription, the subscriber MUST re-request the + sustain a subscription, the subscriber MUST re-request the subscription on the hub before hub.lease_seconds seconds has elapsed. From b49a961a88aaab275dd831f319fff3b9499c04c6 Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 10 May 2013 15:26:58 +0200 Subject: [PATCH 45/76] marking reconfirmation as optional --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index dfd9741..79093e0 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -188,7 +188,7 @@ Requesting a subscription using the hub Validating the subscription with the publisher (OPTIONAL) Confirming the subscription was actually desired by the subscriber - Periodically reconfirming the subscription is still active + Periodically reconfirming the subscription is still active (OPTIONAL) Unsubscribing works in the same way, except with a single parameter From 7dfa4b2c9e867bb00fed59b99b13c0959f36ba73 Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 10 May 2013 15:28:17 +0200 Subject: [PATCH 46/76] removed mention of default value set up by the hub --- pubsubhubbub-core-0.4.xml | 4 +--- 1 file changed, 1 insertion(+), 3 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 79093e0..414c749 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -215,9 +215,7 @@ wishes to subscribe to or unsubscribe from. OPTIONAL. Number of seconds for - which the subscriber would like to have the subscription active. If - not present or an empty value, hubs MUST provide a value upon - verification of intent. Hubs MAY + which the subscriber would like to have the subscription active. Hubs MAY choose to respect this value or not, depending on their own policies. This parameter MAY be present for unsubscription requests and MUST be ignored by the hub in that case. From 0d7f7e6005fada70bd1b2a5bf87aeaed7b1f680f Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 10 May 2013 15:33:28 +0200 Subject: [PATCH 47/76] reordering stuff --- pubsubhubbub-core-0.4.xml | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 414c749..0df2607 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -230,6 +230,14 @@ + Subscribers MAY also include additional HTTP request parameters, as well + as HTTP Headers if they are required by the hub. + In the context of social web applications, it is considered good + practice to include a From HTTP header (as described in section 14.22 + of Hypertext Transfer Protocol) to indicate + on behalf of which user the subscription is being performed. + + Hubs MUST ignore additional request parameters they do not understand. @@ -242,14 +250,6 @@ renew their subscriptions before the lease seconds period is over without any interruption. - Subscribers MAY also include additional HTTP request parameters, as well - as HTTP Headers if they are required by the hub. - In the context of social web applications, it is considered good - practice to include a From HTTP header (as described in section 14.22 - of Hypertext Transfer Protocol) to indicate - on behalf of which user the subscription is being performed. - -
The topic and callback URLs MAY use HTTP From 656ff1373eac84cf21ea35a8af5c3f060d454c1f Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 10 May 2013 15:35:07 +0200 Subject: [PATCH 48/76] rmoved https mention for callbacks as it's redundant and removed the redundant mention to handling query strings in callback url --- pubsubhubbub-core-0.4.xml | 7 +------ 1 file changed, 1 insertion(+), 6 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 0df2607..f4e722e 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -269,15 +269,10 @@ appending new parameters to the end of the list using the & (ampersand) character to join. Existing parameters with names that overlap with those used by verification - requests will not be overwritten; Hubs MUST only append verification - parameters to the existing list, if any. For event notification, the + requests will not be overwritten. For event notification, the callback URL will be POSTed to including any query-string parameters in the URL portion of the request, not as POST body parameters. - Subscribers MAY choose to use HTTPS - for their callback URLs if they care about the privacy of - notifications as they come over the wire from the Hub (see ) -
From 6573a0b139d548b0eacbc191a087320f992b14c9 Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 10 May 2013 15:36:59 +0200 Subject: [PATCH 49/76] swapped verification and validation --- pubsubhubbub-core-0.4.xml | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index f4e722e..d64e72c 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -279,9 +279,9 @@ The hub MUST respond to a subscription request with an HTTP 202 "Accepted" response to indicate that the request was received and will now - be validated () and verified - () and by the hub. The hub SHOULD perform the - validation and verification of intent as soon as possible. + be verified () and validated () by the hub. The hub SHOULD perform the + verification and validation of intent as soon as possible. If a hub finds any errors in the subscription request, an appropriate HTTP error response code (4xx or 5xx) MUST be returned. In From 9b50d2d8726295887045107698036b7eab446188 Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 10 May 2013 15:40:07 +0200 Subject: [PATCH 50/76] groups or users --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index d64e72c..fd1d507 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -317,7 +317,7 @@ Hubs may provide an additional HTTP Location header (as described in section 14.30 of Hypertext Transfer Protocol) to indicate that the subscriber may retry subscribing to a different hub.topic. This allows - for limited distribution to specific groups, users in the context of social web + for limited distribution to specific groups or users in the context of social web applications. The subscription MAY be denied by the hub at any point (even From 8da54b650b1d03e05fa2700959dd170d6b0bd7bb Mon Sep 17 00:00:00 2001 From: julien Date: Fri, 10 May 2013 15:43:24 +0200 Subject: [PATCH 51/76] there may be multiple hubs --- pubsubhubbub-core-0.4.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index fd1d507..beedf95 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -390,8 +390,8 @@
- The publisher MUST inform the hub it previously designated when a topic - has been updated. The hub and the publisher CAN agree on any mechanism, as + The publisher MUST inform the hubs it previously designated when a topic + has been updated. The hub and the publisher can agree on any mechanism, as long as the hub is eventually able send the updated payload to the subscribers.
From 0d6844a2c2b2a9c94c7cb46cf3c3667a0293484e Mon Sep 17 00:00:00 2001 From: julien Date: Thu, 20 Jun 2013 10:54:53 -0400 Subject: [PATCH 52/76] hubs should combine link headers --- pubsubhubbub-core-0.4.xml | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index beedf95..0fa4d51 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -405,9 +405,11 @@ type of the topic. The hub MAY reduce the payload to a diff between two consecutive versions if its format allows it. - The POST request must include the Self Link Header - and a Hub Link Header that correspond - to topic's URL, as well as hub URL respectively. + The request MUST include a Link Header + with rel=hub pointing to the Hub as well as a Link + Header with rel=self set to the topic that's being updated. The Hub + SHOULD combine both headers into a single Link + Header. The successful response from the subscriber's callback URL MUST be an HTTP success (2xx) code. The hub MUST consider all other subscriber From cb934afb852ee8c5e79ab17fdaddfdb5ab6a63b7 Mon Sep 17 00:00:00 2001 From: julien Date: Thu, 20 Jun 2013 11:02:18 -0400 Subject: [PATCH 53/76] replaced all HTTP instances --- pubsubhubbub-core-0.4.xml | 36 ++++++++++++++++++++++++------------ 1 file changed, 24 insertions(+), 12 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 0fa4d51..8427940 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -99,7 +99,8 @@
- An HTTP resource URL. The + An HTTP resource URL. The unit to which one can subscribe to changes. The server ( A potential subscriber initiates discovery by retrieving (GET or HEAD request) - the topic to which it wants to subscribe. The HTTP response from the publisher MUST + the topic to which it wants to subscribe. The HTTP response from the publisher MUST include at least one Link Header with rel=hub (a hub link header) as well as exactly one Link Header with rel=self (the self link header). @@ -171,7 +173,8 @@ The latter will point to the permanent URL for the resource being polled. - In the absence of HTTP Link headers, subscribers MAY fall back to + In the absence of HTTP Link headers, subscribers MAY fall back to other methods to discover the hub(s) and the canonical URI of the topic. If the topic is an XML based feed, it MAY use embedded link elements as described in Appendix B of Web Linking. @@ -230,10 +233,13 @@ - Subscribers MAY also include additional HTTP request parameters, as well - as HTTP Headers if they are required by the hub. + Subscribers MAY also include additional HTTP request parameters, as well + as HTTP Headers if they are required by the hub. In the context of social web applications, it is considered good - practice to include a From HTTP header (as described in section 14.22 + practice to include a From HTTP header (as described in section 14.22 of Hypertext Transfer Protocol) to indicate on behalf of which user the subscription is being performed. @@ -277,14 +283,16 @@
- The hub MUST respond to a subscription request with an HTTP 202 "Accepted" + The hub MUST respond to a subscription request with an HTTP 202 "Accepted" response to indicate that the request was received and will now be verified () and validated () by the hub. The hub SHOULD perform the verification and validation of intent as soon as possible. If a hub finds any errors in the subscription request, an - appropriate HTTP error response code (4xx or 5xx) MUST be returned. In + appropriate HTTP error response code (4xx or 5xx) MUST be returned. In the event of an error, hubs SHOULD return a description of the error in the response body as plain text. Hubs MAY decide to reject some callback URLs or topic URLs based on their own policies (e.g., domain @@ -314,7 +322,8 @@ for which the subscription has been denied. - Hubs may provide an additional HTTP Location header (as described in section 14.30 + Hubs may provide an additional HTTP Location header (as described in section 14.30 of Hypertext Transfer Protocol) to indicate that the subscriber may retry subscribing to a different hub.topic. This allows for limited distribution to specific groups or users in the context of social web @@ -371,7 +380,8 @@ The hub MUST consider other server response codes (3xx, 4xx, 5xx) to mean that the verification request has failed. If the subscriber - returns an HTTP success (2xx) but the content body does not match the + returns an HTTP success (2xx) but the content body does not match the hub.challenge parameter, the hub MUST also consider verification to have failed. @@ -412,7 +422,8 @@ Header. The successful response from the subscriber's callback URL MUST be an - HTTP success (2xx) code. The hub MUST consider all other subscriber + HTTP success (2xx) code. The hub MUST consider all other subscriber response codes as failures; that means subscribers MUST NOT use HTTP redirects for moving subscriptions. The response body from the subscriber MUST be ignored by the hub. Hubs SHOULD retry notifications @@ -446,7 +457,8 @@ locally ignore the message as invalid. Using this technique along with HTTPS for subscription requests enables simple subscribers to receive authenticated notifications from hubs - without the need for subscribers to run an HTTPS server. + without the need for subscribers to run an HTTPS + server. Please note however that this signature only ensures that the payload was not forged. Since the notification also includes headers, these should From d645acb8be1c744e32eface3f5f74bb23993b76c Mon Sep 17 00:00:00 2001 From: julien Date: Thu, 20 Jun 2013 11:10:42 -0400 Subject: [PATCH 54/76] fixing validation problems --- pubsubhubbub-core-0.4.xml | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 8427940..c61ba59 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -12,7 +12,7 @@ $ xml2rfc pubsubhubbub-core-0.1.xml pubsubhubbub-core-0.1.html --> - + @@ -270,10 +270,10 @@ target="RFC3986">the URI spec. The callback URL MAY contain arbitrary query string parameters - (e.g., ?foo=bar&red=fish). Hubs MUST + (e.g., ?foo=bar&red=fish). Hubs MUST preserve the query string during subscription verification by appending new parameters to the end of the list using the & (ampersand) character to join. Existing + style="verb">& (ampersand) character to join. Existing parameters with names that overlap with those used by verification requests will not be overwritten. For event notification, the callback URL will be POSTed to including any query-string parameters From 0773ee2c7e2081123c2410dcf411def14ccb22ab Mon Sep 17 00:00:00 2001 From: julien Date: Thu, 20 Jun 2013 11:11:14 -0400 Subject: [PATCH 55/76] fixing dates --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index c61ba59..e68f9c5 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -62,7 +62,7 @@ - + An open, simple, web-scale and decentralized pubsub protocol. From 4f3aabd97b6e402a5980d1e5f03e48500814a087 Mon Sep 17 00:00:00 2001 From: julien Date: Thu, 20 Jun 2013 11:12:11 -0400 Subject: [PATCH 56/76] regenerated HTML --- pubsubhubbub-core-0.4.html | 1435 +++++++++++++++++++----------------- 1 file changed, 742 insertions(+), 693 deletions(-) diff --git a/pubsubhubbub-core-0.4.html b/pubsubhubbub-core-0.4.html index 4f769fc..4eda9c6 100644 --- a/pubsubhubbub-core-0.4.html +++ b/pubsubhubbub-core-0.4.html @@ -1,700 +1,749 @@ - -Draft: PubSubHubbub Core 0.4 -- Working Draft - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + - td.RFCbug { - font-size: x-small; text-decoration: none; - width: 30px; height: 30px; padding-top: 2px; - text-align: justify; vertical-align: middle; - background-color: #000; - } - td.RFCbug span.RFC { - font-family: monaco, charcoal, geneva, "MS Sans Serif", helvetica, verdana, sans-serif; - font-weight: bold; color: #666; - } - td.RFCbug span.hotText { - font-family: charcoal, monaco, geneva, "MS Sans Serif", helvetica, verdana, sans-serif; - font-weight: normal; text-align: center; color: #FFF; - } - - table.TOCbug { width: 30px; height: 15px; } - td.TOCbug { - text-align: center; width: 30px; height: 15px; - color: #FFF; background-color: #900; - } - td.TOCbug a { - font-family: monaco, charcoal, geneva, "MS Sans Serif", helvetica, sans-serif; - font-weight: bold; font-size: x-small; text-decoration: none; - color: #FFF; background-color: transparent; - } - - td.header { - font-family: arial, helvetica, sans-serif; font-size: x-small; - vertical-align: top; width: 33%; - color: #FFF; background-color: #666; - } - td.author { font-weight: bold; font-size: x-small; margin-left: 4em; } - td.author-text { font-size: x-small; } - - /* info code from SantaKlauss at http://www.madaboutstyle.com/tooltip2.html */ - a.info { - /* This is the key. */ - position: relative; - z-index: 24; - text-decoration: none; - } - a.info:hover { - z-index: 25; - color: #FFF; background-color: #900; - } - a.info span { display: none; } - a.info:hover span.info { - /* The span will display just on :hover state. */ - display: block; - position: absolute; - font-size: smaller; - top: 2em; left: -5em; width: 15em; - padding: 2px; border: 1px solid #333; - color: #900; background-color: #EEE; - text-align: left; - } - - a { font-weight: bold; } - a:link { color: #900; background-color: transparent; } - a:visited { color: #633; background-color: transparent; } - a:active { color: #633; background-color: transparent; } - - p { margin-left: 2em; margin-right: 2em; } - p.copyright { font-size: x-small; } - p.toc { font-size: small; font-weight: bold; margin-left: 3em; } - table.toc { margin: 0 0 0 3em; padding: 0; border: 0; vertical-align: text-top; } - td.toc { font-size: small; font-weight: bold; vertical-align: text-top; } - - ol.text { margin-left: 2em; margin-right: 2em; } - ul.text { margin-left: 2em; margin-right: 2em; } - li { margin-left: 3em; } - - /* RFC-2629 s and s. */ - em { font-style: italic; } - strong { font-weight: bold; } - dfn { font-weight: bold; font-style: normal; } - cite { font-weight: normal; font-style: normal; } - tt { color: #036; } - tt, pre, pre dfn, pre em, pre cite, pre span { - font-family: "Courier New", Courier, monospace; font-size: small; - } - pre { - text-align: left; padding: 4px; - color: #000; background-color: #CCC; - } - pre dfn { color: #900; } - pre em { color: #66F; background-color: #FFC; font-weight: normal; } - pre .key { color: #33C; font-weight: bold; } - pre .id { color: #900; } - pre .str { color: #000; background-color: #CFF; } - pre .val { color: #066; } - pre .rep { color: #909; } - pre .oth { color: #000; background-color: #FCF; } - pre .err { background-color: #FCC; } - - /* RFC-2629 s. */ - table.all, table.full, table.headers, table.none { - font-size: small; text-align: center; border-width: 2px; - vertical-align: top; border-collapse: collapse; - } - table.all, table.full { border-style: solid; border-color: black; } - table.headers, table.none { border-style: none; } - th { - font-weight: bold; border-color: black; - border-width: 2px 2px 3px 2px; - } - table.all th, table.full th { border-style: solid; } - table.headers th { border-style: none none solid none; } - table.none th { border-style: none; } - table.all td { - border-style: solid; border-color: #333; - border-width: 1px 2px; - } - table.full td, table.headers td, table.none td { border-style: none; } - - hr { height: 1px; } - hr.insert { - width: 80%; border-style: none; border-width: 0; - color: #CCC; background-color: #CCC; - } ---> - -
 TOC 
-
- - - - - - - - -
DraftB. Fitzpatrick
 B. Slatkin
 Google, Inc
 M. Atkins
 Six Apart Ltd.
 J. Genestoux
 Notifixious Inc.
 February 5, 2012
-


PubSubHubbub Core 0.4 -- Working Draft

- -

Abstract

- -

An open, simple, web-scale and decentralized pubsub protocol. - Anybody can play. -

-

As opposed to more developed (and more complex) pubsub specs like Jabber Publish-Subscribe (Millard, P., Saint-Andre, P., and R. Meijer, “Publish-Subscribe,” .) [XEP‑0060] this spec's base profile - (the barrier-to-entry to speak it) is dead simple. The fancy bits required - for high-volume publishers and subscribers are optional. The base profile - is HTTP-based, as opposed to XMPP (see more on this below). -

-

To dramatically simplify this spec in several places where we had to - choose between supporting A or B, we took it upon ourselves to say "only - A", rather than making it an implementation decision. -

-

We offer this spec in hopes that it fills a need or at least advances - the state of the discussion in the pubsub space. Polling sucks. We think - a decentralized pubsub layer is a fundamental, missing layer in the - Internet architecture today and its existence, more than just enabling - the obvious lower latency feed readers, would enable many cool - applications, most of which we can't even imagine. But we're looking - forward to decentralized social networking. -


-

Table of Contents

-

-1.  -Notation and Conventions
-2.  -Definitions
-3.  -High-level protocol flow
-4.  -Discovery
-5.  -Subscribing and Unsubscribing
-    5.1.  -Subscriber Sends Subscription Request
-    5.2.  -Subscription Validation
-    5.3.  -Hub Verifies Intent of the Subscriber
-6.  -Publishing
-7.  -Content Distribution
-8.  -Authenticated Content Distribution
-9.  -References
-Appendix A.  -Specification Feedback
-§  -Authors' Addresses
-

-
- -
-
 TOC 
-

1.  -Notation and Conventions

- -

The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", - "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this - document are to be interpreted as described in [RFC2119] (Bradner, B., “Key words for use in RFCs to Indicate Requirement Levels,” .). Domain name examples use [RFC2606] (Eastlake, D. and A. Panitz, “Reserved Top Level DNS Names,” .). -

-
-
 TOC 
-

2.  -Definitions

-

-
-
Topic:
-
An HTTP resource URL. The - unit to which one can subscribe to changes. -
-
Hub ("the hub"):
-
The server (URL (Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” .) [RFC3986]) which implements both sides of this - protocol. Any hub MAY implement its own policies on who can use it. -
-
Publisher:
-
An owner of a topic. Notifies the hub when - the topic feed has been updated. As in almost all pubsub systems, the - publisher is unaware of the subscribers, if any. Other pubsub systems - might call the publisher the "source". -
-
Subscriber:
-
An entity (person or program) that wants - to be notified of changes on a topic. The subscriber must be - directly network-accessible and is identified by its Subscriber - Callback URL. -
-
Subscription:
-
A unique relation to a topic by a - subscriber that indicates it should receive updates for that topic. A - subscription's unique key is the tuple (Topic URL, Subscriber Callback - URL). Subscriptions may (at the hub's decision) have expiration times - akin to DHCP leases which must be periodically renewed. -
-
Subscriber Callback URL:
-
The URL (Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” .) [RFC3986] at which a subscriber wishes to receive - notifications. -
-
Event:
-
An event that causes updates to multiple topics. - For each event that happens (e.g. "Brad posted to the Linux - Community."), multiple topics could be affected (e.g. "Brad posted." - and "Linux community has new post"). Publisher events cause topics to - be updated and the hub looks up all subscriptions for affected topics, - sending out notifications to subscribers. -
-
Notification:
-
A payload describing how a topic's - contents have changed, or the full updated content. - Depending on the topic's content type, the difference (or "delta") may be - computed by the hub and sent to all subscribers. -
-
- -
-
 TOC 
-

3.  -High-level protocol flow

+ -

(This section is non-normative.) -

-

-
    -
  • Publishers notify their hub(s) URLs when their topic(s) - change. -
    • -
  • Subscribers POST to one or more of the advertised hubs for a - topic they're interested in. Alternatively, some hubs may offer - auto-polling capability, to let {their,any} subscribers subscribe to - topics which don't advertise a hub. -
    • -
  • The hub caches minimal metadata (id, data, entry digest) about - each topic's previous state. When the hub re-fetches a topic feed (on - its own initiative or as a result of a publisher's ping) and finds a - delta, it enqueues a notification to all registered subscribers. -
    • + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    Network Working GroupB. Fitzpatrick
    Internet-DraftB. Slatkin
    Intended status: InformationalGoogle, Inc
    Expires: December 22, 2013M. Atkins
    Six Apart Ltd.
    J. Genestoux
    Notifixious Inc.
    June 20, 2013
    + +

    PubSubHubbub Core 0.4 -- Working Draft
    + pubsubhubbub-core-0.4.xml

    + +

    + Abstract +

    +

    An open, simple, web-scale and decentralized pubsub protocol. Anybody can play.

    +

    As opposed to more developed (and more complex) pubsub specs like Jabber Publish-Subscribe [XEP-0060] this spec's base profile (the barrier-to-entry to speak it) is dead simple. The fancy bits required for high-volume publishers and subscribers are optional. The base profile is HTTP-based, as opposed to XMPP (see more on this below).

    +

    To dramatically simplify this spec in several places where we had to choose between supporting A or B, we took it upon ourselves to say "only A", rather than making it an implementation decision.

    +

    We offer this spec in hopes that it fills a need or at least advances the state of the discussion in the pubsub space. Polling sucks. We think a decentralized pubsub layer is a fundamental, missing layer in the Internet architecture today and its existence, more than just enabling the obvious lower latency feed readers, would enable many cool applications, most of which we can't even imagine. But we're looking forward to decentralized social networking.

    +

    + Status of This Memo +

    +

    This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79.

    +

    Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet-Drafts is at http://datatracker.ietf.org/drafts/current/.

    +

    Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress."

    +

    This Internet-Draft will expire on December 22, 2013.

    +

    + Copyright Notice +

    +

    Copyright (c) 2013 IETF Trust and the persons identified as the document authors. All rights reserved.

    +

    This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (http://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Simplified BSD License.

    + + +
    +

    Table of Contents

    + + +

    1. Notation and Conventions

    +

    The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in [RFC2119]. Domain name examples use [RFC2606].

    +

    2. Definitions

    +

    + +

    +
    Topic:
    +
    An HTTP [RFC2616] resource URL. The unit to which one can subscribe to changes.
    +
    Hub ("the hub"):
    +
    The server (URL [RFC3986]) which implements both sides of this protocol. Any hub MAY implement its own policies on who can use it.
    +
    Publisher:
    +
    An owner of a topic. Notifies the hub when the topic feed has been updated. As in almost all pubsub systems, the publisher is unaware of the subscribers, if any. Other pubsub systems might call the publisher the "source".
    +
    Subscriber:
    +
    An entity (person or program) that wants to be notified of changes on a topic. The subscriber must be directly network-accessible and is identified by its Subscriber Callback URL.
    +
    Subscription:
    +
    A unique relation to a topic by a subscriber that indicates it should receive updates for that topic. A subscription's unique key is the tuple (Topic URL, Subscriber Callback URL). Subscriptions may (at the hub's decision) have expiration times akin to DHCP leases which must be periodically renewed.
    +
    Subscriber Callback URL:
    +
    The URL [RFC3986] at which a subscriber wishes to receive notifications.
    +
    Event:
    +
    An event that causes updates to multiple topics. For each event that happens (e.g. "Brad posted to the Linux Community."), multiple topics could be affected (e.g. "Brad posted." and "Linux community has new post"). Publisher events cause topics to be updated and the hub looks up all subscriptions for affected topics, sending out notifications to subscribers.
    +
    Notification:
    +
    A payload describing how a topic's contents have changed, or the full updated content. Depending on the topic's content type, the difference (or "delta") may be computed by the hub and sent to all subscribers.
    +
    +

    3. High-level protocol flow

    +

    (This section is non-normative.)

    +

    + +

      +
    • Publishers notify their hub(s) URLs when their topic(s) change.
      • +
    • Subscribers POST to one or more of the advertised hubs for a topic they're interested in. Alternatively, some hubs may offer auto-polling capability, to let {their,any} subscribers subscribe to topics which don't advertise a hub.
      • +
    • The hub caches minimal metadata (id, data, entry digest) about each topic's previous state. When the hub re-fetches a topic feed (on its own initiative or as a result of a publisher's ping) and finds a delta, it enqueues a notification to all registered subscribers.
    - -
    -
     TOC 
    -

    4.  -Discovery

    - -

    A potential subscriber initiates discovery by retrieving (GET or HEAD request) - the topic to which it wants to subscribe. The HTTP response from the publisher MUST - include at least one Link Header (Nottingham, M., “Web Linking,” October 2010.) [RFC5988] with - rel=hub (a hub link header) as well as exactly one Link Header (Nottingham, M., “Web Linking,” October 2010.) [RFC5988] - with rel=self (the self link header). - The former MUST indicate the exact URL of a PubSubHubbub hub designated by the publisher. - If more than one URL is specified, it is expected that the publisher pings each - of these URLs, so the subscriber may subscribe to one or more of these. - The latter will point to the permanent URL for the resource being polled. -

    -

    In the absence of HTTP Link headers, subscribers MAY fall back to - other methods to discover the hub(s) and the canonical URI of the topic. - If the topic is an XML based feed, it MAY use embedded link elements - as described in Appendix B of Web Linking (Nottingham, M., “Web Linking,” October 2010.) [RFC5988]. - Similarly, for HTML pages, it MAY use embedded link elements as described - in Appendix A of Web Linking (Nottingham, M., “Web Linking,” October 2010.) [RFC5988]. Finally, publishers - MAY also use the Well-Known Uniform Resource Identifiers (Nottingham, M. and E. Hammer-Lahav, “Defining Well-Known Uniform Resource Identifiers (URIs),” .) [RFC5785] - .host-meta to include the <Link> element. -

    -
    -
     TOC 
    -

    5.  -Subscribing and Unsubscribing

    - -

    Subscribing to a topic URL consists of four parts that may occur - immediately in sequence or have a delay. -

    -

    -
      -
    • Requesting a subscription using the hub -
      • -
    • Confirming the subscription was actually desired -
      • -
    • Receiving an acknowledgement from the hub that the subscription was accepted (OPTIONAL). -
      • -
    • Periodically reconfirming the subscription is still active -
      • +

      4. Discovery

      +

      A potential subscriber initiates discovery by retrieving (GET or HEAD request) the topic to which it wants to subscribe. The HTTP [RFC2616] response from the publisher MUST include at least one Link Header [RFC5988] with rel=hub (a hub link header) as well as exactly one Link Header [RFC5988] with rel=self (the self link header). The former MUST indicate the exact URL of a PubSubHubbub hub designated by the publisher. If more than one URL is specified, it is expected that the publisher pings each of these URLs, so the subscriber may subscribe to one or more of these. The latter will point to the permanent URL for the resource being polled.

      +

      In the absence of HTTP [RFC2616] Link headers, subscribers MAY fall back to other methods to discover the hub(s) and the canonical URI of the topic. If the topic is an XML based feed, it MAY use embedded link elements as described in Appendix B of Web Linking [RFC5988]. Similarly, for HTML pages, it MAY use embedded link elements as described in Appendix A of Web Linking [RFC5988]. Finally, publishers MAY also use the Well-Known Uniform Resource Identifiers [RFC5785] .host-meta to include the <Link> element.

      +

      5. Subscribing and Unsubscribing

      +

      Subscribing to a topic URL consists of four parts that may occur immediately in sequence or have a delay.

      +

      + +

        +
      • Requesting a subscription using the hub
        • +
      • Validating the subscription with the publisher (OPTIONAL)
        • +
      • Confirming the subscription was actually desired by the subscriber
        • +
      • Periodically reconfirming the subscription is still active (OPTIONAL)
      - -

      Unsubscribing works in the same way, except with a single parameter - changed to indicate the desire to unsubscribe. -

      -
      -
       TOC 
      -

      5.1.  -Subscriber Sends Subscription Request

      - -

      Subscription is initiated by the subscriber making an HTTPS (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] - or HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] POST request to the hub URL. This request - has a Content-Type of application/x-www-form-urlencoded (described in - Section 17.13.4 of [W3C.REC‑html401‑19991224] (Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” December 1999.)) and the - following parameters in its body: -

      -

      -
      -
      hub.callback
      -
      REQUIRED. The subscriber's callback URL - where notifications should be delivered. It is considered good practice - to use a unique callback url for each subscription. -
      -
      hub.mode
      -
      REQUIRED. The literal string "subscribe" or - "unsubscribe", depending on the goal of the request. -
      -
      hub.topic
      -
      REQUIRED. The topic URL that the subscriber - wishes to subscribe to. -
      -
      hub.lease_seconds
      -
      OPTIONAL. Number of seconds for - which the subscriber would like to have the subscription active. If - not present or an empty value, hubs MUST provide a value upon - verification of intent (Hub Verifies Intent of the Subscriber).Hubs MAY - choose to respect this value or not, depending on their own policies. - This parameter MAY be present for unsubscription requests and MUST be - ignored by the hub in that case. -
      -
      hub.secret
      -
      OPTIONAL. A subscriber-provided secret - string that will be used to compute an HMAC digest for authorized content distribution (Authenticated Content Distribution). If not - supplied, the HMAC digest will not be present for content - distribution requests. This parameter SHOULD only be specified when - the request was made over HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818]. This - parameter MUST be less than 200 bytes in length. -
      -
      - -

      Hubs MUST ignore additional request parameters they do not - understand. -

      -

      Hubs MUST allow subscribers to re-request subscriptions that are - already activated. Each subsequent request to a hub to subscribe or - unsubscribe MUST override the previous subscription state for a - specific topic URL and callback URL combination once the action is - verified. Any failures to confirm the subscription action MUST leave - the subscription state unchanged. This is required so subscribers can - renew their subscriptions before the lease seconds period is over - without any interruption. -

      -

      Subscribers MAY also include additional HTTP request parameters, as well - as HTTP Headers if they are required by the hub. - In the context of social web applications, it is considered good - practice to include a From HTTP header (as described in section 14.22 - of Hypertext Transfer Protocol (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616]) to indicate - on behalf of which user the subscription is being performed. - -

      -
      -
       TOC 
      -

      5.1.1.  -Subscription Parameter Details

      - -

      The topic and callback URLs MAY use HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] - or HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] schemes. The topic URL MUST - be the one advertised by the publisher in a Self Link Header - during the discovery phase. (See Section 4 (Discovery)). - Hubs MAY refuse subscriptions if the topic URL does not correspond to the one - advertised by the publisher. The topic URL can otherwise be free-form - following the URI spec (Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” .) [RFC3986]. Hubs MUST always - decode non-reserved characters for these URL parameters; see section 2.4 on - "When to Encode or Decode" in the URI spec (Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” .) [RFC3986]. -

      -

      The callback URL MAY contain arbitrary query string parameters - (e.g., ?foo=bar&red=fish). Hubs MUST - preserve the query string during subscription verification by - appending new parameters to the end of the list using the & (ampersand) character to join. Existing - parameters with names that overlap with those used by verification - requests will not be overwritten; Hubs MUST only append verification - parameters to the existing list, if any. For event notification, the - callback URL will be POSTed to including any query-string parameters - in the URL portion of the request, not as POST body parameters. -

      -

      Subscribers MAY choose to use HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] - for their callback URLs if they care about the privacy of - notifications as they come over the wire from the Hub (see Section 8 (Authenticated Content Distribution)) -

      -
      -
       TOC 
      -

      5.1.2.  -Subscription Response Details

      - -

      The hub MUST respond to a subscription request with an HTTP 202 "Accepted" - response to indicate that the request was received and will now - be verified (Section 5.3 (Hub Verifies Intent of the Subscriber)) and validated (Section 5.2 (Subscription Validation)) by the hub. The hub SHOULD perform the - verification of intent as soon as possible. -

      -

      If a hub finds any errors in the subscription request, an - appropriate HTTP error response code (4xx or 5xx) MUST be returned. In - the event of an error, hubs SHOULD return a description of the error - in the response body as plain text. Hubs MAY decide to reject some - callback URLs or topic URLs based on their own policies (e.g., domain - authorization, topic URL port numbers). -

      -
      -
       TOC 
      -

      5.2.  -Subscription Validation

      - -

      Subscriptions MAY be validated by the Hubs who may require - more details to accept or refuse a subscription. The Hub MAY also - check with the publisher whether the subscription should be accepted. -

      -

      If (and when), the subscription is accepted, the hub MUST perform the verification of intent (Hub Verifies Intent of the Subscriber) of the subscriber. -

      -

      If (and when), the subscription is denied, the hub MUST inform the subscriber - by sending an HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] GET request to the subscriber's - callback URL as given in the subscription request. This request has the following - query string arguments appended (format described in Section 17.13.4 of - [W3C.REC‑html401‑19991224] (Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” December 1999.)): -

      -

      -
      -
      hub.mode
      -
      REQUIRED. The literal string "denied". -
      -
      hub.topic
      -
      REQUIRED. The topic URL given in the corresponding - subscription request. -
      -
      hub.reason
      -
      OPTIONAL. The hub may include a reason - for which the subscription has been denied. -
      -
      - -

      Hubs may provide an additional HTTP Location header (as described in section 14.30 - of Hypertext Transfer Protocol (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616]) to indicate that the - subscriber may retry subscribing to a different hub.topic. This allows - for limited distribution to specific groups, users in the context of social web - applications. -

      -

      The subscription MAY be denied by the hub at any point (even - if it was previously accepted). The Subscriber SHOULD then consider that - the subscription is not possible anymore. -

      -
      -
       TOC 
      -

      5.3.  -Hub Verifies Intent of the Subscriber

      - -

      In order to prevent an attacker from creating unwanted subscriptions - on behalf of a subscriber (or unsubscribing desired ones), a hub must - ensure that the subscriber did indeed send the subscription request. -

      -

      The hub verifies a subscription request by sending an HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] GET request to the subscriber's callback - URL as given in the subscription request. This request has the following - query string arguments appended (format described in Section 17.13.4 of - [W3C.REC‑html401‑19991224] (Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” December 1999.)): -

      -

      -
      -
      hub.mode
      -
      REQUIRED. The literal string "subscribe" or - "unsubscribe", which matches the original request to the hub from - the subscriber. -
      -
      hub.topic
      -
      REQUIRED. The topic URL given in the - corresponding subscription request. -
      -
      hub.challenge
      -
      REQUIRED. A hub-generated, random string - that MUST be echoed by the subscriber to verify the - subscription. -
      -
      hub.lease_seconds
      -
      REQUIRED/OPTIONAL. The - hub-determined number of seconds that the subscription will stay - active before expiring, measured from the time the verification - request was made from the hub to the subscriber. Hubs MUST supply - this parameter for subscription requests. This parameter MAY be - present for unsubscribe requests and MUST be ignored by subscribers - during unsubscription. -
      -
      - -
      -
       TOC 
      -

      5.3.1.  -Verification Details

      - -

      The subscriber MUST confirm that the hub.topic - corresponds to a pending subscription or unsubscription that it - wishes to carry out. If so, the subscriber MUST respond with an HTTP - success (2xx) code with a response body equal to the hub.challenge parameter. If the subscriber does - not agree with the action, the subscriber MUST respond with a 404 "Not - Found" response. -

      -

      The hub MUST consider other server response codes (3xx, 4xx, 5xx) - to mean that the verification request has failed. If the subscriber - returns an HTTP success (2xx) but the content body does not match the - hub.challenge parameter, the hub MUST also - consider verification to have failed. -

      -

      Hubs MAY make the hub.lease_seconds - equal to the period the subscriber passed in their subscription - request but MAY change the value depending on the hub's policies. To - sustain a temporary subscription, the subscriber MUST re-request the - subscription on the hub before hub.lease_seconds seconds has elapsed. -

      -
      -
       TOC 
      -

      6.  -Publishing

      - -

      The publisher MUST inform the hub it previously designated when a topic - has been updated. The hub and the publisher CAN agree on any mechanism, as - long as the hub is eventually able send the updated payload to the - subscribers. -

      -
      -
       TOC 
      -

      7.  -Content Distribution

      - -

      A content distribution request is an HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] POST request from hub to the subscriber's - callback URL with the payload of the notification. This request MUST - have a Content-Type corresponding to the - type of the topic. The hub MAY reduce the payload to a diff between two - consecutive versions if its format allows it. -

      -

      The POST request must include the Self Link Header - and a Hub Link Header that correspond - to topic's URL, as well as hub URL respectively. -

      -

      The successful response from the subscriber's callback URL MUST be an - HTTP success (2xx) code. The hub MUST consider all other subscriber - response codes as failures; that means subscribers MUST NOT use HTTP - redirects for moving subscriptions. The response body from the - subscriber MUST be ignored by the hub. Hubs SHOULD retry notifications - repeatedly until successful (up to some reasonable maximum over a - reasonable time period). Subscribers SHOULD respond to notifications as - quickly as possible; their success response code SHOULD only indicate - receipt of the message, not acknowledgment that it was successfully - processed by the subscriber. -

      -
      -
       TOC 
      -

      8.  -Authenticated Content Distribution

      - -

      If the subscriber supplied a value for hub.secret in their subscription request, the hub - MUST generate an HMAC signature of the payload and include that - signature in the request headers of the content distribution request. - The X-Hub-Signature header's value MUST be - in the form sha1=signature where signature is a 40-byte, hexadecimal representation - of a SHA1 signature (Eastlake, D. and P. Jones, “US Secure Hash Algorithm 1 (SHA1),” September 2001.) [RFC3174]. The signature MUST be - computed using the HMAC algorithm (Krawczyk, H., Bellare, M., and R. Canetti, “HMAC: Keyed-Hashing for Message Authentication,” .) [RFC2104] with the - request body as the data and the hub.secret - as the key. -

      -

      When subscribers receive a content distribution request with the - X-Hub-Signature header specified, they - SHOULD recompute the SHA1 signature with the shared secret using the - same method as the hub. If the signature does not match, subscribers - MUST still return a 2xx success response to acknowledge receipt, but - locally ignore the message as invalid. Using this technique along with - HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] for subscription requests enables - simple subscribers to receive authenticated notifications from hubs - without the need for subscribers to run an HTTPS server. -

      -

      Please note however that this signature only ensures that the payload - was not forged. Since the notification also includes headers, these should - not be considered as safe by the subscriber, unless of course the subscriber - uses HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] callbacks. -

      -
      -
       TOC 
      -

      9. References

      - - - - - - - - - - - - - - - - - - - - - - - -
      [RFC2104]Krawczyk, H., Bellare, M., and R. Canetti, “HMAC: Keyed-Hashing for Message Authentication,” RFC 2104.
      [RFC2119]Bradner, B., “Key words for use in RFCs to Indicate Requirement - Levels,” RFC 2119.
      [RFC2606]Eastlake, D. and A. Panitz, “Reserved Top Level DNS Names,” RFC 2606.
      [RFC2616]Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” RFC 2616.
      [RFC2818]Rescorla, E., “HTTP Over TLS,” RFC 2818, May 2000 (TXT).
      [RFC3174]Eastlake, D. and P. Jones, “US Secure Hash Algorithm 1 (SHA1),” RFC 3174, September 2001 (TXT).
      [RFC3986]Berners-Lee, T., “Uniform Resource Identifiers (URI): Generic Syntax,” RFC 3986.
      [RFC5785]Nottingham, M. and E. Hammer-Lahav, “Defining Well-Known Uniform Resource Identifiers (URIs),” RFC 5785.
      [RFC5988]Nottingham, M., “Web Linking,” RFC 5988, October 2010 (TXT).
      [W3C.REC-html401-19991224]Raggett, D., Hors, A., and I. Jacobs, “HTML 4.01 Specification,” World Wide Web Consortium Recommendation REC-html401-19991224, December 1999 (HTML).
      [XEP-0060]Millard, P., Saint-Andre, P., and R. Meijer, “Publish-Subscribe,” XSF XEP 0060.
      - -
      -
       TOC 
      -

      Appendix A.  -Specification Feedback

      - -

      Feedback on this specification is welcomed via the - PubSubHubbub W3C Community Group. For - more information, see the - W3C PubSubHubbub Community Group. - -

      -
      -
       TOC 
      -

      Authors' Addresses

      - - - - - - - - - - - - - - - - - - - - - - - - - - - - +

      Unsubscribing works in the same way, except with a single parameter changed to indicate the desire to unsubscribe. Also, the Hub will not validate unsubscription requests with the publisher.

      +

      5.1. Subscriber Sends Subscription Request

      +

      Subscription is initiated by the subscriber making an HTTPS [RFC2616] or HTTP [RFC2616] POST request to the hub URL. This request has a Content-Type of application/x-www-form-urlencoded (described in Section 17.13.4 of [W3C.REC-html401-19991224]) and the following parameters in its body:

      +

      + +

      +
      hub.callback
      +
      REQUIRED. The subscriber's callback URL where notifications should be delivered. It is considered good practice to use a unique callback URL for each subscription.
      +
      hub.mode
      +
      REQUIRED. The literal string "subscribe" or "unsubscribe", depending on the goal of the request.
      +
      hub.topic
      +
      REQUIRED. The topic URL that the subscriber wishes to subscribe to or unsubscribe from.
      +
      hub.lease_seconds
      +
      OPTIONAL. Number of seconds for which the subscriber would like to have the subscription active. Hubs MAY choose to respect this value or not, depending on their own policies. This parameter MAY be present for unsubscription requests and MUST be ignored by the hub in that case.
      +
      hub.secret
      +
      OPTIONAL. A subscriber-provided secret string that will be used to compute an HMAC digest for authorized content distribution [authednotify]. If not supplied, the HMAC digest will not be present for content distribution requests. This parameter SHOULD only be specified when the request was made over HTTPS [RFC2818]. This parameter MUST be less than 200 bytes in length.
      +
      +

      Subscribers MAY also include additional HTTP [RFC2616] request parameters, as well as HTTP [RFC2616] Headers if they are required by the hub. In the context of social web applications, it is considered good practice to include a From HTTP [RFC2616] header (as described in section 14.22 of Hypertext Transfer Protocol [RFC2616]) to indicate on behalf of which user the subscription is being performed.

      +

      Hubs MUST ignore additional request parameters they do not understand.

      +

      Hubs MUST allow subscribers to re-request subscriptions that are already activated. Each subsequent request to a hub to subscribe or unsubscribe MUST override the previous subscription state for a specific topic URL and callback URL combination once the action is verified. Any failures to confirm the subscription action MUST leave the subscription state unchanged. This is required so subscribers can renew their subscriptions before the lease seconds period is over without any interruption.

      +

      5.1.1. Subscription Parameter Details

      +

      The topic and callback URLs MAY use HTTP [RFC2616] or HTTPS [RFC2818] schemes. The topic URL MUST be the one advertised by the publisher in a Self Link Header during the discovery phase. (See Section 4). Hubs MAY refuse subscriptions if the topic URL does not correspond to the one advertised by the publisher. The topic URL can otherwise be free-form following the URI spec [RFC3986]. Hubs MUST always decode non-reserved characters for these URL parameters; see section 2.4 on "When to Encode or Decode" in the URI spec [RFC3986].

      +

      The callback URL MAY contain arbitrary query string parameters (e.g., ?foo=bar&red=fish). Hubs MUST preserve the query string during subscription verification by appending new parameters to the end of the list using the & (ampersand) character to join. Existing parameters with names that overlap with those used by verification requests will not be overwritten. For event notification, the callback URL will be POSTed to including any query-string parameters in the URL portion of the request, not as POST body parameters.

      +

      5.1.2. Subscription Response Details

      +

      The hub MUST respond to a subscription request with an HTTP [RFC2616] 202 "Accepted" response to indicate that the request was received and will now be verified (Section 5.3) and validated (Section 5.2) by the hub. The hub SHOULD perform the verification and validation of intent as soon as possible.

      +

      If a hub finds any errors in the subscription request, an appropriate HTTP [RFC2616] error response code (4xx or 5xx) MUST be returned. In the event of an error, hubs SHOULD return a description of the error in the response body as plain text. Hubs MAY decide to reject some callback URLs or topic URLs based on their own policies (e.g., domain authorization, topic URL port numbers).

      +

      5.2. Subscription Validation

      +

      Subscriptions MAY be validated by the Hubs who may require more details to accept or refuse a subscription. The Hub MAY also check with the publisher whether the subscription should be accepted.

      +

      If (and when), the subscription is accepted, the hub MUST perform the verification of intent [verifysub] of the subscriber.

      +

      If (and when), the subscription is denied, the hub MUST inform the subscriber by sending an HTTP [RFC2616] GET request to the subscriber's callback URL as given in the subscription request. This request has the following query string arguments appended (format described in Section 17.13.4 of [W3C.REC-html401-19991224]):

      +

      + +

      +
      hub.mode
      +
      REQUIRED. The literal string "denied".
      +
      hub.topic
      +
      REQUIRED. The topic URL given in the corresponding subscription request.
      +
      hub.reason
      +
      OPTIONAL. The hub may include a reason for which the subscription has been denied.
      +
      +

      Hubs may provide an additional HTTP [RFC2616] Location header (as described in section 14.30 of Hypertext Transfer Protocol [RFC2616]) to indicate that the subscriber may retry subscribing to a different hub.topic. This allows for limited distribution to specific groups or users in the context of social web applications.

      +

      The subscription MAY be denied by the hub at any point (even if it was previously accepted). The Subscriber SHOULD then consider that the subscription is not possible anymore.

      +

      5.3. Hub Verifies Intent of the Subscriber

      +

      In order to prevent an attacker from creating unwanted subscriptions on behalf of a subscriber (or unsubscribing desired ones), a hub must ensure that the subscriber did indeed send the subscription request.

      +

      The hub verifies a subscription request by sending an HTTP [RFC2616] GET request to the subscriber's callback URL as given in the subscription request. This request has the following query string arguments appended (format described in Section 17.13.4 of [W3C.REC-html401-19991224]):

      +

      + +

      +
      hub.mode
      +
      REQUIRED. The literal string "subscribe" or "unsubscribe", which matches the original request to the hub from the subscriber.
      +
      hub.topic
      +
      REQUIRED. The topic URL given in the corresponding subscription request.
      +
      hub.challenge
      +
      REQUIRED. A hub-generated, random string that MUST be echoed by the subscriber to verify the subscription.
      +
      hub.lease_seconds
      +
      REQUIRED/OPTIONAL. The hub-determined number of seconds that the subscription will stay active before expiring, measured from the time the verification request was made from the hub to the subscriber. Hubs MUST supply this parameter for subscription requests. This parameter MAY be present for unsubscribe requests and MUST be ignored by subscribers during unsubscription.
      +
      +

      5.3.1. Verification Details

      +

      The subscriber MUST confirm that the hub.topic corresponds to a pending subscription or unsubscription that it wishes to carry out. If so, the subscriber MUST respond with an HTTP success (2xx) code with a response body equal to the hub.challenge parameter. If the subscriber does not agree with the action, the subscriber MUST respond with a 404 "Not Found" response.

      +

      The hub MUST consider other server response codes (3xx, 4xx, 5xx) to mean that the verification request has failed. If the subscriber returns an HTTP [RFC2616] success (2xx) but the content body does not match the hub.challenge parameter, the hub MUST also consider verification to have failed.

      +

      Hubs MAY make the hub.lease_seconds equal to the value the subscriber passed in their subscription request but MAY change the value depending on the hub's policies. To sustain a subscription, the subscriber MUST re-request the subscription on the hub before hub.lease_seconds seconds has elapsed.

      +

      6. Publishing

      +

      The publisher MUST inform the hubs it previously designated when a topic has been updated. The hub and the publisher can agree on any mechanism, as long as the hub is eventually able send the updated payload to the subscribers.

      +

      7. Content Distribution

      +

      A content distribution request is an HTTP [RFC2616] POST request from hub to the subscriber's callback URL with the payload of the notification. This request MUST have a Content-Type corresponding to the type of the topic. The hub MAY reduce the payload to a diff between two consecutive versions if its format allows it.

      +

      The request MUST include a Link Header [RFC5988] with rel=hub pointing to the Hub as well as a Link Header [RFC5988] with rel=self set to the topic that's being updated. The Hub SHOULD combine both headers into a single Link Header [RFC5988].

      +

      The successful response from the subscriber's callback URL MUST be an HTTP [RFC2616] success (2xx) code. The hub MUST consider all other subscriber response codes as failures; that means subscribers MUST NOT use HTTP redirects for moving subscriptions. The response body from the subscriber MUST be ignored by the hub. Hubs SHOULD retry notifications repeatedly until successful (up to some reasonable maximum over a reasonable time period). Subscribers SHOULD respond to notifications as quickly as possible; their success response code SHOULD only indicate receipt of the message, not acknowledgment that it was successfully processed by the subscriber.

      +

      8. Authenticated Content Distribution

      +

      If the subscriber supplied a value for hub.secret in their subscription request, the hub MUST generate an HMAC signature of the payload and include that signature in the request headers of the content distribution request. The X-Hub-Signature header's value MUST be in the form sha1=signature where signature is a 40-byte, hexadecimal representation of a SHA1 signature [RFC3174]. The signature MUST be computed using the HMAC algorithm [RFC2104] with the request body as the data and the hub.secret as the key.

      +

      When subscribers receive a content distribution request with the X-Hub-Signature header specified, they SHOULD recompute the SHA1 signature with the shared secret using the same method as the hub. If the signature does not match, subscribers MUST still return a 2xx success response to acknowledge receipt, but locally ignore the message as invalid. Using this technique along with HTTPS [RFC2818] for subscription requests enables simple subscribers to receive authenticated notifications from hubs without the need for subscribers to run an HTTPS [RFC2818] server.

      +

      Please note however that this signature only ensures that the payload was not forged. Since the notification also includes headers, these should not be considered as safe by the subscriber, unless of course the subscriber uses HTTPS [RFC2818] callbacks.

      +

      9. References

      +
       Brad Fitzpatrick
       Google, Inc
      Email: brad@danga.com
        
       Brett Slatkin
       Google, Inc
      Email: bslatkin@gmail.com
        
       Martin Atkins
       Six Apart Ltd.
      Email: mart@degeneration.co.uk
        
       Julien Genestoux
       Notifixious Inc.
      Email: julien@superfeedr.com
      + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
      + [RFC2104] + Krawczyk, H., Bellare, M. and R. Canetti, "HMAC: Keyed-Hashing for Message Authentication", RFC 2104,
      + [RFC2119] + Bradner, B., "Key words for use in RFCs to Indicate Requirement Levels", RFC 2119,
      + [RFC2606] + Eastlake, D. and A. Panitz, "Reserved Top Level DNS Names", RFC 2606,
      + [RFC2616] + Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P. and T. Berners-Lee, "Hypertext Transfer Protocol -- HTTP/1.1", RFC 2616,
      + [RFC2818] + Rescorla, E., "HTTP Over TLS", RFC 2818, May 2000.
      + [RFC3174] + Eastlake, D. and P. Jones, "US Secure Hash Algorithm 1 (SHA1)", RFC 3174, September 2001.
      + [RFC3986] + Berners-Lee, T., "Uniform Resource Identifiers (URI): Generic Syntax", RFC 3986,
      + [RFC5785] + Nottingham, M. and E. Hammer-Lahav, "Defining Well-Known Uniform Resource Identifiers (URIs)", RFC 5785,
      + [RFC5988] + Nottingham, M., "Web Linking", RFC 5988, October 2010.
      + [W3C.REC-html401-19991224] + Raggett, D., Hors, A. and I. Jacobs, "HTML 4.01 Specification", World Wide Web Consortium Recommendation REC-html401-19991224, December 1999.
      + [XEP-0060] + Millard, P., Saint-Andre, P. and R. Meijer, "Publish-Subscribe", XSF XEP 0060,
      - +

      Appendix A. Specification Feedback

      +

      Feedback on this specification is welcomed via the PubSubHubbub W3C Community Group. For more information, see the W3C PubSubHubbub Community Group.

      +

      + Authors' Addresses +

      +
      +
      + + Brad Fitzpatrick + + + Google, Inc + + + + + + + + + + EMail: brad@danga.com + +
      +
      +
      + + Brett Slatkin + + + Google, Inc + + + + + + + + + + EMail: bslatkin@gmail.com + +
      +
      +
      + + Martin Atkins + + + Six Apart Ltd. + + + + + + + + + + EMail: mart@degeneration.co.uk + +
      +
      +
      + + Julien Genestoux + + + Notifixious Inc. + + + + + + + + + + EMail: julien@superfeedr.com + +
      +
      + + + \ No newline at end of file From f3979d807af9b310c2fd754659fea05c497f2418 Mon Sep 17 00:00:00 2001 From: julien Date: Mon, 24 Jun 2013 17:03:34 +0200 Subject: [PATCH 57/76] host-meta only works for rel=hub --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index e68f9c5..0aa3035 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -181,7 +181,7 @@ Similarly, for HTML pages, it MAY use embedded link elements as described in Appendix A of Web Linking. Finally, publishers MAY also use the Well-Known Uniform Resource Identifiers - .host-meta to include the <Link> element. + .host-meta to include the <Link> element with rel="hub".
From afac2fea751f3387ddf7e5430b9e38e4dba14800 Mon Sep 17 00:00:00 2001 From: julien Date: Tue, 19 Nov 2013 15:08:58 +0100 Subject: [PATCH 58/76] only putting the protocol --- COPYING | 13 - Makefile | 8 - analytics.txt | 10 - appengine_hub_preso_gadget.xml | 5 - bookmarklet/Makefile | 7 - bookmarklet/bookmarklet.html | 115 - bookmarklet/bookmarklet.js | 23 - bookmarklet/bookmarklet.min.js | 1 - bookmarklet/bookmarklet_config.html | 46 - bookmarklet/bookmarklet_config.template | 45 - bookmarklet/bookmarklet_gadget.xml | 5 - bookmarklet/bookmarklet_jsonp.js | 127 - bookmarklet/bookmarklet_jsonp.min.js | 1 - bookmarklet/generate_config.py | 5 - bookmarklet/jsmin.py | 218 - design-doc.txt | 593 --- hub/all_stats.html | 65 - hub/app.yaml | 62 - hub/async_apiproxy.py | 133 - hub/base.css | 31 - hub/bookmarklet | 1 - hub/cron.yaml | 12 - hub/dos.py | 1055 ---- hub/dos_test.py | 1717 ------- hub/event_details.html | 105 - hub/favicon.ico | Bin 1406 -> 0 bytes hub/feed_diff.py | 258 - hub/feed_diff_test.py | 331 -- hub/feed_diff_testdata/atom_namespace.xml | 60 - hub/feed_diff_testdata/atom_no_id.xml | 29 - hub/feed_diff_testdata/attribute_escaping.xml | 19 - hub/feed_diff_testdata/bad_atom_feed.xml | 19 - hub/feed_diff_testdata/bad_feed.xml | 1 - hub/feed_diff_testdata/cdata_test.xml | 47 - hub/feed_diff_testdata/entity_escaping.xml | 19 - hub/feed_diff_testdata/missing_entry_id.xml | 18 - hub/feed_diff_testdata/no_xml_header.xml | 18 - hub/feed_diff_testdata/parsing.xml | 348 -- hub/feed_diff_testdata/rdf_10_weirdness.xml | 360 -- hub/feed_diff_testdata/rss2_only_link.xml | 24 - hub/feed_diff_testdata/rss2_only_title.xml | 24 - hub/feed_diff_testdata/rss2sample.xml | 42 - hub/feed_diff_testdata/rss_no_link.xml | 24 - hub/feed_diff_testdata/rss_rdf.xml | 30 - hub/feed_diff_testdata/sampleRss091.xml | 50 - hub/feed_diff_testdata/sampleRss092.xml | 49 - hub/feed_diff_testdata/whitespace_id.xml | 34 - hub/feed_diff_testdata/xhtml_entities.xml | 3 - hub/feed_identifier.py | 137 - hub/feed_identifier_test.py | 108 - hub/fork_join_queue.py | 512 -- hub/fork_join_queue_test.py | 539 -- hub/google3/__init__.py | 0 hub/google3/apphosting/__init__.py | 0 hub/google3/apphosting/runtime/__init__.py | 0 .../_apphosting_runtime___python__apiproxy.py | 2 - hub/index.yaml | 19 - hub/main.py | 3562 -------------- hub/main_test.py | 4350 ----------------- hub/mapreduce.yaml | 44 - hub/offline_jobs.py | 147 - hub/offline_jobs_test.py | 287 -- hub/publish_debug.html | 38 - hub/queue.yaml | 19 - hub/remote_shell.py | 47 - hub/run_tests.sh | 11 - hub/stats_table.html | 33 - hub/subscribe_debug.html | 68 - hub/testutil.py | 283 -- hub/topic_details.html | 88 - hub/urlfetch_async.py | 137 - hub/urlfetch_test_stub.py | 139 - hub/welcome.html | 56 - loadtest/app.yaml | 8 - loadtest/atom.xml | 24 - loadtest/index.yaml | 11 - loadtest/main.py | 63 - media/light_pings_bandwidth.png | Bin 24583 -> 0 bytes media/light_pings_cache_sync.png | Bin 36383 -> 0 bytes media/light_pings_combined_publisher.png | Bin 18847 -> 0 bytes media/light_pings_cpu.png | Bin 24877 -> 0 bytes media/light_pings_naive_pings.png | Bin 22994 -> 0 bytes media/light_pings_proxy.png | Bin 32510 -> 0 bytes media/light_pings_proxy_bandwidth.png | Bin 34641 -> 0 bytes media/light_pings_proxy_bandwidth_slow.png | Bin 34705 -> 0 bytes media/light_pings_proxy_cpu.png | Bin 35759 -> 0 bytes media/light_pings_proxy_cpu_slow.png | Bin 36228 -> 0 bytes media/pshb_bandwidth.png | Bin 25626 -> 0 bytes media/pshb_cache_sync.png | Bin 30240 -> 0 bytes media/pshb_combined_publisher.png | Bin 15951 -> 0 bytes media/pshb_naive_cpu.png | Bin 26740 -> 0 bytes media/pshb_naive_pings.png | Bin 21639 -> 0 bytes nonstandard/fat_publish.py | 142 - nonstandard/fat_publish_test.py | 166 - nonstandard/virtual_feed.py | 172 - nonstandard/virtual_feed_test.py | 216 - presentation_gadget.xml | 5 - publisher/app.yaml | 8 - publisher/atom.xml | 18 - publisher/index.yaml | 17 - publisher/input.html | 40 - publisher/main.py | 92 - publisher_clients/README.txt | 3 - publisher_clients/perl-schwartz/.shipit | 6 - publisher_clients/perl-schwartz/CHANGES | 6 - publisher_clients/perl-schwartz/MANIFEST | 7 - publisher_clients/perl-schwartz/Makefile.PL | 13 - .../perl-schwartz/demo-insert-job.pl | 34 - .../perl-schwartz/demo-worker.pl | 14 - .../TheSchwartz/Worker/PubSubHubbubPublish.pm | 132 - publisher_clients/perl-schwartz/t/00-use.t | 5 - publisher_clients/perl/.gitignore | 1 - publisher_clients/perl/.shipit | 5 - publisher_clients/perl/ChangeLog | 7 - publisher_clients/perl/MANIFEST | 6 - publisher_clients/perl/Makefile.PL | 17 - .../perl/lib/Net/PubSubHubbub/Publisher.pm | 123 - publisher_clients/perl/pubsubhubbub-publish | 48 - publisher_clients/perl/t/00-use.t | 8 - publisher_clients/php/README.txt | 21 - .../php/examples/publisher_example.php | 51 - publisher_clients/php/library/publisher.php | 86 - publisher_clients/python/CHANGES | 2 - .../python/pubsubhubbub_publish.py | 77 - .../python/pubsubhubbub_publish_test.py | 139 - publisher_clients/python/setup.py | 36 - publisher_clients/wordpress/1.0/publisher.php | 86 - .../wordpress/1.0/pubsubhubbub.php | 179 - publisher_clients/wordpress/1.0/readme.txt | 43 - .../wordpress/1.0/screenshot-1.png | Bin 14558 -> 0 bytes publisher_clients/wordpress/1.1/publisher.php | 86 - .../wordpress/1.1/pubsubhubbub.php | 179 - publisher_clients/wordpress/1.1/readme.txt | 43 - .../wordpress/1.1/screenshot-1.png | Bin 14558 -> 0 bytes publisher_clients/wordpress/1.2/publisher.php | 86 - .../wordpress/1.2/pubsubhubbub.php | 211 - publisher_clients/wordpress/1.2/readme.txt | 46 - .../wordpress/1.2/screenshot-1.png | Bin 40565 -> 0 bytes publisher_clients/wordpress/1.3/publisher.php | 86 - .../wordpress/1.3/pubsubhubbub.php | 221 - publisher_clients/wordpress/1.3/readme.txt | 54 - .../wordpress/1.3/screenshot-1.png | Bin 40565 -> 0 bytes publisher_clients/wordpress/README.txt | 13 - subscriber/app.yaml | 10 - subscriber/feedparser.py | 2858 ----------- subscriber/index.yaml | 17 - subscriber/main.py | 150 - subscriber/simplejson/__init__.py | 378 -- subscriber/simplejson/_speedups.c | 2094 -------- subscriber/simplejson/decoder.py | 336 -- subscriber/simplejson/encoder.py | 439 -- subscriber/simplejson/scanner.py | 66 - subscriber/simplejson/tests/__init__.py | 23 - subscriber/simplejson/tests/test_decode.py | 22 - subscriber/simplejson/tests/test_default.py | 9 - subscriber/simplejson/tests/test_dump.py | 13 - .../tests/test_encode_basestring_ascii.py | 38 - subscriber/simplejson/tests/test_fail.py | 76 - subscriber/simplejson/tests/test_float.py | 14 - subscriber/simplejson/tests/test_indent.py | 41 - subscriber/simplejson/tests/test_pass1.py | 76 - subscriber/simplejson/tests/test_pass2.py | 14 - subscriber/simplejson/tests/test_pass3.py | 20 - subscriber/simplejson/tests/test_recursion.py | 65 - .../simplejson/tests/test_scanstring.py | 104 - .../simplejson/tests/test_separators.py | 42 - subscriber/simplejson/tests/test_unicode.py | 59 - subscriber/simplejson/tool.py | 44 - subscriber/static/agg.js | 36 - subscriber/subscriber.html | 35 - subscriber_clients/php/example.php | 25 - subscriber_clients/php/subscriber.php | 120 - testsuite/README | 20 - testsuite/hub.rb | 69 - testsuite/hub_spec.rb | 137 - testsuite/mocks.rb | 132 - 176 files changed, 27580 deletions(-) delete mode 100644 COPYING delete mode 100644 Makefile delete mode 100644 analytics.txt delete mode 100644 appengine_hub_preso_gadget.xml delete mode 100644 bookmarklet/Makefile delete mode 100644 bookmarklet/bookmarklet.html delete mode 100644 bookmarklet/bookmarklet.js delete mode 100644 bookmarklet/bookmarklet.min.js delete mode 100644 bookmarklet/bookmarklet_config.html delete mode 100644 bookmarklet/bookmarklet_config.template delete mode 100644 bookmarklet/bookmarklet_gadget.xml delete mode 100644 bookmarklet/bookmarklet_jsonp.js delete mode 100644 bookmarklet/bookmarklet_jsonp.min.js delete mode 100755 bookmarklet/generate_config.py delete mode 100644 bookmarklet/jsmin.py delete mode 100644 design-doc.txt delete mode 100644 hub/all_stats.html delete mode 100644 hub/app.yaml delete mode 100644 hub/async_apiproxy.py delete mode 100644 hub/base.css delete mode 120000 hub/bookmarklet delete mode 100644 hub/cron.yaml delete mode 100644 hub/dos.py delete mode 100755 hub/dos_test.py delete mode 100644 hub/event_details.html delete mode 100644 hub/favicon.ico delete mode 100755 hub/feed_diff.py delete mode 100755 hub/feed_diff_test.py delete mode 100644 hub/feed_diff_testdata/atom_namespace.xml delete mode 100644 hub/feed_diff_testdata/atom_no_id.xml delete mode 100644 hub/feed_diff_testdata/attribute_escaping.xml delete mode 100644 hub/feed_diff_testdata/bad_atom_feed.xml delete mode 100644 hub/feed_diff_testdata/bad_feed.xml delete mode 100644 hub/feed_diff_testdata/cdata_test.xml delete mode 100644 hub/feed_diff_testdata/entity_escaping.xml delete mode 100644 hub/feed_diff_testdata/missing_entry_id.xml delete mode 100644 hub/feed_diff_testdata/no_xml_header.xml delete mode 100644 hub/feed_diff_testdata/parsing.xml delete mode 100644 hub/feed_diff_testdata/rdf_10_weirdness.xml delete mode 100644 hub/feed_diff_testdata/rss2_only_link.xml delete mode 100644 hub/feed_diff_testdata/rss2_only_title.xml delete mode 100644 hub/feed_diff_testdata/rss2sample.xml delete mode 100644 hub/feed_diff_testdata/rss_no_link.xml delete mode 100644 hub/feed_diff_testdata/rss_rdf.xml delete mode 100644 hub/feed_diff_testdata/sampleRss091.xml delete mode 100644 hub/feed_diff_testdata/sampleRss092.xml delete mode 100644 hub/feed_diff_testdata/whitespace_id.xml delete mode 100644 hub/feed_diff_testdata/xhtml_entities.xml delete mode 100644 hub/feed_identifier.py delete mode 100755 hub/feed_identifier_test.py delete mode 100644 hub/fork_join_queue.py delete mode 100755 hub/fork_join_queue_test.py delete mode 100644 hub/google3/__init__.py delete mode 100644 hub/google3/apphosting/__init__.py delete mode 100644 hub/google3/apphosting/runtime/__init__.py delete mode 100644 hub/google3/apphosting/runtime/_apphosting_runtime___python__apiproxy.py delete mode 100644 hub/index.yaml delete mode 100644 hub/main.py delete mode 100755 hub/main_test.py delete mode 100644 hub/mapreduce.yaml delete mode 100644 hub/offline_jobs.py delete mode 100755 hub/offline_jobs_test.py delete mode 100644 hub/publish_debug.html delete mode 100644 hub/queue.yaml delete mode 100755 hub/remote_shell.py delete mode 100755 hub/run_tests.sh delete mode 100644 hub/stats_table.html delete mode 100644 hub/subscribe_debug.html delete mode 100644 hub/testutil.py delete mode 100644 hub/topic_details.html delete mode 100644 hub/urlfetch_async.py delete mode 100644 hub/urlfetch_test_stub.py delete mode 100644 hub/welcome.html delete mode 100644 loadtest/app.yaml delete mode 100644 loadtest/atom.xml delete mode 100644 loadtest/index.yaml delete mode 100755 loadtest/main.py delete mode 100644 media/light_pings_bandwidth.png delete mode 100644 media/light_pings_cache_sync.png delete mode 100644 media/light_pings_combined_publisher.png delete mode 100644 media/light_pings_cpu.png delete mode 100644 media/light_pings_naive_pings.png delete mode 100644 media/light_pings_proxy.png delete mode 100644 media/light_pings_proxy_bandwidth.png delete mode 100644 media/light_pings_proxy_bandwidth_slow.png delete mode 100644 media/light_pings_proxy_cpu.png delete mode 100644 media/light_pings_proxy_cpu_slow.png delete mode 100644 media/pshb_bandwidth.png delete mode 100644 media/pshb_cache_sync.png delete mode 100644 media/pshb_combined_publisher.png delete mode 100644 media/pshb_naive_cpu.png delete mode 100644 media/pshb_naive_pings.png delete mode 100644 nonstandard/fat_publish.py delete mode 100755 nonstandard/fat_publish_test.py delete mode 100644 nonstandard/virtual_feed.py delete mode 100755 nonstandard/virtual_feed_test.py delete mode 100644 presentation_gadget.xml delete mode 100644 publisher/app.yaml delete mode 100644 publisher/atom.xml delete mode 100644 publisher/index.yaml delete mode 100644 publisher/input.html delete mode 100755 publisher/main.py delete mode 100644 publisher_clients/README.txt delete mode 100644 publisher_clients/perl-schwartz/.shipit delete mode 100644 publisher_clients/perl-schwartz/CHANGES delete mode 100644 publisher_clients/perl-schwartz/MANIFEST delete mode 100644 publisher_clients/perl-schwartz/Makefile.PL delete mode 100755 publisher_clients/perl-schwartz/demo-insert-job.pl delete mode 100755 publisher_clients/perl-schwartz/demo-worker.pl delete mode 100644 publisher_clients/perl-schwartz/lib/TheSchwartz/Worker/PubSubHubbubPublish.pm delete mode 100644 publisher_clients/perl-schwartz/t/00-use.t delete mode 100644 publisher_clients/perl/.gitignore delete mode 100644 publisher_clients/perl/.shipit delete mode 100644 publisher_clients/perl/ChangeLog delete mode 100644 publisher_clients/perl/MANIFEST delete mode 100644 publisher_clients/perl/Makefile.PL delete mode 100644 publisher_clients/perl/lib/Net/PubSubHubbub/Publisher.pm delete mode 100755 publisher_clients/perl/pubsubhubbub-publish delete mode 100644 publisher_clients/perl/t/00-use.t delete mode 100644 publisher_clients/php/README.txt delete mode 100644 publisher_clients/php/examples/publisher_example.php delete mode 100644 publisher_clients/php/library/publisher.php delete mode 100644 publisher_clients/python/CHANGES delete mode 100644 publisher_clients/python/pubsubhubbub_publish.py delete mode 100755 publisher_clients/python/pubsubhubbub_publish_test.py delete mode 100644 publisher_clients/python/setup.py delete mode 100644 publisher_clients/wordpress/1.0/publisher.php delete mode 100755 publisher_clients/wordpress/1.0/pubsubhubbub.php delete mode 100644 publisher_clients/wordpress/1.0/readme.txt delete mode 100644 publisher_clients/wordpress/1.0/screenshot-1.png delete mode 100644 publisher_clients/wordpress/1.1/publisher.php delete mode 100755 publisher_clients/wordpress/1.1/pubsubhubbub.php delete mode 100644 publisher_clients/wordpress/1.1/readme.txt delete mode 100644 publisher_clients/wordpress/1.1/screenshot-1.png delete mode 100644 publisher_clients/wordpress/1.2/publisher.php delete mode 100755 publisher_clients/wordpress/1.2/pubsubhubbub.php delete mode 100644 publisher_clients/wordpress/1.2/readme.txt delete mode 100644 publisher_clients/wordpress/1.2/screenshot-1.png delete mode 100644 publisher_clients/wordpress/1.3/publisher.php delete mode 100755 publisher_clients/wordpress/1.3/pubsubhubbub.php delete mode 100644 publisher_clients/wordpress/1.3/readme.txt delete mode 100644 publisher_clients/wordpress/1.3/screenshot-1.png delete mode 100644 publisher_clients/wordpress/README.txt delete mode 100644 subscriber/app.yaml delete mode 100755 subscriber/feedparser.py delete mode 100644 subscriber/index.yaml delete mode 100755 subscriber/main.py delete mode 100644 subscriber/simplejson/__init__.py delete mode 100644 subscriber/simplejson/_speedups.c delete mode 100644 subscriber/simplejson/decoder.py delete mode 100644 subscriber/simplejson/encoder.py delete mode 100644 subscriber/simplejson/scanner.py delete mode 100644 subscriber/simplejson/tests/__init__.py delete mode 100644 subscriber/simplejson/tests/test_decode.py delete mode 100644 subscriber/simplejson/tests/test_default.py delete mode 100644 subscriber/simplejson/tests/test_dump.py delete mode 100644 subscriber/simplejson/tests/test_encode_basestring_ascii.py delete mode 100644 subscriber/simplejson/tests/test_fail.py delete mode 100644 subscriber/simplejson/tests/test_float.py delete mode 100644 subscriber/simplejson/tests/test_indent.py delete mode 100644 subscriber/simplejson/tests/test_pass1.py delete mode 100644 subscriber/simplejson/tests/test_pass2.py delete mode 100644 subscriber/simplejson/tests/test_pass3.py delete mode 100644 subscriber/simplejson/tests/test_recursion.py delete mode 100644 subscriber/simplejson/tests/test_scanstring.py delete mode 100644 subscriber/simplejson/tests/test_separators.py delete mode 100644 subscriber/simplejson/tests/test_unicode.py delete mode 100644 subscriber/simplejson/tool.py delete mode 100644 subscriber/static/agg.js delete mode 100644 subscriber/subscriber.html delete mode 100644 subscriber_clients/php/example.php delete mode 100644 subscriber_clients/php/subscriber.php delete mode 100644 testsuite/README delete mode 100644 testsuite/hub.rb delete mode 100644 testsuite/hub_spec.rb delete mode 100644 testsuite/mocks.rb diff --git a/COPYING b/COPYING deleted file mode 100644 index 6f01560..0000000 --- a/COPYING +++ /dev/null @@ -1,13 +0,0 @@ -Copyright 2008 Google Inc. - -Licensed under the Apache License, Version 2.0 (the "License"); -you may not use this file except in compliance with the License. -You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - -Unless required by applicable law or agreed to in writing, software -distributed under the License is distributed on an "AS IS" BASIS, -WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -See the License for the specific language governing permissions and -limitations under the License. diff --git a/Makefile b/Makefile deleted file mode 100644 index 56ce3f7..0000000 --- a/Makefile +++ /dev/null @@ -1,8 +0,0 @@ -spec: pubsubhubbub-core-0.3.html - -pubsubhubbub-core-0.3.html: pubsubhubbub-core-0.3.xml - xml2rfc pubsubhubbub-core-0.3.xml pubsubhubbub-core-0.3.html - cat pubsubhubbub-core-0.3.html | head -n -1 > out.html - cat analytics.txt >> out.html - mv out.html pubsubhubbub-core-0.3.html - diff --git a/analytics.txt b/analytics.txt deleted file mode 100644 index e6941a1..0000000 --- a/analytics.txt +++ /dev/null @@ -1,10 +0,0 @@ - - - diff --git a/appengine_hub_preso_gadget.xml b/appengine_hub_preso_gadget.xml deleted file mode 100644 index 2552b3d..0000000 --- a/appengine_hub_preso_gadget.xml +++ /dev/null @@ -1,5 +0,0 @@ - - - - - diff --git a/bookmarklet/Makefile b/bookmarklet/Makefile deleted file mode 100644 index 5e29c28..0000000 --- a/bookmarklet/Makefile +++ /dev/null @@ -1,7 +0,0 @@ -bookmarklet: bookmarklet.min.js bookmarklet_jsonp.min.js bookmarklet_config.html - -%.min.js: %.js - cat $^ | python jsmin.py | tail -n 1 > $@ - -bookmarklet_config.html: bookmarklet_config.template bookmarklet.min.js - python generate_config.py > $@ diff --git a/bookmarklet/bookmarklet.html b/bookmarklet/bookmarklet.html deleted file mode 100644 index 2868d87..0000000 --- a/bookmarklet/bookmarklet.html +++ /dev/null @@ -1,115 +0,0 @@ - - - - - - - -
- -
- Found this feed: -
-
- -
- Publishing new events to this hub: -
-
- -
- - -
- - - -
- - - \ No newline at end of file diff --git a/bookmarklet/bookmarklet.js b/bookmarklet/bookmarklet.js deleted file mode 100644 index 7269764..0000000 --- a/bookmarklet/bookmarklet.js +++ /dev/null @@ -1,23 +0,0 @@ -// Copyright 2009 Google Inc. -// -// Licensed under the Apache License, Version 2.0 (the "License"); -// you may not use this file except in compliance with the License. -// You may obtain a copy of the License at -// -// http://www.apache.org/licenses/LICENSE-2.0 -// -// Unless required by applicable law or agreed to in writing, software -// distributed under the License is distributed on an "AS IS" BASIS, -// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -// See the License for the specific language governing permissions and -// limitations under the License. - -(function() { - if (document.body && !document.xmlVersion) { - var jsonp = document.createElement('script'); - jsonp.type = 'text/javascript'; - // Remove the domain portion of the URL below for local testing. - jsonp.src = 'http://pubsubhubbub.appspot.com/bookmarklet_jsonp.min.js?rand=' + Math.floor(Math.random() * 1000); - var head = document.getElementsByTagName('head')[0].appendChild(jsonp); - }; -})() diff --git a/bookmarklet/bookmarklet.min.js b/bookmarklet/bookmarklet.min.js deleted file mode 100644 index 8084297..0000000 --- a/bookmarklet/bookmarklet.min.js +++ /dev/null @@ -1 +0,0 @@ -(function(){if(document.body&&!document.xmlVersion){var jsonp=document.createElement('script');jsonp.type='text/javascript';jsonp.src='http://pubsubhubbub.appspot.com/bookmarklet_jsonp.min.js?rand='+Math.floor(Math.random()*1000);var head=document.getElementsByTagName('head')[0].appendChild(jsonp);};})() \ No newline at end of file diff --git a/bookmarklet/bookmarklet_config.html b/bookmarklet/bookmarklet_config.html deleted file mode 100644 index dfdb6f1..0000000 --- a/bookmarklet/bookmarklet_config.html +++ /dev/null @@ -1,46 +0,0 @@ - - - PubSubHubbub - Configure bookmarklet - - - - - - -
- - -
- -
- Drag into your Bookmarks → - Publish to Hub -
- - - - diff --git a/bookmarklet/bookmarklet_config.template b/bookmarklet/bookmarklet_config.template deleted file mode 100644 index 76a7b50..0000000 --- a/bookmarklet/bookmarklet_config.template +++ /dev/null @@ -1,45 +0,0 @@ - - - PubSubHubbub - Configure bookmarklet - - - - - - -
- - -
- -
- Drag into your Bookmarks → - Publish to Hub -
- - - diff --git a/bookmarklet/bookmarklet_gadget.xml b/bookmarklet/bookmarklet_gadget.xml deleted file mode 100644 index 2a5f22d..0000000 --- a/bookmarklet/bookmarklet_gadget.xml +++ /dev/null @@ -1,5 +0,0 @@ - - - - - diff --git a/bookmarklet/bookmarklet_jsonp.js b/bookmarklet/bookmarklet_jsonp.js deleted file mode 100644 index e0d2211..0000000 --- a/bookmarklet/bookmarklet_jsonp.js +++ /dev/null @@ -1,127 +0,0 @@ -// Copyright 2009 Google Inc. -// -// Licensed under the Apache License, Version 2.0 (the 'License'); -// you may not use this file except in compliance with the License. -// You may obtain a copy of the License at -// -// http://www.apache.org/licenses/LICENSE-2.0 -// -// Unless required by applicable law or agreed to in writing, software -// distributed under the License is distributed on an 'AS IS' BASIS, -// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -// See the License for the specific language governing permissions and -// limitations under the License. - -var _____pshb_BookmarkletRun = function() { - - var post_id = 'pshb-bookmarklet-iframe'; - var post = null; - var close = null; - - if (document.getElementById(post_id) == null) { - post = document.createElement('iframe'); - post.id = post_id; - post.width = '250'; - post.height = '120'; - var s = post.style; - s.position = 'absolute'; - s.top = '10px'; - s.right = '10px'; - s.padding = '0'; - s.margin = '0'; - s.border = '5px solid #9c0'; - s.zIndex = '1000000'; - - close = document.createElement('a'); - close.href = 'javascript:window._____pshb_closeMe();'; - close.innerHTML = '×'; - s = close.style; - s.cursor = 'default'; - s.fontWeight = 'bold'; - s.fontSize = '12px'; - s.position = 'absolute'; - s.top = '15px'; - s.right = '15px'; - s.margin = '0'; - s.borderStyle = 'dotted'; - s.borderColor = '#aaa;'; - s.borderWidth = '0 0 1px 1px'; - s.padding = '0 3px 0 3px'; - s.display = 'block'; - s.textDecoration = 'none'; - s.color = '#000'; - s.zIndex = '1000001'; - }; - - // Thanks Prototype. - var canonicalize = function(s) { - if (s == '' || s == null) { - return ''; - }; - var temp = document.createElement('div'); - temp.innerHTML = s.toLowerCase(); - var result = temp.childNodes[0].nodeValue; - temp.removeChild(temp.firstChild); // garbage collection - return result; - }; - - window._____pshb_closeMe = function() { - document.body.removeChild(close); - document.body.removeChild(post); - }; - - var findAtomFeed = function() { - var links = document.getElementsByTagName('link'); - for (var i = 0; i < links.length; ++i) { - var item = links[i]; - if (item.type != undefined && - item.href != undefined && - item.rel != undefined && - canonicalize(item.type).indexOf('application/atom') == 0 && - canonicalize(item.rel).indexOf('alternate') == 0 && - item.href.length > 0) { - return item.href; - }; - }; - return null; - }; - - window._____pshb_sawLoad = false; - window._____pshb_autoClose = true; - - // TODO: Figure out a better way to detect event delivery completion. - // XHR can see 204 responses but doing this cross-domain seems impossible. - // Proxying the publish POST through a server because that will hide the IP - // address of the requestor; this leaves publishing open to a DoS attack, - // which we want to avoid. - window._____pshb_handleLoad = function() { - if (!window._____pshb_sawLoad) { - window._____pshb_sawLoad = true; - } else { - // This means the iframe has loaded another page, which could not possibly - // be a 204 response (since browsers do nothing on that response). So here - // we assume the post failed and do not automatically close the window. - window._____pshb_autoClose = false; - }; - }; - - var autoClose = function() { - if (window._____pshb_autoClose) { - window._____pshb_closeMe(); - }; - }; - - - if (post != null) { - var feed = findAtomFeed(); - var hub = _____pshb_getHub(); - post.onload = _____pshb_handleLoad; - // Remove the domain portion of the URL below for local testing. - post.src = 'http://pubsubhubbub.appspot.com/bookmarklet.html' + '?feed=' + feed + '&hub=' + hub; - document.body.appendChild(post); - document.body.appendChild(close); - setTimeout(autoClose, 2000); - }; -}; - -_____pshb_BookmarkletRun(); diff --git a/bookmarklet/bookmarklet_jsonp.min.js b/bookmarklet/bookmarklet_jsonp.min.js deleted file mode 100644 index 7d83689..0000000 --- a/bookmarklet/bookmarklet_jsonp.min.js +++ /dev/null @@ -1 +0,0 @@ -var _____pshb_BookmarkletRun=function(){var post_id='pshb-bookmarklet-iframe';var post=null;var close=null;if(document.getElementById(post_id)==null){post=document.createElement('iframe');post.id=post_id;post.width='250';post.height='120';var s=post.style;s.position='absolute';s.top='10px';s.right='10px';s.padding='0';s.margin='0';s.border='5px solid #9c0';s.zIndex='1000000';close=document.createElement('a');close.href='javascript:window._____pshb_closeMe();';close.innerHTML='×';s=close.style;s.cursor='default';s.fontWeight='bold';s.fontSize='12px';s.position='absolute';s.top='15px';s.right='15px';s.margin='0';s.borderStyle='dotted';s.borderColor='#aaa;';s.borderWidth='0 0 1px 1px';s.padding='0 3px 0 3px';s.display='block';s.textDecoration='none';s.color='#000';s.zIndex='1000001';};var canonicalize=function(s){if(s==''||s==null){return'';};var temp=document.createElement('div');temp.innerHTML=s.toLowerCase();var result=temp.childNodes[0].nodeValue;temp.removeChild(temp.firstChild);return result;};window._____pshb_closeMe=function(){document.body.removeChild(close);document.body.removeChild(post);};var findAtomFeed=function(){var links=document.getElementsByTagName('link');for(var i=0;i0){return item.href;};};return null;};window._____pshb_sawLoad=false;window._____pshb_autoClose=true;window._____pshb_handleLoad=function(){if(!window._____pshb_sawLoad){window._____pshb_sawLoad=true;}else{window._____pshb_autoClose=false;};};var autoClose=function(){if(window._____pshb_autoClose){window._____pshb_closeMe();};};if(post!=null){var feed=findAtomFeed();var hub=_____pshb_getHub();post.onload=_____pshb_handleLoad;post.src='http://pubsubhubbub.appspot.com/bookmarklet.html'+'?feed='+feed+'&hub='+hub;document.body.appendChild(post);document.body.appendChild(close);setTimeout(autoClose,2000);};};_____pshb_BookmarkletRun(); \ No newline at end of file diff --git a/bookmarklet/generate_config.py b/bookmarklet/generate_config.py deleted file mode 100755 index c9163a2..0000000 --- a/bookmarklet/generate_config.py +++ /dev/null @@ -1,5 +0,0 @@ -#!/usr/bin/env python - -js = open('bookmarklet.min.js').read() -config = open('bookmarklet_config.template').read() -print config % {'bookmarklet_min_js': js} diff --git a/bookmarklet/jsmin.py b/bookmarklet/jsmin.py deleted file mode 100644 index 2339f7d..0000000 --- a/bookmarklet/jsmin.py +++ /dev/null @@ -1,218 +0,0 @@ -#!/usr/bin/python - -# This code is original from jsmin by Douglas Crockford, it was translated to -# Python by Baruch Even. The original code had the following copyright and -# license. -# -# /* jsmin.c -# 2007-05-22 -# -# Copyright (c) 2002 Douglas Crockford (www.crockford.com) -# -# Permission is hereby granted, free of charge, to any person obtaining a copy of -# this software and associated documentation files (the "Software"), to deal in -# the Software without restriction, including without limitation the rights to -# use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies -# of the Software, and to permit persons to whom the Software is furnished to do -# so, subject to the following conditions: -# -# The above copyright notice and this permission notice shall be included in all -# copies or substantial portions of the Software. -# -# The Software shall be used for Good, not Evil. -# -# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR -# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, -# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE -# AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER -# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, -# OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE -# SOFTWARE. -# */ - -from StringIO import StringIO - -def jsmin(js): - ins = StringIO(js) - outs = StringIO() - JavascriptMinify().minify(ins, outs) - str = outs.getvalue() - if len(str) > 0 and str[0] == '\n': - str = str[1:] - return str - -def isAlphanum(c): - """return true if the character is a letter, digit, underscore, - dollar sign, or non-ASCII character. - """ - return ((c >= 'a' and c <= 'z') or (c >= '0' and c <= '9') or - (c >= 'A' and c <= 'Z') or c == '_' or c == '$' or c == '\\' or (c is not None and ord(c) > 126)); - -class UnterminatedComment(Exception): - pass - -class UnterminatedStringLiteral(Exception): - pass - -class UnterminatedRegularExpression(Exception): - pass - -class JavascriptMinify(object): - - def _outA(self): - self.outstream.write(self.theA) - def _outB(self): - self.outstream.write(self.theB) - - def _get(self): - """return the next character from stdin. Watch out for lookahead. If - the character is a control character, translate it to a space or - linefeed. - """ - c = self.theLookahead - self.theLookahead = None - if c == None: - c = self.instream.read(1) - if c >= ' ' or c == '\n': - return c - if c == '': # EOF - return '\000' - if c == '\r': - return '\n' - return ' ' - - def _peek(self): - self.theLookahead = self._get() - return self.theLookahead - - def _next(self): - """get the next character, excluding comments. peek() is used to see - if an unescaped '/' is followed by a '/' or '*'. - """ - c = self._get() - if c == '/' and self.theA != '\\': - p = self._peek() - if p == '/': - c = self._get() - while c > '\n': - c = self._get() - return c - if p == '*': - c = self._get() - while 1: - c = self._get() - if c == '*': - if self._peek() == '/': - self._get() - return ' ' - if c == '\000': - raise UnterminatedComment() - - return c - - def _action(self, action): - """do something! What you do is determined by the argument: - 1 Output A. Copy B to A. Get the next B. - 2 Copy B to A. Get the next B. (Delete A). - 3 Get the next B. (Delete B). - action treats a string as a single character. Wow! - action recognizes a regular expression if it is preceded by ( or , or =. - """ - if action <= 1: - self._outA() - - if action <= 2: - self.theA = self.theB - if self.theA == "'" or self.theA == '"': - while 1: - self._outA() - self.theA = self._get() - if self.theA == self.theB: - break - if self.theA <= '\n': - raise UnterminatedStringLiteral() - if self.theA == '\\': - self._outA() - self.theA = self._get() - - - if action <= 3: - self.theB = self._next() - if self.theB == '/' and (self.theA == '(' or self.theA == ',' or - self.theA == '=' or self.theA == ':' or - self.theA == '[' or self.theA == '?' or - self.theA == '!' or self.theA == '&' or - self.theA == '|' or self.theA == ';' or - self.theA == '{' or self.theA == '}' or - self.theA == '\n'): - self._outA() - self._outB() - while 1: - self.theA = self._get() - if self.theA == '/': - break - elif self.theA == '\\': - self._outA() - self.theA = self._get() - elif self.theA <= '\n': - raise UnterminatedRegularExpression() - self._outA() - self.theB = self._next() - - - def _jsmin(self): - """Copy the input to the output, deleting the characters which are - insignificant to JavaScript. Comments will be removed. Tabs will be - replaced with spaces. Carriage returns will be replaced with linefeeds. - Most spaces and linefeeds will be removed. - """ - self.theA = '\n' - self._action(3) - - while self.theA != '\000': - if self.theA == ' ': - if isAlphanum(self.theB): - self._action(1) - else: - self._action(2) - elif self.theA == '\n': - if self.theB in ['{', '[', '(', '+', '-']: - self._action(1) - elif self.theB == ' ': - self._action(3) - else: - if isAlphanum(self.theB): - self._action(1) - else: - self._action(2) - else: - if self.theB == ' ': - if isAlphanum(self.theA): - self._action(1) - else: - self._action(3) - elif self.theB == '\n': - if self.theA in ['}', ']', ')', '+', '-', '"', '\'']: - self._action(1) - else: - if isAlphanum(self.theA): - self._action(1) - else: - self._action(3) - else: - self._action(1) - - def minify(self, instream, outstream): - self.instream = instream - self.outstream = outstream - self.theA = '\n' - self.theB = None - self.theLookahead = None - - self._jsmin() - self.instream.close() - -if __name__ == '__main__': - import sys - jsm = JavascriptMinify() - jsm.minify(sys.stdin, sys.stdout) diff --git a/design-doc.txt b/design-doc.txt deleted file mode 100644 index 74f9a3a..0000000 --- a/design-doc.txt +++ /dev/null @@ -1,593 +0,0 @@ -Note: -===== - -This document is old. Instead, see: - -http://pubsubhubbub.googlecode.com/svn/trunk/pubsubhubbub-core-0.1.html - - - - -============================================================================ ->> Overview -============================================================================ - -An open, simple web-scale pubsub protocol, along with an open source -reference implentation targetting Google App Engine. Notably, -however, nothing in the protocol is centralized, or Google- or App -Engine-specific. Anybody can play. - -As opposed to more developed (and more complex) pubsub specs like -XEP-0060, this spec's base profile (the barrier-to-entry to speak it) -is dead simple. The fancy bits required for high-volume publishers -and subscribers are optional. The base profile is HTTP-based, as -opposed to XMPP (see more on this below). - -To dramatically simplify the spec in several places where we had to -choose between supporting A or B, we took it upon ourselves to say -"only A", rather than making it an implementation decision. - -We offer this spec in hopes that it fills a need or at least advances -the state of the discussion in the pubsub space. Polling sucks. We -think a decentralized pubsub layer is a fundamental, missing layer in -the Internet architecture today and its existence, more than just -enabling the obvious lower latency feed readers, would enable many -cool applications, most of which we can't even imagine. But we're -looking forward to decentralized social networking. - - - -============================================================================ ->> Terminology -============================================================================ - -Topic: an Atom feed URL. The unit to which one can subscribe to - changes. RSS isn't supported for simplicity. Further, the spec - currently only addresses public (unauthenticated) Atom feed URLs. - -Pubsub Hub ("the hub"): the server (URL) which implements this protocol. - We're currently implementing this and running at server at - http://pubsubhubbub.appspot.com/ that's at least for now open for anybody - to use, as either a publisher or subscriber. Any hub is free to - implement its own policies on who can use it. - -Publisher: an owner of a topic. Notifies the pubsub hub when the topic - (Atom feed) has been updated. Just notifies that it _has_ been updated, - but not how. As in almost all pubsub systems, the publisher is unaware - of the subscribers, if any. - -Subscriber: an entity (person or program) that wants to be notified of - changed on a topic. Must be directly network-accessible, not being - a NAT. PubSubHubbub is a server-to-server protocol. If you're being - NAT, you're a client, out-of-scope for this protocol. (Browser channels, - long-polling a server would be more appropriate for you.) - -Subscription: a tuple (Topic URL, Subscriber). For network-accessible - subscribers, the subscription's unique key is actually the tuple - (Topic URL, Subscriber Callback URL). For NAT'd subscribers, - the unique key for a subscription is (Topic URL, SubscriberToken). - In both cases, subscriptions may (at the hub's decision) have expiration - times akin to DHCP leases and then must be renewed. - -Event: an event that's visible to multiple topics. For each event - that happens (e.g. "Brad posted to the Linux Community."), multiple - topics could be affected (e.g. "Brad posted." and "Linux community - has new post"). Publisher events update topics, and the hub looks - up all subscriptions for all affected topics, sending out - notifications to subscribers. - -Notification: a delta on a topic, computed by the hub and sent to all - subscribers. (TBD: format of this delta. likely: an Atom feed - itself with just the new or changed stuff, and gravestones for - removed items?) The notification can be the result of a publisher - telling the hub of an update, or the hub proactively polling a topic - feed, perhaps for a subscriber subscribing to a topic that's not - pubsub-aware. Note also that a notification to a subscriber can be - a payload consisting of updates for multiple topics. Publishers MAY - choose to send multi-topic notifications as an optimization for - heavy subscribers, but subscribers MUST understand them. - - - - - -============================================================================ ->> Notes: -============================================================================ - -* There is no relationship or hierarchy between topics. In the future - such an Atom extension could exist, but that's entirely out of this - spec, both now and then. Non-goal. If a publisher wants to offer - a hierarchy, they need to offer 'n' Atom feeds. - -* For HTTP callback subscribers, the add-subscription part of the - protocol requires that the hub verifies (via a pingback: "did you - really mean that?") before actually adding the subscription. This - is to prevent people from DoS'ing each other by subscribing victims - to many and/or high-volume publishers. - -* In same way openid was bootstrappable with a simple tag, should - be similar for publishers to delegate their pubsubhub with a simple - link tag. Example: - - -* Multi-protocol would be nice, but simple would probably win... HTTP - only at first. XMPP later. XMPP has a few advantages, but really - only authentication. A good HTTP implementation can do long polling, - pingbacks, etc. - -* Loops. Perhaps Atom child element (repeated) of all the Atom Entry - IDs that entry used to be or came from or is. Neat to see the - HTTP-like TRACE. (perhaps extension to Atom, not part of this spec) - (** Looked it up, and implies this, but it - only works if all of the feeds in the trace correctly supply a 'via' - tag. Then it's on the client to iteratively follow the trace). - - - -============================================================================ ->> High-level protocol flow: -============================================================================ - - - -* Publishers POST a ping to their hub(s) URLs when their topic(s) - change. - -* Subscribers POST to one or more of the advertised hubs for a topic they're interested in. Alternatively, some hubs may offer auto-polling capability, to let {their,any} subscribers subscribe to topics which don't advertise a hub. - -* The hub caches minimal metadata (id, data, entry digest) about each topic's previous state. When the hub refetches a topic feed (on its own initiative or as a result of a publisher's ping) and finds a delta, it enqueues a notification to all registered subscribers. Subscribers can be notified of topic deltas in a variety of ways: - - - - - - - In the base profile, subscribers must be directly network accessible (not behind a NAT), - running a listening webserver, and can receive an HTTP callback to notify them their topic - changed. To avoid authentication issues with HTTP, this - callback doesn't include any payload but rather just a note for - the subscriber to check the hub for the topic URL (which - presumably they trust, if they subscribed to it in the first - place). In the future, this HTTP callback could include a - signed (OAuth?) payload, avoiding the need for the extra HTTP - request in the other direction. In any high transaction - scenario, though, it's hoped that all parties (hub, publisher, - subscriber) would make proper use of HTTP Keep-Alive - connections, negating the ugliest part of the multiple HTTP - requests (new TCP connections: 3-way handshake, slow start, - ephemeral port exhaustion, etc). - - - Also in the base profile, but slightly lower priority for us - implementation-wise, is support for NAT'd subscribers unable - to run a publicly accessible listening webserver. Instead, - these subscribers need to connect to the hub to retrieve their - enqueued notifications. A smart hub implementation here would - support HTTP long-polling (aka "comet") so the client doesn't - need to make HTTP requests often to get low-latency updates. - (TODO/FUTURE: define recommendations for this long-polling behavior - on both client and server: ideally server just does it, hanging - after the GET, but then what's the recommendation for the client's - HTTP client timeout value, which might not be under their control? - Ignore that and document it? Separate URL for long polling? - Then subscriber caches hub's long-polling ability? Server includes - X- header to signal that it did or wants to do long polling?) - - - Fancier implementations may choose to use HTTP long polling - ("comet") or XMPP. We're punting on this for now in the - interest of getting something basic working for the common case. - - - -============================================================================ ->> Atom details -============================================================================ - -Notification and source formats will be Atom. More detail follows this example. - - - # ... source, title, etc ... - - - - 2008-08-11T02:15:01Z - - # Example of a full entry. - - Heathcliff - - http://publisher.com/happycat25.xml - 2008-08-11T02:15:01Z - - What a happy cat. Full content goes here. - - - - # Example of an entity that isn't full/is truncated. This is implied - # by the lack of a element and a element instead. - - Heathcliff - - http://publisher.com/happycat25.xml - 2008-08-11T02:15:01Z - - What a happy cat! - - - - # Meta-data only; implied by the lack of and elements. - - Garfield - - http://publisher.com/happycat25.xml - 2008-08-11T02:15:01Z - - - # Context entry that's meta-data only and not new. Implied because the - # update time on this entry is before the //atom:feed/updated time. - - Nermal - - http://publisher.com/happycat25.xml - 2008-07-10T12:28:13Z - - - - -Publisher makes the decision as to include full body, truncated body, -or meta data of most recent event(s). One of: - - URL + metadata - URL + metadata + truncated - URL + metadata + full - -The trade-off between including all content in outgoing notifications -or having the thundering herd (by clients who fetch the -//atom:feed/entry/link in response to a notification) is up to the -publisher. - -Entries of most recent 10 events (for recipient to know whether or not -they'd missed any recent items... like TCP SACK) will be provided as -context. This is implied by the difference between the -//atom:feed/updated field and the //atom:feed/entry/updated -fields. The //atom:feed/updated field will be set to the time of the -*oldest* in the list that is new. All items with - times before then are context; all with times equal to or -after are new. This also lets subscribers know how long it has been -from when the notification was first sent by the publisher to when -they actually received it from the hub. - -The //atom:feed/link[@rel="self"] element will indicate the original -URL for the entire event stream with no truncation (if available). - -The //atom:feed/link[@rel="hub.delegate"] element indicates the URL -that the hub should use for retrieving new notifications from a -publisher. The publisher can make this delegate URL contain a -meta-data only or truncated view of the feed. If a hub.delegate is not -provided, then the 'self' URL is used as both the source of -notifications and the source for the topic URL feed. - -Topic URLs must be unique, but multiple topics may use the same -hub.delegate. In this situation, the delegate URL may serve a -MIME multipart response, each part of which will contain a -separate Atom document for an individual topic. The hub -must understand this delegation. Once it has fetched the topic URL -once to see this delegation is present, it will use the delegation url -to pull the feed. This allows the publisher to be more efficient at -publishing across many topics at once with a single fetch from the -hub. - -TODO: How do you indicate to the hub that you no longer want to have a -delegate URL? - -Requirement is that topic URLs and delegate URLs can never overlap! - -More info on atom:link tag meanings here: - http://intertwingly.net/wiki/pie/LinkTagMeaning - -============================================================================ ->> Subscribing -============================================================================ - -There are multiple ways to subscribe, depending on the type and -needs of the subscriber. Roughly, the types are as follows: - - 1. Internet-accessible subscriber using HTTP callback - (new subscriptions need to be verified to prevent using - the hub to DoS others) - 1.1. verification synchronously - 1.2. verification asynchronously ("deferred") - 2. NAT'd subscribers or those without an HTTP server - (no verification necessary) - -Flow for subscription, using the following example URLs: - -http://subr.com/notify-callback.php -http://pubr.com/happycats.xml -http://hub.com/hubpoint - - 1. Subr does POST to /hubpoint with payload: - - & hub.mode=subscribe - & hub.callback = http://subr.com/notify-callback.php - & hub.topic = http://pubr.com/happycats.xml - (may be repeated for large subscriptions) - & hub.verify = async,sync - & hub.verify_token = [opaque] - - The hub.verify is an optional comma-separated list of the - subscribers ordered preferences and capabiliies, - verification-wise. One of: - - sync -- Subr only supports synchronous verification. - async -- Subr only supports async verification. - WARNING: it's not required that servers support - async, so this type of subscription may fail. - sync,async -- Subr prefers sync to async. - async,sync -- Subr prefers async to sync. - - The optional hub.verify_token is opaque to the hub and is simply - echoed back to the subscriber in the verification request. - Subscribers can put whatever they want in it: database primary - keys, encrypted data, etc... anything that makes processing the - hub.mode=subverify request easier. - - 2. Hub sends new request "oh do you want this topic?" to - /notify-callback.php with x-requester-ip: 1.2.3.4 (so DoSing - clients can be detected). - - POST /notify-callback.php - Host: subr.com - - hub.mode=subverify & - hub.topic=whatever - - NOTE: Maybe this should be a GET to the callback URL instead of a POST, since - it represents a steady state for the subscriber? We should probably be rigid - about the 204 here, if possible; otherwise it's really hard to differentiate - between a callback success and just pointing at a random good page on the - web that will return a 200 no matter what you throw at it. - - 3. Subr says, "yes, I really do want this topic": - - HTTP/1.1 204 No Content - - 4. Hub responds to Subr with "okay". Either 204 if the - subscription(s) were verified and created, or 202 if the - subscriptions were enqueued to be verified later. - -TODO: Somewhere in here we should require the subscriber to re-confirm their subscription after a certain amount of time. We need to convey to them what the expiration period of their subscription will be. - -If verification is being done asynchronously, steps 2 and 3 above are -skipped and Hub's 2xx response in step 4 is really just saying, -"Potential subscription enqueued for later verification." - -Publisher must provide synchronous capability at a minimum. - -Sub | Situation | Results - -SA - fetch succeed --> 204 (no content) -SA - fetch fail or server prefers async, async logged --> 202 (accepted): best effort. min 1 retry in the future only. -SA - fetch fail, async not supported --> 501 (not implemented) -AS - async supported --> 202 accepted. best effort. -AS - async not supported (or not preferred) + fetch success --> 204 no content. success! -AS - async not supported (or not preferred) + fetch failure --> 5xx -S - fetch succeed --> 204 (no content; success!) -S - fetch failed --> 5xx -A - server supports --> 202 (accepted) best effort later -A - server doesn't support --> 501 (not implemented) - -TODO: 5xx on fetch failure isn't clear enough. Maybe we should use 409 ("Conflict") to indicate when a synchronous subscription request tries to confirm and fails. Then it's clearly the requestor's fault and not a server error. - -In the case of temporary server error, the server should return 503. - -============================================================================- ->> Subscribe Protocol -============================================================================ - -POST -http://publisher.com/subpoint? - callback=http://subscriber.com/callback.php - topic=http://publisher.com/foo.xml - async={AS, SA, A, S} - mode=unsubscribe (optional: default is 'subscribe') - - Error cases: - * If callback is invalid: TODO - * If topic isn't handled by this pubsubhub: TODO - - Probably if it's an unknown topic, issue a 404 - * Async option is bogus (400 bad request) - -TODO: What about support for multi-part data for the subscriber? For -very simple subscribers, we probably don't even want to do multipart -form-data, because it's more complex to parse? Or is it a minimum -requirement that the post body will always be multipart? - -============================================================================ ->> Publishing -============================================================================ - -Overview: - - A publisher pings the hub with the URL(s) which have been updated - and the hub schedules them to be fetched & diffed. Because it's - just a ping to wake up the hub, no authentication from the publisher - is required. - -Protocol: - -POST -http://pubsubhubbub.com/hubpoint? - hub.mode=publish & - hub.url=http://publisher.com/topic1.xml & - hub.url=http://publisher.com/topic2.xml & - ... - - The 'url' field can be repeated for any combination of topic URL or - delegate URLs. The hub should deal properly with duplicate URLs. - - Error cases: - * Topic(s) known/accepted. -> 204 No content. - * Topic(s) unknown/unaccepted -> 4xx Bad Request / Forbidden. - -This will enqueue a feed-fetch for sometime in the future, followed by -pushing the new notifications of potential deltas to all subscribers. -The hub may decide to combine this publish notification with any -earlier publish notification that have not yet been pushed to -subscribers (this could happen if events are coming in faster than the -hub will allow). - -The hub's GET request of the Atom topic URL may include a Google -Reader Feed-fetcher style thing where there is a statistics header on -the request for the feed every time we pull it. Then the publisher -always knows how many subscribers are on the hub. Example: - - GET /foo.xml HTTP/1.1 - Host: publisher.com - X-Hub-Subscribers: 120 - - -============================================================================ ->> Receive Events -============================================================================ - -POST -http://subscriber.com/callback.php - -Post body will be the Atom notification feed described above. The hub will -keep track of the last N known elements for the topic, and send -updates only for the newest elements (along with N entries for -context). - -The subscriber will know the topic URL by looking at the -//atom:feed/link[@rel="self"] value? Or maybe we'll make it rel="source" for -the notifications? - -The subscriber should return 200 or 204 on successful acceptance of -the event. 4xx and 5xx responses will be considered errors (and -delivery will be attempted again later). TODO: What should we do with -3xx responses? - -=========================================================================== ->> Meeting notes from 2008-09-16: -=========================================================================== - -Priorities: - - ignore for now NAT'ed token polling (requires https anyway) - - ignore for now XMPP (requires XMPP anyway) - - ignore for now huge subscribers: - - multi-topic notifications - - long-lived connections, - - one HTTP in-flight at a time, - - ignore for now huge publishers: - - publishing tons of updated URLs at a time (e.g. Blogger) - - ignore for now (until v2) all authentication issues: - - no pushing payloads to subscribers. send them notification - to poll us instead. perhaps with token. - - ignore for now private Atom URLs/topics. public topics for now. - OAuth or something later. - -Keep atomid of all feed entries we've seen on an Atom URL in the past. -(or just the immediate past one perhaps? or 'n' days of them?). keep -(atomid, date, digest) - -Lexicon: - topicid: an Atom URL - topicdeltaid: a diff of two Atom URLs (t1 and t2). - -POST /pubber/?topic_url=http://lolcats/lolcatz.xml - SELECT subberid FROM subbers WHERE topicid=? LIMIT 1 - ("does anybody give a shit?") - If no, - return "Thanks bye! 200 OK!" (optionally tell google - crawlers, based on publisher's preference. TODO: put this - in spec somehow. perhaps reuse the term "noindex"?) - If yes, - enqueue a poll-this-url-later record. one insert. bounded - latency. return 200 OK - -Cron: -GET /do-some-work/fetch-updated-feeds-and-find-deltas - pull feed, - compute digests. find ids, dates. compute deltas from our copy of that thing's previous value. - INSERT INTO topicdeltapayloads - SET topicdeltaid="yyyymmhhddmss.mmss:topicid", - payload=..., topicid=.... - INSERT INTO topics_what_are_new_but_people_need_to_be_notified - SET topicdeltaid=?, subid-where-i-left-off="" - - -GET /do-some-work/send-notifications - SELECT topiciddeltaid, subid-where-i-left-off FROM topics_what_are_new_but_people_need_to_be_notified LIMIT 500 - RANDOMIZE LIST - Foreach topicid: - try-to-get-lock { - SELECT the topicdeltaid payload - SELECT subscribers WHERE topicid = ? AND subid > subid-where-i-left-off - BATCH urlfetch POST to them all, - scatter-gather errors. - - For those that fail from the 100-some batch, create - to-do-later (notification) records. increase subid if the - selected count == the previous limit, - else DELETE FROM - topics_where_people_need_to_be_notified WHERE - topiciddeltaid = ? - - } // end lock - -XMPP: - -* in the future, if/when App Engine supports it. but it's a special - thingy. HTTP is base and required. XMPP support for pubbers and - subbers is optional. - -Polling mode for subscribers: - -* a) callbacks won't always work (subscribers behind NATs, etc) -* b) callbacks won't always fit all subscriber's model (not easy for them) -* so must have poll mode. -* in the future: can be long-poll, when App Engine supports it. maybe. -* needs auth -* 1MB payload on responses, so server needs ability to paginate and set "but there's more!" flag w/ continuation token. - -The hub notifies all subbers: POST /callback/url/ "yo, something's new for you. don't trust me. fetch: http://pubsubhubbub.appspost.com/poll-for-new-shit/?subid=234&token=23482903482340923849023840923i4" - -Large subscribers: (may be v2) - -* one in-flight HTTP POST to subscribers at a time. use memcacheg 10 second or so lock. -* if another POST is attempted while another is already in flight, enqueue/append the payloadid to a new - table, contentious_or_big_subscriber. still mark that (topicdeltaid, subid) pair as done for the purposes of - /do-some-work/sent-notifications -* new do-some-work: - /do-some-work/sent-notifications-to-big-peeps -* optional property on subscriptions for big subscribers to say, "Yo, it's okay to mix my subscriptions together - in one HTTP payload post." in which case it's atom-stream.xml style (updates.sixapart.com) and the payloads are mixed: - - -Misc notes: ----------------- -* can subscribe to anything, regardless of whether or not there are any publishers. -* server's choice whether or not to actually poll proactively for changes vs. getting notified. - - -Discovery: --------------- -in Atom.xml: - - (repeated. client should pick one) - -in /index.html - - - -then bookmarklet to ping the publish URL. - -=========================================================================== - end meeting notes from 2009-09-16 -=========================================================================== - -=== Open issues... === - -Is there an existing standard for aggregators to specify how many readers they're requesting on behalf of? - - diff --git a/hub/all_stats.html b/hub/all_stats.html deleted file mode 100644 index d7e3403..0000000 --- a/hub/all_stats.html +++ /dev/null @@ -1,65 +0,0 @@ - - - Hub - Statistics - - - - - -
- -
- -

Table of contents

- - -

Fetch stats

-

Per-URL error rate

-{% for result in fetch_url_error %} - {% include "stats_table.html" %} -{% endfor %} - -

Per-URL latency

-{% for result in fetch_url_latency %} - {% include "stats_table.html" %} -{% endfor %} - -

Per-domain error rate

-{% for result in fetch_domain_error %} - {% include "stats_table.html" %} -{% endfor %} - -

Per-domain latency

-{% for result in fetch_domain_latency %} - {% include "stats_table.html" %} -{% endfor %} - - -

Delivery stats

-

Per-URL error rate

-{% for result in delivery_url_error %} - {% include "stats_table.html" %} -{% endfor %} - -

Per-URL latency

-{% for result in delivery_url_latency %} - {% include "stats_table.html" %} -{% endfor %} - -

Per-domain error rate

-{% for result in delivery_domain_error %} - {% include "stats_table.html" %} -{% endfor %} - -

Per-domain latency

-{% for result in delivery_domain_latency %} - {% include "stats_table.html" %} -{% endfor %} - - - - diff --git a/hub/app.yaml b/hub/app.yaml deleted file mode 100644 index fd655af..0000000 --- a/hub/app.yaml +++ /dev/null @@ -1,62 +0,0 @@ -application: pubsubhubbub -version: 1 -runtime: python -api_version: 1 - -skip_files: -- ^(.*/)?app\.yaml -- ^(.*/)?app\.yml -- ^(.*/)?index\.yaml -- ^(.*/)?index\.yml -- ^(.*/)?#.*# -- ^(.*/)?.*~ -- ^(.*/)?.*\.py[co].* -- ^(.*/)?.*/RCS/.* -- ^(.*/)?\..* -- ^(.*/)?(main_test|remote_shell|testutil|urlfetch_test_stub|feed_diff_test)\.py -- ^(.*/)?feed_diff_testdata - -handlers: -- url: /base\.css - static_files: base.css - upload: base\.css - secure: optional - -- url: /favicon\.ico - static_files: favicon.ico - upload: favicon\.ico - secure: optional - -# Admin tools -- url: /remote_api - script: $PYTHON_LIB/google/appengine/ext/remote_api/handler.py - login: admin - secure: optional - -- url: /admin(/.*)? - script: $PYTHON_LIB/google/appengine/ext/admin - login: admin - -- url: /stats - script: main.py - login: admin - -- url: /mapreduce(/.*)? - script: mapreduce/main.py - login: admin - -# Optional bookmarklet creation gadget. -- url: /bookmarklet(_jsonp\.min\.js|\.min\.js|\.html|_config\.html|_gadget\.xml) - static_files: bookmarklet/bookmarklet\1 - upload: bookmarklet/.+\.(min\.js|html|xml) - secure: optional - -# Always require the subscriber details form to be securely accessed. -- url: /subscription-details - script: main.py - secure: always - -# Everything else -- url: .* - script: main.py - secure: optional diff --git a/hub/async_apiproxy.py b/hub/async_apiproxy.py deleted file mode 100644 index 478dae4..0000000 --- a/hub/async_apiproxy.py +++ /dev/null @@ -1,133 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2008 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""APIProxy-like object that enables asynchronous API calls.""" - -import collections -import logging -import sys - -from google.appengine.api import apiproxy_stub_map -from google.appengine.runtime import apiproxy -from google.appengine.runtime import apiproxy_errors -from google3.apphosting.runtime import _apphosting_runtime___python__apiproxy - - -class DevAppServerRPC(apiproxy.RPC): - """RPC-like object for use in the dev_appserver environment.""" - - def MakeCall(self): - pass - - def Wait(self): - pass - - def CheckSuccess(self): - apiproxy_stub_map.MakeSyncCall(self.package, self.call, - self.request, self.response) - self.callback() - - -if hasattr(_apphosting_runtime___python__apiproxy, 'MakeCall'): - AsyncRPC = apiproxy.RPC - logging.debug('Using apiproxy.RPC') -else: - logging.debug('Using DevAppServerRPC') - AsyncRPC = DevAppServerRPC - - -class AsyncAPIProxy(object): - """Proxy for asynchronous API calls.""" - - def __init__(self): - # TODO: Randomize this queue in the dev_appserver to simulate a real - # asynchronous queue and better catch any funny race-conditions or - # unclear event ordering dependencies. - self.enqueued = collections.deque() - self.complete = collections.deque() - - def start_call(self, package, call, pbrequest, pbresponse, user_callback, - deadline=None): - """user_callback is a callback that takes (response, exception)""" - if not callable(user_callback): - raise TypeError('%r not callable' % user_callback) - - # Do not actually supply the callback to the async call function because - # when it runs it could interfere with global state (like Datastore - # transactions). The callback will be run from the wait_one() function. - done_callback = lambda: user_callback(pbresponse, None) - rpc = AsyncRPC(package, call, pbrequest, pbresponse, - lambda: self.end_call(done_callback), - deadline=deadline) - setattr(rpc, 'user_callback', user_callback) - setattr(rpc, 'pbresponse', pbresponse) - - self.enqueued.append(rpc) - show_request = '...' - if rpc.package == 'urlfetch': - show_request = pbrequest.url() - logging.debug('Making call for RPC(%s, %s, %s, ..)', - rpc.package, rpc.call, show_request) - rpc.MakeCall() - - def end_call(self, rpc): - """An outstanding RPC has completed, enqueue its callback for execution.""" - self.complete.append(rpc) - - def rpcs_outstanding(self): - """Returns the number of asynchronous RPCs pending in this proxy.""" - return len(self.enqueued) - - def _wait_one(self): - """Wait for a single RPC to finish.""" - if not self.enqueued: - return - rpc = self.enqueued.popleft() - logging.debug('Waiting for RPC(%s, %s, .., ..)', rpc.package, rpc.call) - rpc.Wait() - try: - rpc.CheckSuccess() - except (apiproxy_errors.Error, apiproxy_errors.ApplicationError), e: - rpc.user_callback(None, e) - - def _run_callbacks(self): - """Runs a single RPC's success callback. - - Callbacks are run in a loop like this from the wait() callstack to avoid - race conditions from the APIProxy. Any API call can cause asynchronous - callbacks to fire before the main thread goes to sleep, which means a - user callback could run *before* a Commit() call finishes; this causes - really bad situations when the user callback also does some API calls. To - handle this properly, all callbacks will just go onto the completion - queue, and then run at the top of the stack here after at least one RPC - waiting period has finished. - """ - while True: - try: - callback = self.complete.popleft() - except IndexError: - return - else: - callback() - - def wait(self): - """Wait for RPCs to finish. Returns True if any were processed.""" - while self.enqueued or self.complete: - # Run the callbacks before even waiting, because a response could have - # come back during any outbound API call. - self._run_callbacks() - self._wait_one() diff --git a/hub/base.css b/hub/base.css deleted file mode 100644 index 9813cd9..0000000 --- a/hub/base.css +++ /dev/null @@ -1,31 +0,0 @@ -body, input, select, table { - font-family: "Trebuchet MS", "Helvetica", sans-serif; - font-size: 14px; -} -label { display: block; } -input[type="text"] { - width: 400px; -} -hr { margin-top: 1em; } -em { font-size: 0.8em; } -h3 { margin-bottom: 0.2em } -.stats-table > table { - width: 100%; - border-color: #000; - border-width: 0 0 1px 1px; - border-style: solid; - border-spacing: 0; - border-collapse: collapse; -} -.stats-table > table td, -.stats-table > table th { - border-color: #000; - border-width: 1px 1px 0 0; - border-style: solid; - margin: 0; - padding: 3px; - background-color: #E0ECF8; -} -.stats-table > .summary > span { - margin-right: 0.5em; -} \ No newline at end of file diff --git a/hub/bookmarklet b/hub/bookmarklet deleted file mode 120000 index bd18264..0000000 --- a/hub/bookmarklet +++ /dev/null @@ -1 +0,0 @@ -../bookmarklet \ No newline at end of file diff --git a/hub/cron.yaml b/hub/cron.yaml deleted file mode 100644 index d573068..0000000 --- a/hub/cron.yaml +++ /dev/null @@ -1,12 +0,0 @@ -cron: -- description: Bootstrap polling - url: /work/poll_bootstrap - schedule: every 5 minutes - -- description: Subscription cleanup - url: /work/subscription_cleanup - schedule: every 1 minutes - -- description: Subscription reconfirmation - url: /work/reconfirm_subscriptions - schedule: every 3 hours diff --git a/hub/dos.py b/hub/dos.py deleted file mode 100644 index f9f526d..0000000 --- a/hub/dos.py +++ /dev/null @@ -1,1055 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Decorators and utilities for attack protection and statistics gathering.""" - -import gc -import logging -import os -import random -import re -import struct -import time - -from google.appengine.api import memcache - - -# Set to true in tests to disable DoS protection. -DISABLE_FOR_TESTING = False - - -class ConfigError(Exception): - """Something is wrong with a configured DoS limit, sampler, or scorer.""" - -################################################################################ - - -_DEFAULT_MESSAGE = ( - 'Too many requests for "%(key)s"; ' - 'current rate is %(rate).3f/s, ' - 'limit is %(limit).3f/s') - - -def limit(param=None, - header='REMOTE_ADDR', - count=None, - period=None, - error_code=503, - retry_after=120, - message=_DEFAULT_MESSAGE, - param_whitelist=None, - header_whitelist=None): - """Limits a webapp.RequestHandler method to a specific rate. - - Either 'param', 'header', or both 'param' and 'header' must be specified. If - values cannot be found for either of these, the request will be allowed to - go through. Unlike the limiting constraints, if whitelists are supplied, then - *any* match of either whitelist will cause the dos limit to be skipped. - - Args: - func: The RequestHandler method to decorate with the rate limit. - param: A request parameter to use for rate limiting. If None, no parameters - will be used. - header: Header to use for rate limiting. If None, no header value will be - used. This header name must be in the CGI environment variable format, - e.g., HTTP_X_FORWARDED_FOR. - count: Maximum number of executions of this function to allow. - period: Period over which the 'count' executions should be allowed, - specified in seconds. Must be less than a month in length. - error_code: Error code to return when the rate limit has been exceeded. - Defaults to 503. - retry_after: Number of seconds to return for the 'Retry-After' header when - an error is served. If None, no header will be returned. - message: Error message to serve in the body of an error response. May have - formatting parameters 'key', 'rate', and 'limit'. - param_whitelist: If not None, a set of values of 'param' that are allowed - to pass the dos limit without throttling. - header_whitelist: If not None, a set of values of 'header' that are allowed - to pass the dos limit without throttling. - - Returns: - The decorated method. - - Raises: - ConfigError at decoration time if any rate limit parameters are invalid. - """ - if not (param or header): - raise ConfigError('Must specify "param" and/or "header" keywords') - if count is None or count < 0: - raise ConfigError('Must specify count >= 0') - if period is None or period < 1: - raise ConfigError('Must specify period >= 1') - - limit = float(count) / period - required_parts = 2 # two becuase path and method name are always in the key - if param: - required_parts += 1 - if header: - required_parts += 1 - if param_whitelist is None: - param_whitelist = frozenset([]) - if header_whitelist is None: - header_whitelist = frozenset([]) - - def wrapper(func): - if func.func_name not in ('post', 'get') and param: - raise ConfigError('May only specify param limit for GET and POST') - def decorated(myself, *args, **kwargs): - method = myself.request.method - parts = [method, myself.request.path] - whitelisted = False - - if DISABLE_FOR_TESTING: - return func(myself, *args, **kwargs) - - if param: - value = myself.request.get(param) - if value: - parts.append('%s=%s' % (param, value)) - if value in param_whitelist: - whitelisted = True - if header: - value = os.environ.get(header) - if value: - parts.append('%s=%s' % (header, value)) - if value in header_whitelist: - whitelisted = True - - key = ' '.join(parts) - result = None - if len(parts) != required_parts: - logging.critical('Incomplete rate-limit key = "%s" for param = "%s", ' - 'header = "%s" on "%s" where count = %s, period = %s, ' - 'limit = %.3f/sec', key, param, header, method, - count, period, limit) - else: - result = memcache.incr(key) - if result is None: - # Rate limit not yet in memcache. - result = 1 - if not memcache.add(key, result, time=period): - # Possible race for who adds to the cache first. - result = memcache.incr(key) - if result is None: - # Memcache definitely down. - skip_enforcement = True - logging.error('Memcache failed for rate limit on "%s" by "%s" ' - 'where count = %s, period = %s, limit = %.3f/s', - method, key, count, period, limit) - - if not whitelisted and result > count: - rate = float(result) / period - if (result - count) == 1: - log_level = logging.error - else: - log_level = logging.debug - log_level('Hit rate limit on "%s" by "%s" where ' - 'count = %s, period = %s, rate = %.3f/s, limit = %.3f/s', - method, key, count, period, rate, limit) - myself.response.set_status(error_code) - myself.response.headers['Content-Type'] = 'text/plain' - if retry_after is not None: - myself.response.headers['Retry-After'] = str(retry_after) - values = {'key': key, 'rate': rate, 'limit': limit} - myself.response.out.write(message % values) - else: - return func(myself, *args, **kwargs) - - decorated.func_name = func.func_name # Fun with hacking the Python stack! - return decorated - - return wrapper - -################################################################################ - -# TODO: Determine if URL/domain caching is necessary due to regex performance. - -# TODO: Add ane exception list of domains that should use the full domain, -# not just the last suffix, when going through the get_url_domain. This is -# needed for domains like 'appspot.com' that are shared across totally -# different developers. - -# Matches four groups: -# 1) an IP, 2) a domain prefix, 3) a domain suffix, 4) other (eg, localhost) -URL_DOMAIN_RE = re.compile( - r'https?://(?:' - r'([0-9]+\.[0-9]+\.[0-9]+\.[0-9]+)|' # IP address - r'(?:((?:[a-zA-Z0-9-]+\.)*)([a-zA-Z0-9-]+\.[a-zA-Z0-9-]+))|' # Domain - r'([^/]+)' # Anyting else - r')(?:/.*)?') # The rest of the URL - -# Domains where only the suffix is important. -DOMAIN_SUFFIX_EXCEPTIONS = frozenset([ - 'blogspot.com', - 'livejournal.com', -]) - -# Maximum size of the cache of URLs to domains. -DOMAIN_CACHE_SIZE = 100 - -# Simple local cache used for per-request URL to domain mappings. -_DOMAIN_CACHE = {} - - -def get_url_domain(url): - """Returns the domain for a URL or 'bad_url if it's not a valid URL.""" - result = _DOMAIN_CACHE.get(url) - if result is not None: - return result - if len(_DOMAIN_CACHE) >= DOMAIN_CACHE_SIZE: - _DOMAIN_CACHE.clear() - - match = URL_DOMAIN_RE.match(url) - if match: - groups = list(match.groups()) - if groups[1] and groups[2] and groups[2] not in DOMAIN_SUFFIX_EXCEPTIONS: - groups[2] = groups[1] + groups[2] - groups[1] = None - groups = filter(bool, groups) - else: - groups = [] - result = (groups + ['bad_url'])[0] - - _DOMAIN_CACHE[url] = result - return result - -################################################################################ - -def offset_or_add(offsets, - period, - prefix='', - offset_multi=memcache.offset_multi, - add_multi=memcache.add_multi): - """Offsets values in memcache or re-adds them if not present. - - This method is required when you want to offset memcache values *and* set - their expiration time to a distinct time in the future. - - Args: - offsets: Dictionary mapping keys to offset integers. - period: Time in seconds before these keys should expire. - prefix: Any memcache prefix to use for these keys. - offset_multi: Used for testing. - add_multi: Used for testing. - - Returns: - Dictionary mapping input keys to updated values. None will be returned - for keys that could not be updated. - """ - results = offset_multi(offsets, key_prefix=prefix) - - # Add any non-existent items. - adds = {} - for key, value in results.iteritems(): - if value is None: - adds[key] = offsets[key] - if adds: - failed = set(add_multi(adds, time=period, key_prefix=prefix)) - for key, value in adds.iteritems(): - if key not in failed: - results[key] = value - else: - failed = set() - - # If the add fails, then someone else won the race, so increment. - second_offsets = dict((k, offsets[k]) for k in failed) - if second_offsets: - second_results = offset_multi(second_offsets, key_prefix=prefix) - else: - second_results = {} - - failed_keys = set(k for k, v in second_results.iteritems() if v is None) - if failed_keys: - logging.warning('Failed memcache offset_or_add for prefix=%r, keys=%r', - prefix, failed_keys) - - results.update(second_results) - return results - -################################################################################ - -# TODO: Support more than 1MB of sample data by using multiple memcache calls -# to retrieve all of the sample values. - -# TODO: Support configs that *always* sample particular URLs or domains. -# Could have a console insert a list of values into memcache which is fetched -# and cached in each runtime, and then those domains would always match. - -# TODO: Allow for synchronized reservoirs that reset at synchronized intervals. -# This will let us view overlapping windows of samples across a time period -# instead of having to reset every N seconds. - -class ReservoirConfig(object): - """Configuration for a reservoir sampler.""" - - def __init__(self, - name, - period=None, - samples=None, - by_domain=False, - by_url=False, - rate=1, - max_value_length=75, - tolerance=10, - title=None, - key_name='Key', - value_units=''): - """Initializer. - - Args: - name: Programmatic name to use for this reservoir in memcache. - period: Time period for this reservoir in seconds. - samples: Total number of samples to use in the reservoir. - by_domain: True if URL domains should be used as the sampling key. - by_url: True if the whole URL should be used as the sampling key. - rate: Sampling rate (between 0 and 1) to reduce the latency overhead of - applying this sampler. - max_value_length: Length to truncate a sampling key to before storing - it in memcache. - tolerance: Number of seconds to allow for samples to stay valid for - after a reservoir reset has happened. - title: Nice-looking title of this config; will use the name if - not supplied. - key_name: The noun of the key (e.g., 'domain' or 'url'). - value_units: The noun of the value units (e.g., 'milliseconds'). - """ - if not name: - raise ConfigError('Must specify a name') - - try: - period = int(period) - except ValueError, e: - raise ConfigError('Invalid period: %s' % e) - if period <= 0: - raise ConfigError('period must be positive') - - try: - samples = int(samples) - except ValueError, e: - raise ConfigError('Invalid samples: %s' % e) - if samples <= 0: - raise ConfigError('samples must be positive') - - if not (by_domain ^ by_url): - raise ConfigError('Must specify by_domain or by_url') - - try: - rate = float(rate) - except ValueError, e: - raise ConfigError('Invalid rate: %s' % e) - if not (0 <= rate <= 1): - raise ConfigError('rate must be between 0 and 1') - - try: - tolerance = int(tolerance) - except ValueError, e: - raise ConfigError('Invalid tolerance: %s' % e) - if tolerance < 0: - raise ConfigError('tolerance must be non-negative') - - self.name = name - self.title = title or name - self.key_name = key_name - self.value_units = value_units - self.samples = samples - self.rate = rate - self.period = period - self.inverse_rate = 1.0 / self.rate - self.by_url = by_url - self.by_domain = by_domain - self.max_value_length = max_value_length - self.tolerance = tolerance - - if by_url: - self.kind = 'by_url' - else: - self.kind = 'by_domain' - self.counter_key = '%s:%s:counter' % (self.name, self.kind) - self.start_key = '%s:%s:start_time' % (self.name, self.kind) - self._position_key_template = '%s:%s:%%d' % (self.name, self.kind) - - def position_key(self, index): - """Generates the position key for the sample slot with the given index. - - Args: - index: Numerical index of the sample position who's key to retrieve. - - Returns: - Memcache key to use. - """ - return self._position_key_template % index - - def is_expired(self, last_time, current_time): - """Checks if this config is expired. - - Args: - last_time: UNIX timestamp when this config's period started. - current_time: UNIX timestamp of the current time. - - Returns: - True if the config period has expired. - """ - return (current_time - last_time) > self.period - - def adjust_value(self, key): - """Adjust the value for a sampling key. - - Args: - key: The sampling key to adjust. - - Returns: - The adjusted key. - """ - if self.by_url: - value = key - else: - value = get_url_domain(key) - if len(value) > self.max_value_length: - value = value[:self.max_value_length] - if isinstance(value, unicode): - value = unicode(value).encode('utf-8') - return value - - def should_sample(self, key, coin_flip): - """Checks if the key should be sampled. - - Args: - key: The sampling key to check. - coin_flip: Random value between 0 and 1. - - Return: - True if the sample should be taken, False otherwise. - """ - return coin_flip < self.rate - - def compute_frequency(self, count, found, total, elapsed): - """Computes the frequency of a sample. - - Args: - count: Total number of samples of this key. - found: Total number of samples present for all keys. - total: The total number of sampling events so far, regardless of - whether or not the sample was saved. - elapsed: Seconds elapsed during the current sampling period. - - Returns: - The frequency, in events per second, of this key in the time period, - or None if no samples have been taken yet. - """ - if not total or not found: - return None - return self.inverse_rate * (1.0 * count / found) * (1.0 * total / elapsed) - - -class Reporter(object): - """Contains a batch of keys and values for potential sampling.""" - - def __init__(self): - """Initializer.""" - # Keep a list of input keys in order so we can iterate through the - # dictionary in order during testing. This costs little and vastly - # simplifies testing. - self.keys = [] - # Maps key -> {config -> value} - self.param_dict = {} - # Maps config -> [key, ...] - self.config_dict = {} - - def set(self, key, config, value=1): - """Sets a key/value for a specific config. - - Each config/key combination may only have a single value. Subsequent - calls to this method with the same key/config will overwrite the - previous value. - - Args: - key: The sampling key to add. - config: The ReservoirConfig object to set the value for. - value: The value to set for this config. - """ - value_dict = self.param_dict.get(key) - if value_dict is None: - self.param_dict[key] = value_dict = {} - value_dict[config] = value - self.keys.append(key) - - present_list = self.config_dict.get(config) - if present_list is None: - self.config_dict[config] = present_list = [] - present_list.append(key) - - def get(self, key, config): - """Gets the value for a key/config. - - Args: - key: The sampling key to retrieve the value for. - config: The ReservoirConfig object to get the value for. - - Returns: - The value for the key/config or None if it's not present. - """ - return self.param_dict.get(key, {}).get(config) - - def remove(self, key, config): - """Removes a key/value for a specific config. - - If the key is not present for the config, this method does nothing. - - Args: - key: The sampling key to remove. - config: The ReservoirConfig object to remove the key for. - """ - try: - del self.param_dict[key][config] - self.config_dict[config].remove(key) - except KeyError: - pass - - def all_keys(self): - """Returns all the sampling keys present across all configs. - - Each key will be present at least once, but some keys may be present - more than once if they were inserted repeatedly. The keys are in - insertion order. This simplifies testing of this class. - """ - return self.keys - - def get_keys(self, config): - """Retrieves the keys present for a specific ReservoirConfig. - - Args: - config: The ReservoirConfig object to get the keys for. - - Returns: - The list of keys present for this config, with no duplicates. - """ - return self.config_dict.get(config, []) - - -class SampleResult(object): - """Contains the current results of a sampler for a given config.""" - - def __init__(self, config, total_samples, time_elapsed): - """Initializer. - - Args: - config: The ReservoirConfig these results are for. - total_samples: The total number of sampling events that have occurred. - This is *not* the number of unique samples present in the table. - time_elapsed: Time in seconds that have elapsed in the current period. - """ - self.config = config - self.total_samples = total_samples - self.time_elapsed = time_elapsed - self.unique_samples = 0 - self.title = config.title - self.key_name = config.key_name - self.value_units = config.value_units - - # Maps key -> [(when, value), ...] - self.sample_dict = {} - - def add(self, key, when, value): - """Adds a new sample to these results. - - Args: - key: The sampling key. - when: When the sample was made, as a UNIX timestamp. - value: The value that was sampled. - """ - samples = self.sample_dict.get(key) - if samples is None: - self.sample_dict[key] = samples = [] - samples.append((when, value)) - self.unique_samples += 1 - - def overall_rate(self): - """Gets the overall rate of events. - - Returns: - Total events per second. - """ - return 1.0 * self.total_samples / self.time_elapsed - - def get_min(self, key): - """Gets the min value seen for a key. - - Args: - key: The sampling key. - - Returns: - The minimum value or None if this key does not exist. - """ - samples = self.sample_dict.get(key) - if samples is None: - return None - return min(samples, key=lambda x: x[1])[1] - - def get_max(self, key): - """Gets the max value seen for a key. - - Args: - key: The sampling key. - - Returns: - The maximum value or None if this key does not exist. - """ - samples = self.sample_dict.get(key) - if samples is None: - return None - return max(samples, key=lambda x: x[1])[1] - - def get_frequency(self, key): - """Gets the frequency of events for this key during the sampling period. - - Args: - key: The sampling key. - - Returns: - The frequency as events per second or None if this key does not exist. - """ - samples = self.sample_dict.get(key) - if samples is None: - return None - return self.config.compute_frequency( - len(samples), - self.unique_samples, - self.total_samples, - self.time_elapsed) - - def get_average(self, key): - """Gets the weighted average of this key's sampled values. - - Args: - key: The sampling key. - - Returns: - The weighted average or None if this key does not exist. - """ - samples = self.sample_dict.get(key) - if not samples: - return None - total = 0.0 - for sample in samples: - total += sample[1] - return total / len(samples) - - def get_count(self, key): - """Gets the count of unique samples for a key. - - Args: - key: The sampling key. - - Returns: - The number of items. Will be zero if the key does not exist. - """ - return len(self.sample_dict.get(key, [])) - - def get_samples(self, key): - """Gets the unique sample data for a key. - - Args: - key: The sampling key. - - Returns: - List of tuple (when, value) where: - when: The UNIX timestamp for the sample. - value: The sample value. - """ - return self.sample_dict.get(key, []) - - def set_single_sample(self, key): - """Sets that this result is for a single key. - - Args: - key: The sampling key. - """ - self.total_samples = self.get_count(key) - - def sample_objects(self): - """Gets the contents of this result object for use in template rendering. - - Returns: - Generator of model objects. - """ - for key in self.sample_dict: - yield { - 'key': key, - 'count': self.get_count(key), - 'frequency': self.get_frequency(key), - 'min': self.get_min(key), - 'max': self.get_max(key), - 'average': self.get_average(key), - } - - -class MultiSampler(object): - """Sampler that saves key/value pairs for multiple reservoirs in parallel. - - The basic algorithm is: - - 1. Get the reservoir start timestamp. - 2. If more than period seconds have elapsed, set the timestamp to now, set - the reservoir's event counter to zero (average case this is skipped). - 3. Increment the event counter by the number of new samples. - 4. Set memcache values to incoming samples following the reservoir - algorithm, potentially only sampling a subset. - - The benefit of this approach is it can be applied to many reservoirs in - parallel without incurring additional API calls. The only limit is the 1MB - limit on App Engine API calls, which puts a cap on the amount of samples - that can be made simultaneously. - - Samples are stored in keys like: 'sampler_name:0', 'sampler_name:1' - - Values stored for samples look like: 'key_sample:NNNN:WWWW' where the 'N's - represent the sample value as a big-endian-encoded 4-byte string, and the - 'W's are a UNIX timestamp as a big-endian-encoded 4-byte string. The - timestamp is used to ignore samples that are not from the current period. - - There can be a race for resetting the timestamp for a sampler right after - the period starts, but it always favors the caller who inserted last (all - earlier data will be overwritten). This results in some missing data for - short-period samplers, but it's okay. - """ - - def __init__(self, configs, gettime=time.time): - """Initializer. - - Args: - configs: Iterable of ReservoirConfig objects. - gettime: Used for testing. - """ - self.configs = list(configs) - self.gettime = gettime - - def sample(self, - reporter, - getrandom=random.random, - randrange=random.randrange): - """Samples a set of reported key/values. - - Args: - reporter: Reporter instance containing key/values to sample. - getrandom: Used for testing. - randrange: Used for testing. - """ - # Update period start times if they're expired or non-existent. - now = int(self.gettime()) - start_times = memcache.get_multi([c.start_key for c in self.configs]) - config_sets = {} - for config in self.configs: - start = start_times.get(config.start_key) - if start is None or config.is_expired(start, now): - config_sets[config.start_key] = now - config_sets[config.counter_key] = 0 - if config_sets: - memcache.set_multi(config_sets) - - # Flip coin for sample rate of all Keys on all configs. - for key in reporter.all_keys(): - coin_flip = getrandom() - for config in self.configs: - if not config.should_sample(key, coin_flip): - reporter.remove(key, config) - - # Increment counters for affected configs. - counter_offsets = {} - for config in self.configs: - matching = reporter.get_keys(config) - if matching: - counter_offsets[config.counter_key] = len(matching) - if not counter_offsets: - return - counter_results = memcache.offset_multi(counter_offsets, initial_value=0) - - # Apply the reservoir algorithm. - value_sets = {} - now_encoded = struct.pack('!l', now) - for config in self.configs: - matching = list(reporter.get_keys(config)) - counter = counter_results.get(config.counter_key) - if counter is None: - # Incrementing the config failed, so give up on these Key samples. - continue - counter = int(counter) # Deal with wonky serialization types. - for (value_index, sample_number) in zip( - xrange(len(matching)), xrange(counter - len(matching), counter)): - insert_index = None - if sample_number < config.samples: - insert_index = sample_number - else: - random_index = randrange(sample_number) - if random_index < config.samples: - insert_index = random_index - if insert_index is not None: - key = matching[value_index] - value_key = config.position_key(insert_index) - value = reporter.get(key, config) - if value is not None: - # Value may be none if this key was removed from the samples - # list due to not passing the coin flip. - value_encoded = struct.pack('!l', value) - sample = '%s:%s:%s' % ( - config.adjust_value(key), now_encoded, value_encoded) - value_sets[value_key] = sample - memcache.set_multi(value_sets) - - def get(self, config, single_key=None): - """Gets statistics for a particular config and/or key. - - This will only retrieve samples for the current time period. Samples - from previous time periods will be ignored. - - Args: - config: The ReservoirConfig to retrieve stats for. - single_key: If None, then global stats for the config will be retrieved. - When a key value (a string), then only stats for that particular key - will be returned to the caller. - - Returns: - SampleResult object containing the result data. - """ - # Make sure the key is converted into the format expected by the config. - if single_key is not None: - single_key = config.adjust_value(single_key) - - keys = [config.start_key, config.counter_key] - for i in xrange(config.samples): - keys.append(config.position_key(i)) - sample_data = memcache.get_multi(keys) - - # Deal with wonky serialization types. - counter = int(sample_data.get(config.counter_key, 0)) - start_time = sample_data.get(config.start_key) - now = self.gettime() - if start_time is None: - # If the start time isn't there, then just assume it started exactly - # the period ago. This should only happen if the start time gets - # evicted for some weird reason. - start_time = now - config.period - elapsed = now - start_time - - # Find all samples that fall within the reset time validity window. - results = SampleResult(config, counter, elapsed) - for i in xrange(config.samples): - combined_value = sample_data.get(config.position_key(i)) - if combined_value is None: - continue - key, when_encoded, value_encoded = ( - combined_value.rsplit(':', 2) + ['', '', ''])[:3] - if single_key is not None and single_key != key: - continue - - if len(when_encoded) != 4: - continue - when = struct.unpack('!l', when_encoded)[0] - if len(value_encoded) != 4: - continue - value = struct.unpack('!l', value_encoded)[0] - - if ((start_time - config.tolerance) - < when < - (start_time + config.period + config.tolerance)): - results.add(key, when, value) - - # For a single sample we need to set the counter to the number of unique - # samples so we don't leak the overall QPS being pushed for this event. - if single_key is not None: - results.set_single_sample(single_key) - - return results - - def get_chain(self, *configs, **kwargs): - """Gets statistics for a set of configs, optionally for a single key. - - For retrieving multiple configs sequentially in a way that ensures that - the memory usage of the previous result is garbage collected before the - next one is returned. - - Args: - *configs: Set of configs to retrieve. - **kwargs: Keyword arguments to pass to the 'get' method of this class. - - Returns: - Generator that yields each SampleResult object for each config. - """ - for config in configs: - result = self.get(config, **kwargs) - yield result - del result - # NOTE: This kinda sucks, but the result sets are really large so - # we need to make sure the garbage collector is doing its job so we - # don't run bloat memory over the course of a single stats request. - gc.collect() - -################################################################################ - -class UrlScorer(object): - """Classifies incoming URLs by domain as passing a filter or being blocked. - - Used to enforce per-callback and per-feed limits on slowness, failures, - and misbehavior. - """ - - def __init__(self, - period=None, - min_requests=None, - max_failure_percentage=None, - prefix=None): - """Initializer. - - Args: - period: Over what time period, in seconds, the scorer should track - statistics for URLs. The shorter the more reliable the enforcement - due to cache eviction. Must be a positive number, forced to integer. - min_requests: Minimum number of requests to receive (per second, - independent of the enforcement 'period' parameter) before rate limiting - takes effect. Must be non-negative. Floating point is fine. - max_failure_percentage: Maximum percentage of failures (as a moving - rate) to allow before a domain is blocked. Value can be a number - between 0 and 1 and float. - prefix: Memcache key prefix to use for this scorer configuration. - Must not be empty. - - Raises: - ConfigError if any of the parameters above are invalid. - """ - try: - period = int(period) - except ValueError, e: - raise ConfigError('Invalid period: %s' % e) - if period <= 0: - raise ConfigError('period must be non-zero') - - try: - min_requests = float(min_requests) - except ValueError, e: - raise ConfigError('Invalid min_requests: %s' % e) - if min_requests < 0: - raise ConfigError('min_requests must be non-negative') - - try: - max_failure_percentage = float(max_failure_percentage) - except ValueError, e: - raise ConfigError('invalid max_failure_percentage: %s' % e) - if not (0 <= max_failure_percentage <= 1): - raise ConfigError('max_failure_percentage must be between 0 and 1') - - if not isinstance(prefix, basestring) or not prefix: - raise ConfigError('prefix must be a non-empty string') - - self.period = period - self.min_requests = int(self.period * min_requests) - self.max_failure_percentage = max_failure_percentage - self.prefix = 'scoring:%s:' % prefix - - def filter(self, urls): - """Checks if each URL can proceed based on a successful score. - - Args: - urls: Iterable of URLs to check. Each input URL will have a corresponding - result returned in the same order they were passed in. - - Returns: - List of tuple (allowed, failure_percentage) where: - allowed: True if the URL passed the filter, False otherwise. - failure_percentage: Percent of failures seen during the current - scoring period. Number between 0 and 1. - """ - domain_list = [get_url_domain(u) for u in urls] - keys = ['success:' + d for d in domain_list] - keys.extend('failure:' + d for d in domain_list) - values = memcache.get_multi(keys, key_prefix=self.prefix) - - result = [] - for domain in domain_list: - success = values.get('success:' + domain, 0) - failure = values.get('failure:' + domain, 0) - requests = success + failure - - if requests > 0: - failure_percentage = (1.0 * failure) / requests - else: - failure_percentage = 0 - - allow = bool( - DISABLE_FOR_TESTING or - requests < self.min_requests or - failure_percentage < self.max_failure_percentage) - result.append((allow, failure_percentage)) - - return result - - def report(self, success, failure): - """Reports the status of interactions with a set of URLs. - - Args: - success: Iterable of URLs that had successful interactions. - failure: Iterable of URLs that had failed interactions. - """ - if success is None: - success = [] - if failure is None: - failure = [] - - offsets = {} - # Always set successful and failed even if the other one doesn't exist yet - # so we're reasonably sure that their expiration times are synchronized. - for url in success: - domain = get_url_domain(url) - success_key = 'success:' + domain - fail_key = 'failure:' + domain - offsets[success_key] = offsets.get(success_key, 0) + 1 - offsets[fail_key] = offsets.get(fail_key, 0) - for url in failure: - domain = get_url_domain(url) - success_key = 'success:' + domain - fail_key = 'failure:' + domain - offsets[success_key] = offsets.get(success_key, 0) - offsets[fail_key] = offsets.get(fail_key, 0) + 1 - - offset_or_add(offsets, self.period, self.prefix) - - def get_scores(self, urls): - """Retrieves the scores for a set of URLs. - - Args: - urls: Iterable of URLs to retrieve the scores for. Each input will have - a corresponding entry in the returned value in the same order. - - Returns: - List of tuple (success, failure) where: - success: Number of successful requests. - failure: Number of failed requests. - """ - domain_list = [get_url_domain(u) for u in urls] - keys = ['success:' + d for d in domain_list] - keys.extend('failure:' + d for d in domain_list) - values = memcache.get_multi(keys, key_prefix=self.prefix) - return [(values.get('success:' + d, 0), values.get('failure:' + d, 0)) - for d in domain_list] - - def blackhole(self, urls): - """Blackholes a set of URLs by domain for the rest of the current period. - - Args: - urls: Iterable of URLs to blackhole. - """ - values = dict(('failure:' + get_url_domain(u), self.min_requests) - for u in urls) - memcache.set_multi(values, key_prefix=self.prefix) diff --git a/hub/dos_test.py b/hub/dos_test.py deleted file mode 100755 index 69ab449..0000000 --- a/hub/dos_test.py +++ /dev/null @@ -1,1717 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Tests for the dos module.""" - -import cProfile -import gc -import logging -logging.basicConfig(format='%(levelname)-8s %(filename)s] %(message)s') -import os -import random -import sys -import unittest - -import testutil -testutil.fix_path() - -from google.appengine.api import memcache -from google.appengine.ext import webapp - -import dos - -################################################################################ - -class LimitTestBase(testutil.HandlerTestBase): - """Base class for limit function tests.""" - - def setUp(self): - """Sets up the test harness.""" - testutil.HandlerTestBase.setUp(self) - self.old_environ = os.environ.copy() - os.environ['PATH_INFO'] = '/foobar_path' - - def tearDown(self): - """Tears down the test hardness.""" - testutil.HandlerTestBase.tearDown(self) - os.environ.clear() - os.environ.update(self.old_environ) - - -class HeaderHandler(webapp.RequestHandler): - - # Rate limit by headers - @dos.limit(count=3, period=10) - def get(self): - self.response.out.write('get success') - - # Rate limit by custom header - @dos.limit(header='HTTP_FANCY_HEADER', count=3, period=10) - def post(self): - self.response.out.write('post success') - - -class HeaderTest(LimitTestBase): - """Tests for limiting by only headers.""" - - handler_class = HeaderHandler - - def testDefaultHeader(self): - """Tests limits on a default header.""" - os.environ['REMOTE_ADDR'] = '10.1.1.3' - for i in xrange(3): - self.handle('get') - self.assertEquals(200, self.response_code()) - self.assertEquals('get success', self.response_body()) - self.handle('get') - self.assertEquals(503, self.response_code()) - - # Different header value will not be limited. - os.environ['REMOTE_ADDR'] = '10.1.1.4' - self.handle('get') - self.assertEquals(200, self.response_code()) - - def testCustomHeader(self): - """Tests limits on a default header.""" - header = 'HTTP_FANCY_HEADER' - os.environ[header] = 'my cool header value' - for i in xrange(3): - self.handle('post') - self.assertEquals(200, self.response_code()) - self.assertEquals('post success', self.response_body()) - self.handle('post') - self.assertEquals(503, self.response_code()) - - # Different header value will not be limited. - os.environ['HTTP_FANCY_HEADER'] = 'something else' - self.handle('post') - self.assertEquals(200, self.response_code()) - - def testHeaderMissing(self): - """Tests when rate-limiting on a header that's missing.""" - # Should not allow more than three requests here, but - # since there is no limit key, we let them all through. - for i in xrange(4): - self.handle('get') - self.assertEquals(200, self.response_code()) - self.assertEquals('get success', self.response_body()) - - -class ParamHandler(webapp.RequestHandler): - - # Limit by parameter - @dos.limit(param='foo', header=None, count=3, period=10) - def post(self): - self.response.out.write('post success') - - -class ParamTest(LimitTestBase): - """Tests for limiting by only parameters.""" - - handler_class = ParamHandler - - def testParam(self): - """Tests limits on a parameter.""" - for i in xrange(3): - self.handle('post', ('foo', 'meep')) - self.assertEquals(200, self.response_code()) - self.assertEquals('post success', self.response_body()) - self.handle('post', ('foo', 'meep')) - self.assertEquals(503, self.response_code()) - - # Different parameter value will not be limited. - self.handle('post', ('foo', 'wooh')) - self.assertEquals(200, self.response_code()) - - def testParamMissing(self): - """Tests when rate-limiting on a parameter that's missing.""" - # Should not allow more than three requests here, but - # since there is no limit key, we let them all through. - for i in xrange(4): - self.handle('post') - self.assertEquals(200, self.response_code()) - self.assertEquals('post success', self.response_body()) - - -class ParamAndHeaderHandler(webapp.RequestHandler): - - # Limit by headers and params - @dos.limit(param='foo', count=3, period=10) - def post(self): - self.response.out.write('post success') - - -class ParamAndHeaderTest(LimitTestBase): - """Tests for limiting by parameters and headers.""" - - handler_class = ParamAndHeaderHandler - - def testHeaderAndParam(self): - """Tests when a header and parameter are limited.""" - os.environ['REMOTE_ADDR'] = '10.1.1.3' - for i in xrange(3): - self.handle('post', ('foo', 'meep')) - self.assertEquals(200, self.response_code()) - self.assertEquals('post success', self.response_body()) - self.handle('post', ('foo', 'meep')) - self.assertEquals(503, self.response_code()) - - # Different header *or* parmaeter values will not be limited. - self.handle('post', ('foo', 'stuff')) - self.assertEquals(200, self.response_code()) - - os.environ['REMOTE_ADDR'] = '10.1.1.4' - self.handle('post', ('foo', 'meep')) - self.assertEquals(200, self.response_code()) - - def testHeaderMissing(self): - """Tests when the header should be there too but isn't.""" - # Should not allow more than three requests here, but - # since there is no limit key, we let them all through. - for i in xrange(4): - self.handle('post', ('foo', 'meep')) - self.assertEquals(200, self.response_code()) - self.assertEquals('post success', self.response_body()) - - def testParamMissing(self): - """Tests when the parameter should be there too but isn't.""" - # Should not allow more than three requests here, but - # since there is no limit key, we let them all through. - os.environ['REMOTE_ADDR'] = '10.1.1.4' - for i in xrange(4): - self.handle('post') - self.assertEquals(200, self.response_code()) - self.assertEquals('post success', self.response_body()) - - def testBothMissing(self): - """Tests when the header and parameter are missing.""" - # Should not allow more than three requests here, but - # since there is no limit key, we let them all through. - for i in xrange(4): - self.handle('post') - self.assertEquals(200, self.response_code()) - self.assertEquals('post success', self.response_body()) - - -class MethodsAndUrlsHandler(webapp.RequestHandler): - - @dos.limit(count=3, period=10) - def get(self): - self.response.out.write('get success') - - @dos.limit(count=3, period=10) - def post(self): - self.response.out.write('post success') - - -class MethodsAndUrlsTest(LimitTestBase): - """Tests for limiting across various methods and URLs.""" - - handler_class = MethodsAndUrlsHandler - - def testMethods(self): - """Tests that methods are limited separately.""" - os.environ['REMOTE_ADDR'] = '10.1.1.3' - for i in xrange(3): - self.handle('post') - self.assertEquals(200, self.response_code()) - self.assertEquals('post success', self.response_body()) - self.handle('post') - self.assertEquals(503, self.response_code()) - - # Different method still works. - self.handle('get') - self.assertEquals(200, self.response_code()) - - def testUrls(self): - """Tests that limiting for the same verb on different URLs works.""" - os.environ['REMOTE_ADDR'] = '10.1.1.3' - for i in xrange(3): - self.handle('post') - self.assertEquals(200, self.response_code()) - self.assertEquals('post success', self.response_body()) - self.handle('post') - self.assertEquals(503, self.response_code()) - - # Different path still works. - os.environ['PATH_INFO'] = '/other_path' - self.handle('post') - self.assertEquals(200, self.response_code()) - - -class ErrorParamsHandler(webapp.RequestHandler): - - # Alternate error code - @dos.limit(count=0, period=1, error_code=409, retry_after=99) - def get(self): - self.response.out.write('get success') - - # No retry-after time - @dos.limit(count=0, period=1, retry_after=None) - def post(self): - self.response.out.write('post success') - - # Defaults - @dos.limit(count=0, period=1) - def put(self): - self.response.out.write('put success') - - -class ErrorParamsTest(LimitTestBase): - """Tests the error and retry paramters""" - - handler_class = ErrorParamsHandler - - def testDefaultRetryAmount(self): - """Tests the supplied retry amount is valid.""" - os.environ['REMOTE_ADDR'] = '10.1.1.3' - self.handle('put') - self.assertEquals(503, self.response_code()) - self.assertEquals('120', self.response_headers().get('Retry-After')) - - def testCustomErrorCode(self): - """Tests when a custom error code and retry time are specified.""" - os.environ['REMOTE_ADDR'] = '10.1.1.3' - self.handle('get') - self.assertEquals(409, self.response_code()) - self.assertEquals('99', self.response_headers().get('Retry-After')) - - def testNoRetryTime(self): - """Tests when no retry time should be returned.""" - os.environ['REMOTE_ADDR'] = '10.1.1.3' - self.handle('post') - self.assertEquals(503, self.response_code()) - self.assertEquals(None, self.response_headers().get('Retry-After')) - - -class ConfigErrorTest(unittest.TestCase): - """Tests various limit configuration errors.""" - - def testNoKeyError(self): - """Tests when there is no limiting key to derive.""" - self.assertRaises( - dos.ConfigError, - dos.limit, - header=None, - param=None) - - def testNegativeCount(self): - """Tests when the count is less than zero.""" - self.assertRaises( - dos.ConfigError, - dos.limit, - count=-1, - period=1) - - def testZeroPeriod(self): - """Tests when the count is less than zero.""" - self.assertRaises( - dos.ConfigError, - dos.limit, - count=1, - period=0) - - def testParamForDifferentVerb(self): - """Tests trying to rate limit a .""" - def put(): - pass - wrapper = dos.limit(param='okay', count=1, period=1) - self.assertRaises(dos.ConfigError, wrapper, put) - - -class MemcacheDetailsHandler(webapp.RequestHandler): - - @dos.limit(count=0, period=5.234) - def post(self): - self.response.out.write('post success') - - -class MemcacheDetailTest(LimitTestBase): - """Tests for various memcache details and failures.""" - - handler_class = MemcacheDetailsHandler - - def setUp(self): - """Sets up the test harness.""" - LimitTestBase.setUp(self) - os.environ['REMOTE_ADDR'] = '10.1.1.4' - self.expected_key = 'POST /foobar_path REMOTE_ADDR=10.1.1.4' - self.expected_incr = [] - self.expected_add = [] - self.old_incr = dos.memcache.incr - self.old_add = dos.memcache.add - - def incr(key): - self.assertEquals(self.expected_key, key) - return self.expected_incr.pop(0) - dos.memcache.incr = incr - - def add(key, value, time=None): - self.assertEquals(self.expected_key, key) - self.assertEquals(1, value) - self.assertEquals(5.234, time) - return self.expected_add.pop(0) - dos.memcache.add = add - - def tearDown(self): - """Tears down the test harness.""" - LimitTestBase.tearDown(self) - self.assertEquals(0, len(self.expected_incr)) - self.assertEquals(0, len(self.expected_add)) - dos.memcache.incr = self.old_incr - dos.memcache.add = self.old_add - - def testIncrFailure(self): - """Tests when the initial increment fails.""" - self.expected_incr.append(None) - self.expected_add.append(True) - self.handle('post') - self.assertEquals(503, self.response_code()) - - def testIncrAndAddFailure(self): - """Tests when the initial increment and the following add fail.""" - self.expected_incr.append(None) - self.expected_add.append(False) - self.expected_incr.append(14) - self.handle('post') - self.assertEquals(503, self.response_code()) - - def testCompleteFailure(self): - """Tests when all memcache calls fail.""" - self.expected_incr.append(None) - self.expected_add.append(False) - self.expected_incr.append(None) - self.handle('post') - self.assertEquals(200, self.response_code()) - self.assertEquals('post success', self.response_body()) - - -class WhiteListHandler(webapp.RequestHandler): - - @dos.limit(count=0, period=1, - header_whitelist=set(['10.1.1.5', '10.1.1.6'])) - def get(self): - self.response.out.write('get success') - - @dos.limit(param='foobar', header=None, count=0, period=1, - param_whitelist=set(['meep', 'stuff'])) - def post(self): - self.response.out.write('post success') - - -class WhiteListTest(LimitTestBase): - """Tests for white-listing.""" - - handler_class = WhiteListHandler - - def testHeaderWhitelist(self): - """Tests white-lists for headers.""" - os.environ['REMOTE_ADDR'] = '10.1.1.3' - self.handle('get') - self.assertEquals(503, self.response_code()) - - for addr in ('10.1.1.5', '10.1.1.6'): - os.environ['REMOTE_ADDR'] = addr - self.handle('get') - self.assertEquals(200, self.response_code()) - self.assertEquals('get success', self.response_body()) - - def testParameterWhitelist(self): - """Tests white-lists for parameters.""" - self.handle('post', ('foobar', 'zebra')) - self.assertEquals(503, self.response_code()) - - for value in ('meep', 'stuff'): - self.handle('post', ('foobar', value)) - self.assertEquals(200, self.response_code()) - self.assertEquals('post success', self.response_body()) - - -class LayeredHandler(webapp.RequestHandler): - - @dos.limit(count=3, period=1) - @dos.limit(header=None, param='stuff', count=0, period=1) - def get(self): - self.response.out.write('get success') - - -class LayeringTest(LimitTestBase): - """Tests that dos limits can be layered.""" - - handler_class = LayeredHandler - - def testLayering(self): - """Tests basic layering.""" - os.environ['REMOTE_ADDR'] = '10.1.1.3' - - # First request works normally, limiting by IP. - self.handle('get') - self.assertEquals(200, self.response_code()) - self.assertEquals('get success', self.response_body()) - - # Next request uses param and is blocked. - self.handle('get', ('stuff', 'meep')) - self.assertEquals(503, self.response_code()) - - # Next request without param is allowed, following one is blocked. - self.handle('get') - self.assertEquals(200, self.response_code()) - self.assertEquals('get success', self.response_body()) - self.handle('get') - self.assertEquals(503, self.response_code()) - -################################################################################ - -class GetUrlDomainTest(unittest.TestCase): - """Tests for the get_url_domain function.""" - - def testDomain(self): - """Tests good domain names.""" - # No subdomain - self.assertEquals( - 'example.com', - dos.get_url_domain('http://example.com/foo/bar?meep=stuff#asdf')) - # One subdomain - self.assertEquals( - 'www.example.com', - dos.get_url_domain('http://www.example.com/foo/bar?meep=stuff#asdf')) - # Many subdomains - self.assertEquals( - '1.2.3.many.sub.example.com', - dos.get_url_domain('http://1.2.3.many.sub.example.com/')) - # Domain with no trailing path - self.assertEquals( - 'www.example.com', - dos.get_url_domain('http://www.example.com')) - - def testDomainExceptions(self): - """Tests that some URLs may use more than the domain suffix.""" - self.assertEquals( - 'blogspot.com', - dos.get_url_domain('http://example.blogspot.com/this-is?some=test')) - - def testIP(self): - """Tests IP addresses.""" - self.assertEquals( - '192.168.1.1', - dos.get_url_domain('http://192.168.1.1/foo/bar?meep=stuff#asdf')) - # No trailing path - self.assertEquals( - '192.168.1.1', - dos.get_url_domain('http://192.168.1.1')) - - def testOther(self): - """Tests anything that's not IP- or domain-like.""" - self.assertEquals( - 'localhost', - dos.get_url_domain('http://localhost/foo/bar?meep=stuff#asdf')) - # No trailing path - self.assertEquals( - 'localhost', - dos.get_url_domain('http://localhost')) - - def testBadUrls(self): - """Tests URLs that are bad.""" - self.assertEquals('bad_url', - dos.get_url_domain('this is bad')) - self.assertEquals('bad_url', - dos.get_url_domain('example.com/foo/bar?meep=stuff#asdf')) - self.assertEquals('bad_url', - dos.get_url_domain('example.com')) - self.assertEquals('bad_url', - dos.get_url_domain('//example.com')) - self.assertEquals('bad_url', - dos.get_url_domain('/myfeed.atom')) - self.assertEquals('bad_url', - dos.get_url_domain('192.168.0.1/foobar')) - self.assertEquals('bad_url', - dos.get_url_domain('192.168.0.1')) - - def testCaching(self): - """Tests that cache eviction works properly.""" - dos._DOMAIN_CACHE.clear() - old_size = dos.DOMAIN_CACHE_SIZE - try: - dos.DOMAIN_CACHE_SIZE = 2 - dos._DOMAIN_CACHE['http://a.example.com/stuff'] = 'a.example.com' - dos._DOMAIN_CACHE['http://b.example.com/stuff'] = 'b.example.com' - dos._DOMAIN_CACHE['http://c.example.com/stuff'] = 'c.example.com' - self.assertEquals(3, len(dos._DOMAIN_CACHE)) - - # Old cache entries are hit: - self.assertEquals('c.example.com', - dos.get_url_domain('http://c.example.com/stuff')) - self.assertEquals(3, len(dos._DOMAIN_CACHE)) - - # New cache entries clear the contents. - self.assertEquals('d.example.com', - dos.get_url_domain('http://d.example.com/stuff')) - self.assertEquals(1, len(dos._DOMAIN_CACHE)) - finally: - dos.DOMAIN_CACHE_SIZE = old_size - -################################################################################ - -class OffsetOrAddTest(unittest.TestCase): - """Tests for the offset_or_add function.""" - - def setUp(self): - """Sets up the test harness.""" - self.offsets = None - self.offset_multi = lambda *a, **k: self.offsets.next()(*a, **k) - self.adds = None - self.add_multi = lambda *a, **k: self.adds.next()(*a, **k) - - def testAlreadyExist(self): - """Tests when the keys already exist and can just be added to.""" - def offset_multi(): - yield lambda *a, **k: {'one': 2, 'three': 4} - self.offsets = offset_multi() - - self.assertEquals( - {'one': 2, 'three': 4}, - dos.offset_or_add({'blue': 15, 'red': 10}, 5, - offset_multi=self.offset_multi, - add_multi=self.add_multi)) - - def testKeysAdded(self): - """Tests when some keys need to be re-added.""" - def offset_multi(): - yield lambda *a, **k: {'one': None, 'three': 4, 'five': None} - self.offsets = offset_multi() - - def add_multi(): - def run(adds, **kwargs): - self.assertEquals({'one': 5, 'five': 10}, adds) - return [] - yield run - self.adds = add_multi() - - self.assertEquals( - {'one': 5, 'three': 4, 'five': 10}, - dos.offset_or_add({'one': 5, 'three': 0, 'five': 10}, 5, - offset_multi=self.offset_multi, - add_multi=self.add_multi)) - - def testAddsRace(self): - """Tests when re-adding keys is a race that is lost.""" - def offset_multi(): - yield lambda *a, **k: {'one': None, 'three': 4, 'five': None} - yield lambda *a, **k: {'one': 5, 'five': 10} - self.offsets = offset_multi() - - def add_multi(): - def run(adds, **kwargs): - self.assertEquals({'one': 5, 'five': 10}, adds) - return ['one', 'five'] - yield run - self.adds = add_multi() - - self.assertEquals( - {'one': 5, 'three': 4, 'five': 10}, - dos.offset_or_add({'one': 5, 'three': 0, 'five': 10}, 5, - offset_multi=self.offset_multi, - add_multi=self.add_multi)) - - def testOffsetsFailAfterRace(self): - """Tests when the last offset call fails.""" - def offset_multi(): - yield lambda *a, **k: {'one': None, 'three': 4, 'five': None} - yield lambda *a, **k: {'one': None, 'five': None} - self.offsets = offset_multi() - - def add_multi(): - def run(adds, **kwargs): - self.assertEquals({'one': 5, 'five': 10}, adds) - return ['one', 'five'] - yield run - self.adds = add_multi() - - self.assertEquals( - {'one': None, 'three': 4, 'five': None}, - dos.offset_or_add({'one': 5, 'three': 0, 'five': 10}, 5, - offset_multi=self.offset_multi, - add_multi=self.add_multi)) - -################################################################################ - -class SamplerTest(unittest.TestCase): - """Tests for the MultiSampler class.""" - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - self.domainA = 'mydomain.com' - self.domainB = 'example.com' - self.domainC = 'other.com' - self.domainD = 'meep.com' - self.url1 = 'http://mydomain.com/stuff/meep' - self.url2 = 'http://example.com/some-path?a=b' - self.url3 = 'http://example.com' - self.url4 = 'http://other.com/relative' - self.url5 = 'http://meep.com/another-one' - self.all_urls = [self.url1, self.url2, self.url3, self.url4, self.url5] - - self.randrange_results = [] - self.fake_randrange = lambda value: self.randrange_results.pop(0) - - self.random_results = [] - self.fake_random = lambda: self.random_results.pop(0) - - self.gettime_results = [] - self.fake_gettime = lambda: self.gettime_results.pop(0) - - def verify_sample(self, - results, - key, - expected_count, - expected_frequency, - expected_average=1, - expected_min=1, - expected_max=1): - """Verifies a sample key is present in the results. - - Args: - results: SampleResult object. - key: String key of the sample to test. - expected_count: How many samples should be present in the results. - expected_frequency: The frequency of this single key. - expected_average: Expected average value across samples of this key. - expected_min: Expected minimum value across samples of this key. - expected_max: Expected maximum value across samples of this key. - - Raises: - AssertionError if any of the expectations are not met. - """ - self.assertEquals(expected_count, results.get_count(key)) - self.assertTrue( - -0.001 < (expected_frequency - results.get_frequency(key)) < 0.001, - 'Difference %f - %f = %f' % ( - expected_frequency, results.get_frequency(key), - expected_frequency - results.get_frequency(key))) - self.assertTrue( - -0.001 < (expected_average - results.get_average(key)) < 0.001, - 'Difference %f - %f %f' % ( - expected_average, results.get_average(key), - expected_average - results.get_average(key))) - self.assertEquals(expected_min, results.get_min(key)) - self.assertEquals(expected_max, results.get_max(key)) - - def verify_no_sample(self, results, key): - """Verifies a sample key is not present in the results. - - Args: - results: SampleResult object. - key: String key of the sample to test. - - Raises: - AssertionError if the key is present. - """ - self.assertEquals(0, len(results.get_samples(key))) - - def testSingleAlways(self): - """Tests single-config sampling when the sampling rate is 100%.""" - config = dos.ReservoirConfig( - 'always', - period=300, - rate=1, - samples=10000, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config) - reporter.set(self.url2, config) - reporter.set(self.url3, config) - reporter.set(self.url4, config) - reporter.set(self.url5, config) - self.gettime_results.extend([0, 10]) - sampler.sample(reporter) - results = sampler.get(config) - self.assertEquals(5, results.total_samples) - self.assertEquals(5, results.unique_samples) - self.verify_sample(results, self.domainA, 1, 0.1) - self.verify_sample(results, self.domainB, 2, 0.2) - self.verify_sample(results, self.domainC, 1, 0.1) - self.verify_sample(results, self.domainD, 1, 0.1) - - self.gettime_results.extend([0, 10]) - sampler.sample(reporter) - results = sampler.get(config) - self.assertEquals(10, results.total_samples) - self.assertEquals(10, results.unique_samples) - self.verify_sample(results, self.domainA, 2, 0.2) - self.verify_sample(results, self.domainB, 4, 0.4) - self.verify_sample(results, self.domainC, 2, 0.2) - self.verify_sample(results, self.domainD, 2, 0.2) - - reporter = dos.Reporter() - reporter.set(self.url1, config) - self.gettime_results.extend([0, 10]) - sampler.sample(reporter) - results = sampler.get(config) - self.assertEquals(11, results.total_samples) - self.assertEquals(11, results.unique_samples) - self.verify_sample(results, self.domainA, 3, 0.3) - self.verify_sample(results, self.domainB, 4, 0.4) - self.verify_sample(results, self.domainC, 2, 0.2) - self.verify_sample(results, self.domainD, 2, 0.2) - - def testSingleOverwrite(self): - """Tests when the number of slots is lower than the sample count.""" - config = dos.ReservoirConfig( - 'always', - period=300, - rate=1, - samples=2, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - # Writes samples index 0 and 1, then overwrites index 1 again with - # a URL in the same domain. - reporter = dos.Reporter() - reporter.set(self.url1, config) - reporter.set(self.url2, config) - reporter.set(self.url3, config) - self.gettime_results.extend([0, 1]) - self.randrange_results.extend([1]) - sampler.sample(reporter, randrange=self.fake_randrange) - results = sampler.get(config) - self.assertEquals(3, results.total_samples) - self.assertEquals(2, results.unique_samples) - self.verify_sample(results, self.domainA, 1, 1.5) - self.verify_sample(results, self.domainB, 1, 1.5) - - # Overwrites the sample at index 0, skewing all results towards the - # domain from index 1. - reporter = dos.Reporter() - reporter.set(self.url3, config) - self.gettime_results.extend([0, 1]) - self.randrange_results.extend([0]) - sampler.sample(reporter, randrange=self.fake_randrange) - results = sampler.get(config) - self.assertEquals(4, results.total_samples) - self.assertEquals(2, results.unique_samples) - self.verify_sample(results, self.domainB, 2, 4.0) - self.verify_no_sample(results, self.domainA) - - # Now a sample outside the range won't replace anything. - self.gettime_results.extend([0, 1]) - self.randrange_results.extend([3]) - sampler.sample(reporter, randrange=self.fake_randrange) - results = sampler.get(config) - self.assertEquals(5, results.total_samples) - self.assertEquals(2, results.unique_samples) - self.verify_sample(results, self.domainB, 2, 5.0) - self.verify_no_sample(results, self.domainA) - - def testSingleSampleRate(self): - """Tests when the sampling rate is less than 1.""" - config = dos.ReservoirConfig( - 'always', - period=300, - rate=0.2, - samples=10000, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config) - reporter.set(self.url2, config) - reporter.set(self.url3, config) - reporter.set(self.url4, config) - reporter.set(self.url5, config) - self.gettime_results.extend([0, 10]) - self.random_results.extend([0.25, 0.199, 0.1, 0, 0.201]) - sampler.sample(reporter, getrandom=self.fake_random) - results = sampler.get(config) - self.assertEquals(3, results.total_samples) - self.assertEquals(3, results.unique_samples) - self.verify_no_sample(results, self.domainA) - self.verify_no_sample(results, self.domainD) - self.verify_sample(results, self.domainB, 2, - (1.0/0.2) * (2.0/3.0) * (3.0/10.0)) - self.verify_sample(results, self.domainC, 1, - (1.0/0.2) * (1.0/3.0) * (3.0/10.0)) - - def testSingleDoubleSampleRemoved(self): - """Tests when the same sample key is set twice and one is skipped. - - Setting the value twice should just overwite the previous value for a key, - but we store the keys in full order (with dupes) for simpler tests. This - ensures that incorrectly using the sampler with multiple sets won't barf. - """ - config = dos.ReservoirConfig( - 'always', - period=300, - rate=0.2, - samples=4, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config) - reporter.set(self.url1, config) - reporter.set(self.url2, config) - reporter.set(self.url3, config) - reporter.set(self.url4, config) - reporter.set(self.url5, config) - self.gettime_results.extend([0, 10]) - self.randrange_results.extend([0]) - self.random_results.extend([0.25, 0.199, 0.1, 0, 0.3, 0.3]) - sampler.sample(reporter, getrandom=self.fake_random) - results = sampler.get(config) - self.assertEquals(3, results.total_samples) - self.assertEquals(2, results.unique_samples) - self.verify_no_sample(results, self.domainA) - self.verify_no_sample(results, self.domainC) - self.verify_no_sample(results, self.domainD) - self.verify_sample(results, self.domainB, 2, - (1.0/0.2) * (2.0/2.0) * (3.0/10.0)) - - def testSingleSampleRateReplacement(self): - """Tests when the sample rate is < 1 and slots are overwritten.""" - config = dos.ReservoirConfig( - 'always', - period=300, - rate=0.2, - samples=2, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config) - reporter.set(self.url2, config) - reporter.set(self.url3, config) - reporter.set(self.url4, config) - self.gettime_results.extend([0, 10]) - self.randrange_results.extend([1]) - self.random_results.extend([0.25, 0.199, 0.1, 0]) - sampler.sample(reporter, getrandom=self.fake_random) - results = sampler.get(config) - self.assertEquals(3, results.total_samples) - self.assertEquals(2, results.unique_samples) - self.verify_no_sample(results, self.domainA) - self.verify_no_sample(results, self.domainD) - self.verify_sample(results, self.domainB, 1, - (1.0/0.2) * (1.0/2.0) * (3.0/10.0)) - self.verify_sample(results, self.domainC, 1, - (1.0/0.2) * (1.0/2.0) * (3.0/10.0)) - - def testSingleSampleValues(self): - """Tests various samples with expected values.""" - config = dos.ReservoirConfig( - 'always', - period=300, - rate=0.2, - samples=4, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config, 5) - reporter.set(self.url1, config, 20) # in - reporter.set(self.url2, config, 10) # in - reporter.set(self.url2 + '&more=true', config, 25) # in - reporter.set(self.url3, config, 20) # in - reporter.set(self.url4, config, 40) # in - reporter.set(self.url5, config, 60) - self.gettime_results.extend([0, 10]) - self.randrange_results.extend([0]) - self.random_results.extend([0.25, 0.199, 0.1, 0, 0, 0.1, 0.3]) - sampler.sample(reporter, - randrange=self.fake_randrange, - getrandom=self.fake_random) - results = sampler.get(config) - self.assertEquals(5, results.total_samples) - self.assertEquals(4, results.unique_samples) - self.verify_no_sample(results, self.domainA) - self.verify_no_sample(results, self.domainD) - self.verify_sample(results, self.domainB, 3, - (1.0/0.2) * (3.0/4.0) * (5.0/10.0), - expected_average=18.333, - expected_min=10, - expected_max=25) - self.verify_sample(results, self.domainC, 1, - (1.0/0.2) * (1.0/4.0) * (5.0/10.0), - expected_average=40, - expected_min=40, - expected_max=40) - - def testResetTimestamp(self): - """Tests resetting the timestamp after the period elapses.""" - config = dos.ReservoirConfig( - 'always', - period=10, - samples=10000, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config) - self.gettime_results.extend([0, 5]) - sampler.sample(reporter) - results = sampler.get(config) - self.assertEquals(1, results.total_samples) - self.assertEquals(1, results.unique_samples) - self.verify_sample(results, self.domainA, 1, 1.0 / 5) - self.verify_no_sample(results, self.domainB) - self.verify_no_sample(results, self.domainC) - self.verify_no_sample(results, self.domainD) - - reporter = dos.Reporter() - reporter.set(self.url2, config) - self.gettime_results.extend([15, 16]) - sampler.sample(reporter) - results = sampler.get(config) - self.assertEquals(1, results.total_samples) - self.assertEquals(1, results.unique_samples) - self.verify_sample(results, self.domainB, 1, 1.0) - self.verify_no_sample(results, self.domainA) - self.verify_no_sample(results, self.domainC) - self.verify_no_sample(results, self.domainD) - - def testSingleUnicodeKey(self): - """Tests when a sampling key is unicode. - - Keys must be UTF-8 encoded because the memcache API will do this for us - (and break) if we don't. - """ - config = dos.ReservoirConfig( - 'always', - period=300, - samples=10000, - by_url=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - key = u'this-breaks-stuff\u30d6\u30ed\u30b0\u8846' - key_utf8 = key.encode('utf-8') - reporter.set(key, config) - self.gettime_results.extend([0, 10]) - sampler.sample(reporter) - results = sampler.get(config) - self.assertEquals(1, results.total_samples) - self.assertEquals(1, results.unique_samples) - self.verify_sample(results, key_utf8, 1, 0.1) - - def testMultiple(self): - """Tests multiple configs being applied together.""" - config1 = dos.ReservoirConfig( - 'first', - period=300, - samples=10000, - by_domain=True) - config2 = dos.ReservoirConfig( - 'second', - period=300, - samples=10000, - by_domain=True) - sampler = dos.MultiSampler([config1, config2], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config1) - reporter.set(self.url2, config1) - reporter.set(self.url3, config1) - reporter.set(self.url4, config1) - reporter.set(self.url5, config1) - reporter.set(self.url1, config2, 5) - reporter.set(self.url2, config2, 5) - reporter.set(self.url3, config2, 5) - reporter.set(self.url4, config2, 5) - reporter.set(self.url5, config2, 5) - self.gettime_results.extend([0, 10, 10]) - sampler.sample(reporter) - - results1 = sampler.get(config1) - self.assertEquals(5, results1.total_samples) - self.assertEquals(5, results1.unique_samples) - self.verify_sample(results1, self.domainA, 1, 0.1) - self.verify_sample(results1, self.domainB, 2, 0.2) - self.verify_sample(results1, self.domainC, 1, 0.1) - self.verify_sample(results1, self.domainD, 1, 0.1) - - results2 = sampler.get(config2) - self.assertEquals(5, results2.total_samples) - self.assertEquals(5, results2.unique_samples) - self.verify_sample(results2, self.domainA, 1, 0.1, - expected_max=5, - expected_min=5, - expected_average=5) - self.verify_sample(results2, self.domainB, 2, 0.2, - expected_max=5, - expected_min=5, - expected_average=5) - self.verify_sample(results2, self.domainC, 1, 0.1, - expected_max=5, - expected_min=5, - expected_average=5) - self.verify_sample(results2, self.domainD, 1, 0.1, - expected_max=5, - expected_min=5, - expected_average=5) - - def testGetSingleKey(self): - """Tests getting the stats for a single key.""" - config = dos.ReservoirConfig( - 'single-sample', - period=300, - rate=1, - samples=10000, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config) - reporter.set(self.url2, config) - reporter.set(self.url3, config) - reporter.set(self.url3 + '&okay=1', config) - reporter.set(self.url3 + '&okay=2', config) - reporter.set(self.url3 + '&okay=3', config) - reporter.set(self.url3 + '&okay=4', config) - reporter.set(self.url4, config) - reporter.set(self.url5, config) - self.gettime_results.extend([0, 10, 10]) - sampler.sample(reporter) - results = sampler.get(config) - self.assertEquals(9, results.total_samples) - self.assertEquals(9, results.unique_samples) - self.verify_sample(results, self.domainA, 1, 0.1) - self.verify_sample(results, self.domainB, 6, 0.6) - self.verify_sample(results, self.domainC, 1, 0.1) - self.verify_sample(results, self.domainD, 1, 0.1) - - results = sampler.get(config, self.url2) - self.assertEquals(6, results.total_samples) - self.assertEquals(6, results.unique_samples) - self.verify_sample(results, self.domainB, 6, 0.6) - self.verify_no_sample(results, self.domainA) - self.verify_no_sample(results, self.domainC) - self.verify_no_sample(results, self.domainD) - - def testCountLost(self): - """Tests when the count variable disappears between samples.""" - config = dos.ReservoirConfig( - 'lost_count', - period=300, - rate=1, - samples=10000, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config) - reporter.set(self.url2, config) - self.gettime_results.extend([0, 10]) - sampler.sample(reporter) - results = sampler.get(config) - self.assertEquals(2, results.total_samples) - self.assertEquals(2, results.unique_samples) - self.verify_no_sample(results, self.domainC) - self.verify_no_sample(results, self.domainD) - self.verify_sample(results, self.domainA, 1, 0.1) - self.verify_sample(results, self.domainB, 1, 0.1) - - memcache.delete('lost_count:by_domain:counter') - reporter = dos.Reporter() - reporter.set(self.url4, config) - self.gettime_results.extend([0, 10]) - sampler.sample(reporter) - results = sampler.get(config) - self.assertEquals(1, results.total_samples) - - # Two samples found because we're still in the same period tolerance. - # Sample at index 0 will be overwritten with the new entry, meaning - # domain A is gone. - self.assertEquals(2, results.unique_samples) - self.verify_no_sample(results, self.domainA) - self.verify_no_sample(results, self.domainD) - self.verify_sample(results, self.domainB, 1, 0.05) - self.verify_sample(results, self.domainC, 1, 0.05) - - def testStampLost(self): - """Tests when the start timestamp is lost between samples.""" - config = dos.ReservoirConfig( - 'lost_stamp', - period=300, - rate=1, - samples=10000, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config) - reporter.set(self.url2, config) - self.gettime_results.extend([0, 10]) - sampler.sample(reporter) - results = sampler.get(config) - self.assertEquals(2, results.total_samples) - self.assertEquals(2, results.unique_samples) - self.verify_no_sample(results, self.domainC) - self.verify_no_sample(results, self.domainD) - self.verify_sample(results, self.domainA, 1, 0.1) - self.verify_sample(results, self.domainB, 1, 0.1) - - memcache.delete('lost_stamp:by_domain:start_time') - reporter = dos.Reporter() - reporter.set(self.url4, config) - self.gettime_results.extend([0, 10]) - sampler.sample(reporter) - results = sampler.get(config) - self.assertEquals(1, results.total_samples) - - # Just like losing the count, old samples found because we're still in the - # same period tolerance. Sample at index 0 will be overwritten with the new - # entry, meaning domain A is gone. - self.assertEquals(2, results.unique_samples) - self.verify_no_sample(results, self.domainA) - self.verify_no_sample(results, self.domainD) - self.verify_sample(results, self.domainB, 1, 0.05) - self.verify_sample(results, self.domainC, 1, 0.05) - - def testSamplesLost(self): - """Tests when some unique samples were evicted.""" - config = dos.ReservoirConfig( - 'lost_sample', - period=300, - rate=1, - samples=10000, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config) - reporter.set(self.url2, config) - reporter.set(self.url3, config) - reporter.set(self.url4, config) - reporter.set(self.url5, config) - self.gettime_results.extend([0, 10]) - sampler.sample(reporter) - - memcache.delete_multi([ - 'lost_sample:by_domain:0', - 'lost_sample:by_domain:1', - 'lost_sample:by_domain:2', - ]) - - results = sampler.get(config) - self.assertEquals(5, results.total_samples) - self.assertEquals(2, results.unique_samples) - self.verify_no_sample(results, self.domainA) - self.verify_no_sample(results, self.domainB) - self.verify_sample(results, self.domainC, 1, 0.25) - self.verify_sample(results, self.domainD, 1, 0.25) - - def testBeforePeriod(self): - """Tests when the samples retrieved are too old.""" - config = dos.ReservoirConfig( - 'old_samples', - period=10, - rate=1, - samples=10000, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config) - reporter.set(self.url2, config) - reporter.set(self.url3, config) - reporter.set(self.url4, config) - reporter.set(self.url5, config) - self.gettime_results.extend([20, 40]) - sampler.sample(reporter) - - memcache.set('old_samples:by_domain:start_time', 0) - results = sampler.get(config) - self.assertEquals(5, results.total_samples) - self.assertEquals(0, results.unique_samples) - self.verify_no_sample(results, self.domainA) - self.verify_no_sample(results, self.domainB) - self.verify_no_sample(results, self.domainC) - self.verify_no_sample(results, self.domainD) - - def testBadSamples(self): - """Tests when getting samples with memcache values that are bad.""" - config = dos.ReservoirConfig( - 'bad_samples', - period=10, - rate=1, - samples=10000, - by_domain=True) - sampler = dos.MultiSampler([config], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config) - reporter.set(self.url2, config) - reporter.set(self.url3, config) - reporter.set(self.url4, config) - reporter.set(self.url5, config) - self.gettime_results.extend([0, 10]) - sampler.sample(reporter) - - # Totaly bad - memcache.set('bad_samples:by_domain:0', 'garbage') - # Bad value. - memcache.set('bad_samples:by_domain:1', - '%s:\0\0\0\1:' % self.domainB) - # Bad when. - memcache.set('bad_samples:by_domain:2', - '%s::\0\0\0\1' % self.domainB) - - results = sampler.get(config) - self.assertEquals(5, results.total_samples) - self.assertEquals(2, results.unique_samples) - self.verify_no_sample(results, self.domainA) - self.verify_no_sample(results, self.domainB) - self.verify_sample(results, self.domainC, 1, 0.25) - self.verify_sample(results, self.domainD, 1, 0.25) - - def testGetChain(self): - """Tests getting results from multiple configs in a single call.""" - config1 = dos.ReservoirConfig( - 'first', - period=300, - rate=1, - samples=10000, - by_domain=True) - config2 = dos.ReservoirConfig( - 'second', - period=300, - rate=1, - samples=10000, - by_url=True) - sampler = dos.MultiSampler([config1, config2], gettime=self.fake_gettime) - - reporter = dos.Reporter() - reporter.set(self.url1, config1) - reporter.set(self.url2, config1) - reporter.set(self.url3, config1) - reporter.set(self.url4, config1) - reporter.set(self.url5, config1) - reporter.set(self.url1, config2) - reporter.set(self.url2, config2) - reporter.set(self.url3, config2) - reporter.set(self.url4, config2) - reporter.set(self.url5, config2) - self.gettime_results.extend([0, 10, 10, 10, 10]) - sampler.sample(reporter) - result_iter = sampler.get_chain(config1, config2) - - # Results for config1 - results = result_iter.next() - self.assertEquals(5, results.total_samples) - self.assertEquals(5, results.unique_samples) - self.verify_sample(results, self.domainA, 1, 0.1) - self.verify_sample(results, self.domainB, 2, 0.2) - self.verify_sample(results, self.domainC, 1, 0.1) - self.verify_sample(results, self.domainD, 1, 0.1) - - # Results for config2 - results = result_iter.next() - self.assertEquals(5, results.total_samples) - self.assertEquals(5, results.unique_samples) - self.verify_sample(results, self.url1, 1, 0.1) - self.verify_sample(results, self.url2, 1, 0.1) - self.verify_sample(results, self.url3, 1, 0.1) - self.verify_sample(results, self.url4, 1, 0.1) - self.verify_sample(results, self.url5, 1, 0.1) - - # Single key test - result_iter = sampler.get_chain( - config1, config2, - single_key=self.url2) - - # Results for config1 - results = result_iter.next() - self.assertEquals(2, results.total_samples) - self.assertEquals(2, results.unique_samples) - self.verify_sample(results, self.domainB, 2, 0.2) - - # Results for config2 - results = result_iter.next() - self.assertEquals(1, results.total_samples) - self.assertEquals(1, results.unique_samples) - self.verify_sample(results, self.url2, 1, 0.1) - - - def testConfig(self): - """Tests config validation.""" - # Bad name. - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - '', - period=10, - samples=10, - by_domain=True) - - # Bad period. - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period=0, - samples=10, - by_domain=True) - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period=-1, - samples=10, - by_domain=True) - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period='bad', - samples=10, - by_domain=True) - - # Bad samples. - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period=10, - samples=0, - by_domain=True) - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period=10, - samples=-1, - by_domain=True) - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period=10, - samples='bad', - by_domain=True) - - # Bad domain/url combo. - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period=10, - samples=10, - by_domain=True, - by_url=True) - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period=10, - samples=10, - by_domain=False, - by_url=False) - - # Bad rate. - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period=10, - samples=10, - rate=-1, - by_domain=True) - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period=10, - samples=10, - rate=1.1, - by_domain=True) - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period=10, - samples=10, - rate='bad', - by_domain=True) - - # Bad tolerance. - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period=10, - samples=10, - tolerance=-1, - by_domain=True) - self.assertRaises( - dos.ConfigError, - dos.ReservoirConfig, - 'my name', - period=10, - samples=10, - tolerance='bad', - by_domain=True) - - def testSampleProfile(self): - """Profiles the sample method with lots of data.""" - print 'Tracked objects start',len(gc.get_objects()) - config = dos.ReservoirConfig( - 'testing', - period=10, - rate=1, - samples=10000, - by_domain=True) - sampler = dos.MultiSampler([config]) - reporter = dos.Reporter() - fake_urls = ['http://example-%s.com/meep' % i - for i in xrange(100)] - for i in xrange(100000): - reporter.set(random.choice(fake_urls), config, random.randint(0, 10000)) - del fake_urls - gc.collect() - dos._DOMAIN_CACHE.clear() - - gc.disable() - gc.set_debug(gc.DEBUG_STATS | gc.DEBUG_LEAK) - try: - # Swap the two following lines to profile memory vs. CPU - sampler.sample(reporter) - #cProfile.runctx('sampler.sample(reporter)', globals(), locals()) - memcache.flush_all() # Clear the string references - print 'Tracked objects before collection', len(gc.get_objects()) - dos._DOMAIN_CACHE.clear() - del reporter - del sampler - finally: - print 'Unreachable', gc.collect() - print 'Tracked objects after collection', len(gc.get_objects()) - gc.set_debug(0) - gc.enable() - - def testGetProfile(self): - """Profiles the get method when there's lots of data.""" - print 'Tracked objects start',len(gc.get_objects()) - config = dos.ReservoirConfig( - 'testing', - period=10, - rate=1, - samples=10000, - by_domain=True) - sampler = dos.MultiSampler([config]) - reporter = dos.Reporter() - fake_urls = ['http://example-%s.com/meep' % i - for i in xrange(100)] - for i in xrange(100000): - reporter.set(random.choice(fake_urls), config, random.randint(0, 10000)) - del fake_urls - dos._DOMAIN_CACHE.clear() - gc.collect() - sampler.sample(reporter) - - gc.disable() - gc.set_debug(gc.DEBUG_STATS | gc.DEBUG_LEAK) - try: - # Swap the two following lines to profile memory vs. CPU - result = sampler.get(config) - #cProfile.runctx('result = sampler.get(config)', globals(), locals()) - memcache.flush_all() # Clear the string references - print 'Tracked objects before collection', len(gc.get_objects()) - try: - del locals()['result'] - del result - except: - pass - dos._DOMAIN_CACHE.clear() - del reporter - del sampler - finally: - print 'Unreachable', gc.collect() - print 'Tracked objects after collection', len(gc.get_objects()) - gc.set_debug(0) - gc.enable() - -################################################################################ - -class UrlScorerTest(unittest.TestCase): - """Tests for the UrlScorer class.""" - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - self.domain1 = 'mydomain.com' - self.domain2 = 'example.com' - self.domain3 = 'other.com' - self.url1 = 'http://mydomain.com/stuff/meep' - self.url2 = 'http://example.com/some-path?a=b' - self.url3 = 'http://example.com' - self.url4 = 'http://other.com/relative' - self.scorer = dos.UrlScorer( - period=60, - min_requests=1, - max_failure_percentage=0.2, - prefix='test') - - def testConfig(self): - """Tests that the config parameters are sanitized.""" - # Bad periods - self.assertRaises(dos.ConfigError, - dos.UrlScorer, - period=0, - min_requests=1, - max_failure_percentage=0.2, - prefix='test:') - self.assertRaises(dos.ConfigError, - dos.UrlScorer, - period=-1, - min_requests=1, - max_failure_percentage=0.2, - prefix='test:') - self.assertRaises(dos.ConfigError, - dos.UrlScorer, - period='not an int', - min_requests=1, - max_failure_percentage=0.2, - prefix='test:') - - # Bad min_requests - self.assertRaises(dos.ConfigError, - dos.UrlScorer, - period=1, - min_requests='bad', - max_failure_percentage=0.2, - prefix='test:') - self.assertRaises(dos.ConfigError, - dos.UrlScorer, - period=1, - min_requests=-1, - max_failure_percentage=0.2, - prefix='test:') - - # Bad max_failure_percentage - self.assertRaises(dos.ConfigError, - dos.UrlScorer, - period=1, - min_requests=1, - max_failure_percentage='not a float', - prefix='test:') - self.assertRaises(dos.ConfigError, - dos.UrlScorer, - period=1, - min_requests=1, - max_failure_percentage=2, - prefix='test:') - self.assertRaises(dos.ConfigError, - dos.UrlScorer, - period=1, - min_requests=1, - max_failure_percentage=-1, - prefix='test:') - - # Bad prefix - self.assertRaises(dos.ConfigError, - dos.UrlScorer, - period=1, - min_requests=1, - max_failure_percentage=0.2, - prefix='') - self.assertRaises(dos.ConfigError, - dos.UrlScorer, - period=1, - min_requests=1, - max_failure_percentage=0.2, - prefix=123) - - def testReport(self): - """Tests reporting domain status.""" - self.scorer.report( - [self.url1, self.url2], [self.url3, self.url4]) - self.assertEquals(1, memcache.get('scoring:test:success:' + self.domain1)) - self.assertEquals(0, memcache.get('scoring:test:failure:' + self.domain1)) - self.assertEquals(1, memcache.get('scoring:test:success:' + self.domain2)) - self.assertEquals(1, memcache.get('scoring:test:failure:' + self.domain2)) - self.assertEquals(0, memcache.get('scoring:test:success:' + self.domain3)) - self.assertEquals(1, memcache.get('scoring:test:failure:' + self.domain3)) - - self.scorer.report( - [self.url1, self.url2, self.url3, self.url4], []) - self.assertEquals(2, memcache.get('scoring:test:success:' + self.domain1)) - self.assertEquals(0, memcache.get('scoring:test:failure:' + self.domain1)) - self.assertEquals(3, memcache.get('scoring:test:success:' + self.domain2)) - self.assertEquals(1, memcache.get('scoring:test:failure:' + self.domain2)) - self.assertEquals(1, memcache.get('scoring:test:success:' + self.domain3)) - self.assertEquals(1, memcache.get('scoring:test:failure:' + self.domain3)) - - self.scorer.report( - [], [self.url1, self.url2, self.url3, self.url4]) - self.assertEquals(2, memcache.get('scoring:test:success:' + self.domain1)) - self.assertEquals(1, memcache.get('scoring:test:failure:' + self.domain1)) - self.assertEquals(3, memcache.get('scoring:test:success:' + self.domain2)) - self.assertEquals(3, memcache.get('scoring:test:failure:' + self.domain2)) - self.assertEquals(1, memcache.get('scoring:test:success:' + self.domain3)) - self.assertEquals(2, memcache.get('scoring:test:failure:' + self.domain3)) - - def testBelowMinRequests(self): - """Tests when there are enough failures but not enough total requests.""" - memcache.set('scoring:test:success:' + self.domain1, 0) - memcache.set('scoring:test:failure:' + self.domain1, 10) - self.assertEquals( - [(True, 1), (True, 0)], - self.scorer.filter([self.url1, self.url2])) - - def testFailurePrecentageTooLow(self): - """Tests when there are enough requests but too few failures.""" - memcache.set('scoring:test:success:' + self.domain1, 100) - memcache.set('scoring:test:failure:' + self.domain1, 1) - self.assertEquals( - [(True, 1/101.0), (True, 0)], - self.scorer.filter([self.url1, self.url2])) - - def testNotAllowed(self): - """Tests when a result is blocked due to overage.""" - memcache.set('scoring:test:success:' + self.domain1, 100) - memcache.set('scoring:test:failure:' + self.domain1, 30) - self.assertEquals( - [(False, 30/130.0), (True, 0)], - self.scorer.filter([self.url1, self.url2])) - - def testGetScores(self): - """Tests getting the scores of URLs.""" - memcache.set('scoring:test:success:' + self.domain1, 2) - memcache.set('scoring:test:failure:' + self.domain1, 1) - memcache.set('scoring:test:success:' + self.domain2, 3) - memcache.set('scoring:test:failure:' + self.domain2, 3) - memcache.set('scoring:test:success:' + self.domain3, 1) - memcache.set('scoring:test:failure:' + self.domain3, 2) - self.assertEquals( - [(2, 1), (3, 3), (1, 2)], - self.scorer.get_scores([self.url1, self.url2, self.url4])) - - def testBlackhole(self): - """Tests blackholing a URL.""" - self.assertEquals( - [(True, 0), (True, 0)], - self.scorer.filter([self.url1, self.url2])) - self.scorer.blackhole([self.url1, self.url2]) - self.assertEquals( - [(False, 1.0), (False, 1.0)], - self.scorer.filter([self.url1, self.url2])) - -################################################################################ - -if __name__ == '__main__': - unittest.main() diff --git a/hub/event_details.html b/hub/event_details.html deleted file mode 100644 index 9264a81..0000000 --- a/hub/event_details.html +++ /dev/null @@ -1,105 +0,0 @@ - - - Hub - Subscription Details - {{topic_url|escape}} - - - - - -

Subscription Details - {{topic_url|escape}}

- -{% if error %} -
{{error|escape}}
-{% else %} - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
Callback URL:{{callback_url|escape}}
Created time (UTC):{{created_time|date:"Y-m-d\TH:i:s\Z"}}
Last modified time (UTC):{{last_modified|date:"Y-m-d\TH:i:s\Z"}}
Expiration time (UTC):{{expiration_time|date:"Y-m-d\TH:i:s\Z"}}
State:{{subscription_state}}
Confirmation failures:{{confirm_failures}}
Delivery to domain: - {% if delivery_blocked %} - BLOCKED - {% else %} - OK - {% endif %} -
Delivery short-term:{{delivery_errors|floatformat:"-2"}}% errors
- -

Error rate statistics

-{% for result in delivery_url_error %} - {% include "stats_table.html" %} -{% endfor %} -{% for result in delivery_domain_error %} - {% include "stats_table.html" %} -{% endfor %} - -

Latency statistics

-{% for result in delivery_url_latency %} - {% include "stats_table.html" %} -{% endfor %} -{% for result in delivery_domain_latency %} - {% include "stats_table.html" %} -{% endfor %} - -{% for event in failed_events %} -
-

Failure {{forloop.counter}}

-

- - - - - - - - - - - - - - - - - -
Next/Last attempt time (UTC):{{event.last_modified|date:"Y-m-d\TH:i:s\Z"}}
Totally failed:{{event.totally_failed}}
Retry attempts:{{event.retry_attempts}}
Content type:{{event.content_type|escape}}
- -

Payload, possibly truncated:

-
-{{event.payload_trunc|escape}}
-
-

-{% endfor %} - -{% endif %} - - - - diff --git a/hub/favicon.ico b/hub/favicon.ico deleted file mode 100644 index c42ce2422eb479276ce234ce7d712a223e2845d6..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 1406 zcmeIyyDx)L7{~GFZB^@Dw<>jMOQ~wL?k!5sX0b4vL>Mg+iJ7qYI}9cfgH1$OM8ae+ zFbI=GA|WpIJ(0#SSgiWI`JDIsp7$NjIl~dLc-(GbbjgB4#3LeM&=Nm%|JTZ9#ey9U zIN^a8J_Ha%2oXdPLmWw@Fo8)-VHz`-#T@3bh$Spz1*=%YIySJ0Eo@^4yV%1%4seJg z9ODG1IKw$EaEU8i;|905!#y7Gh$lSb1+RF+J3f#_zVavVA5TD0V?!PO=C*;fo-38< zYj9dz8V+wyM#pez?p%sO<4PrryQDCxMyqmP^}AxY%VuV)y~&Is_4;lys=CeyOltx^ zvoBs?Hf){gS~FLUsNRzAhAYm3yWOl_msK9o8&HESWp)u;abv$uR3?>Z4aSmeMyan~ H|2}>K#$&tD diff --git a/hub/feed_diff.py b/hub/feed_diff.py deleted file mode 100755 index b9c7f97..0000000 --- a/hub/feed_diff.py +++ /dev/null @@ -1,258 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2008 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -__author__ = 'bslatkin@gmail.com (Brett Slatkin)' - -"""Atom/RSS feed parser that quickly extracts entry/item elements.""" - -import cStringIO -import logging -import xml.sax -import xml.sax.handler -import xml.sax.saxutils - - -# Set to true to see stack level messages and other debugging information. -DEBUG = False - - -class Error(Exception): - """Exception for errors in this module.""" - - -class TrivialEntityResolver(xml.sax.handler.EntityResolver): - """Pass-through entity resolver.""" - - def resolveEntity(self, publicId, systemId): - return cStringIO.StringIO() - - -class FeedContentHandler(xml.sax.handler.ContentHandler): - """Sax content handler for quickly parsing Atom and RSS feeds.""" - - def __init__(self, parser): - """Initializer. - - Args: - parser: Instance of the xml.sax parser being used with this handler. - """ - self.enclosing_tag = "" - self.parser = parser - self.header_footer = "" - self.entries_map = {} - - # Internal state - self.stack_level = 0 - self.output_stack = [] - self.current_level = None - self.last_id = '' - self.last_link = '' - self.last_title = '' - self.last_description = '' - - # Helper methods - def emit(self, data): - if type(data) is list: - self.current_level.extend(data) - else: - self.current_level.append(data) - - def push(self): - self.current_level = [] - self.output_stack.append(self.current_level) - - def pop(self): - old_level = self.output_stack.pop() - if len(self.output_stack) > 0: - self.current_level = self.output_stack[-1] - else: - self.current_level = None - return old_level - - # SAX methods - def startElement(self, name, attrs): - self.stack_level += 1 - event = (self.stack_level, name) - if DEBUG: logging.debug('Start stack level %r', event) - if self.stack_level == 1: - # Save the outermost tag for later. - self.enclosing_tag = name.lower() - - self.push() - self.emit(['<', name]) - for key, value in attrs.items(): - self.emit([' ', key, '=', xml.sax.saxutils.quoteattr(value)]) - # Do not emit a '>' here because this tag may need to be immediately - # closed with a '/> ending. - - self.push() - - def endElement(self, name): - event = (self.stack_level, name) - if DEBUG: logging.debug('End stack level %r', event) - - content = self.pop() - if content: - self.emit('>') - self.emit(content) - self.emit(['']) - else: - # No content means this element should be immediately closed. - self.emit('/>') - - self.handleEvent(event, content) - self.stack_level -= 1 - - def characters(self, content): - # The SAX parser will try to escape XML entities (like &) and other - # fun stuff. But this is not what we actually want. We want the original - # content to be reproduced exactly as we received it, so we can pass it - # along to others. The reason is simple: reformatting the XML by unescaping - # certain data may cause the resulting XML to no longer validate. - self.emit(xml.sax.saxutils.escape(content)) - - -def strip_whitespace(enclosing_tag, all_parts): - """Strips the whitespace from a SAX parser list for a feed. - - Args: - enclosing_tag: The enclosing tag of the feed. - all_parts: List of SAX parser elements. - - Returns: - header_footer for those parts with trailing whitespace removed. - """ - if 'feed' in enclosing_tag: - first_part = ''.join(all_parts[:-3]).strip('\n\r\t ') - return '%s\n' % (first_part, enclosing_tag) - else: - first_part = ''.join(all_parts[:-3]).strip('\n\r\t ') - channel_part = first_part.rfind('') - if channel_part == -1: - raise Error('Could not find after trimming whitespace') - stripped = first_part[:channel_part].strip('\n\r\t ') - return '%s\n\n' % (stripped, enclosing_tag) - - -class AtomFeedHandler(FeedContentHandler): - """Sax content handler for Atom feeds.""" - - def handleEvent(self, event, content): - depth, tag = event[0], event[1].lower() - if depth == 1: - if tag != 'feed' and not tag.endswith(':feed'): - raise Error('Enclosing tag is not . Found: %r' % tag) - else: - self.header_footer = strip_whitespace(event[1], self.pop()) - elif depth == 2 and (tag == 'entry' or tag.endswith(':entry')): - self.entries_map[self.last_id] = ''.join(self.pop()) - elif depth == 3 and (tag == 'id' or tag.endswith(':id')): - self.last_id = ''.join(content).strip() - self.emit(self.pop()) - else: - self.emit(self.pop()) - - -class RssFeedHandler(FeedContentHandler): - """Sax content handler for RSS feeds.""" - - def handleEvent(self, event, content): - depth, tag = event[0], event[1].lower() - if depth == 1: - if (tag != 'rss' and not tag.endswith(':rss') - and tag != 'rdf' and not tag.endswith(':rdf')): - raise Error('Enclosing tag is not or . ' - 'Found: %r' % tag) - else: - self.header_footer = strip_whitespace(event[1], self.pop()) - elif (tag == 'item' or tag.endswith(':item')) and ( - depth == 3 or (depth == 2 and 'rdf' in self.enclosing_tag)): - item_id = (self.last_id or self.last_link or - self.last_title or self.last_description) - self.entries_map[item_id] = ''.join(self.pop()) - self.last_id, self.last_link, self.last_title, self.last_description = ( - '', '', '', '') - elif (tag == 'guid' or tag.endswith(':guid')) and ( - depth == 4 or (depth == 3 and 'rdf' in self.enclosing_tag)): - self.last_id = ''.join(content).strip() - self.emit(self.pop()) - elif (tag == 'link' or tag.endswith(':link')) and ( - depth == 4 or (depth == 3 and 'rdf' in self.enclosing_tag)): - self.last_link = ''.join(content).strip() - self.emit(self.pop()) - elif (tag == 'title' or tag.endswith(':title')) and ( - depth == 4 or (depth == 3 and 'rdf' in self.enclosing_tag)): - self.last_title = ''.join(content).strip() - self.emit(self.pop()) - elif (tag == 'description' or tag.endswith(':description')) and ( - depth == 4 or (depth == 3 and 'rdf' in self.enclosing_tag)): - self.last_description = ''.join(content).strip() - self.emit(self.pop()) - else: - self.emit(self.pop()) - - -def filter(data, format): - """Filter a feed through the parser. - - Args: - data: String containing the data of the XML feed to parse. - format: String naming the format of the data. Should be 'rss' or 'atom'. - - Returns: - Tuple (header_footer, entries_map) where: - header_footer: String containing everything else in the feed document - that is specifically *not* an or . - entries_map: Dictionary mapping entry_id to the entry's XML data. - - Raises: - xml.sax.SAXException on parse errors. feed_diff.Error if the diff could not - be derived due to bad content (e.g., a good XML doc that is not Atom or RSS) - or any of the feed entries are missing required fields. - """ - data_stream = cStringIO.StringIO(data) - parser = xml.sax.make_parser() - - if format == 'atom': - handler = AtomFeedHandler(parser) - elif format == 'rss': - handler = RssFeedHandler(parser) - else: - raise Error('Invalid feed format "%s"' % format) - - parser.setContentHandler(handler) - parser.setEntityResolver(TrivialEntityResolver()) - # NOTE: Would like to enable these options, but expat (which is all App Engine - # gives us) cannot report the QName of namespace prefixes. Thus, we have to - # work around this to preserve the document's original namespacing. - # parser.setFeature(xml.sax.handler.feature_namespaces, 1) - # parser.setFeature(xml.sax.handler.feature_namespace_prefixes, 1) - try: - parser.parse(data_stream) - except IOError, e: - raise Error('Encountered IOError while parsing: %s' % e) - - for entry_id, content in handler.entries_map.iteritems(): - if format == 'atom' and not entry_id: - raise Error(' element missing : %s' % content) - elif format == 'rss' and not entry_id: - raise Error(' element missing or : %s' % content) - - return handler.header_footer, handler.entries_map - - -__all__ = ['filter', 'DEBUG', 'Error'] diff --git a/hub/feed_diff_test.py b/hub/feed_diff_test.py deleted file mode 100755 index 7a20130..0000000 --- a/hub/feed_diff_test.py +++ /dev/null @@ -1,331 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2008 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -__author__ = 'bslatkin@gmail.com (Brett Slatkin)' - -"""Tests for the feed_diff module.""" - -import logging -import os -import unittest - -import feed_diff - - -class TestBase(unittest.TestCase): - - format = None - feed_open = None - feed_close = None - entry_open = None - entry_close = None - - def setUp(self): - self.testdata = os.path.join(os.path.dirname(__file__), - 'feed_diff_testdata') - - def verify_entries(self, expected_list, entries): - found_entries = sorted(entries.items()) - self.assertEqual(len(expected_list), len(found_entries)) - for index, (expected_key, found) in enumerate( - zip(expected_list, found_entries)): - found_key, found_content = found - self.assertEqual(expected_key, found_key, - "Fail on index %d: Expected %r, found %r" % ( - index, expected_key, found_key)) - self.assertTrue(found_content.startswith(self.entry_open)) - self.assertTrue(found_content.endswith(self.entry_close)) - - def load_feed(self, path): - data = open(os.path.join(self.testdata, path)).read() - header_footer, entries = feed_diff.filter(data, self.format) - self.assertTrue(header_footer.startswith(self.feed_open)) - self.assertTrue(header_footer.endswith(self.feed_close)) - return header_footer, entries - - -class AtomFeedDiffTest(TestBase): - - format = 'atom' - feed_open = '\n')) - # Verify preservation of '/>' closings. - self.assertTrue('' in header_footer) - - def testEntityEscaping(self): - """Tests when certain external entities show up in the feed. - - Example: '&nbsp' will be converted to ' ' by the parser, but then - the new output entity won't be resolved. - """ - header_footer, entries = self.load_feed('entity_escaping.xml') - self.assertTrue(''' not in header_footer) - entity_id, content = entries.items()[0] - self.assertTrue('&nbsp;' in content) - - def testAttributeEscaping(self): - """Tests when certain external entities show up in an XML attribute. - - Example: gd:foo=""blah"" will be converted to - gd:foo=""blah"" by the parser, which is not valid XML when reconstructing - the result. - """ - header_footer, entries = self.load_feed('attribute_escaping.xml') - self.assertTrue('foo:myattribute=""\'foobar\'""' in header_footer) - - def testInvalidFeed(self): - """Tests when the feed is not a valid Atom document.""" - data = open(os.path.join(self.testdata, 'bad_atom_feed.xml')).read() - try: - feed_diff.filter(data, 'atom') - except feed_diff.Error, e: - self.assertTrue('Enclosing tag is not ' in str(e)) - else: - self.fail() - - def testNoXmlHeader(self): - """Tests that feeds with no XML header are accepted.""" - data = open(os.path.join(self.testdata, 'no_xml_header.xml')).read() - header_footer, entries = feed_diff.filter(data, 'atom') - self.assertEquals(1, len(entries)) - - def testMissingId(self): - """Tests when an Atom entry is missing its ID field.""" - data = open(os.path.join(self.testdata, 'missing_entry_id.xml')).read() - try: - feed_diff.filter(data, 'atom') - except feed_diff.Error, e: - self.assertTrue(' element missing ' in str(e)) - else: - self.fail() - - def testFailsOnRss(self): - """Tests that parsing an RSS feed as Atom will fail.""" - data = open(os.path.join(self.testdata, 'rss2sample.xml')).read() - try: - feed_diff.filter(data, 'atom') - except feed_diff.Error, e: - self.assertTrue('Enclosing tag is not ' in str(e)) - else: - self.fail() - - def testCData(self): - """Tests a feed that has a CData section.""" - data = open(os.path.join(self.testdata, 'cdata_test.xml')).read() - header_footer, entries = feed_diff.filter(data, 'atom') - expected_list = [ - u'tag:blog.livedoor.jp,2010:coupon_123.1635380' - ] - self.verify_entries(expected_list, entries) - self.assertTrue( - ('livedoor Blog') - in header_footer) - entry_data = entries['tag:blog.livedoor.jp,2010:coupon_123.1635380'] - # Here the CData section is rewritten. - self.assertTrue('</FONT>' in entry_data) - - -class AtomNamespacedFeedDiffTest(TestBase): - - format = 'atom' - feed_open = '')) - expected_list = [ - u'http://example.com/feeds/delta/124', - u'http://example.com/feeds/delta/125' - ] - self.verify_entries(expected_list, entries) - - -class RssFeedDiffTest(TestBase): - - format = 'rss' - feed_open = '\n\n')) - # Verify preservation of '/>' closings. - self.assertTrue('' in header_footer) - - def testParsingRss091(self): - """Tests parsing RSS 0.91.""" - header_footer, entries = self.load_feed('sampleRss091.xml') - expected_list = [ - u'http://writetheweb.com/read.php?item=19', - u'http://writetheweb.com/read.php?item=20', - u'http://writetheweb.com/read.php?item=21', - u'http://writetheweb.com/read.php?item=22', - u'http://writetheweb.com/read.php?item=23', - u'http://writetheweb.com/read.php?item=24', - ] - self.verify_entries(expected_list, entries) - - def testParsingRss092(self): - """Tests parsing RSS 0.92 with enclosures and only descriptions.""" - header_footer, entries = self.load_feed('sampleRss092.xml') - expected_list = [ - u'<a href="http://arts.ucsc.edu/GDead/AGDL/other1.html">The Other One</a>, live instrumental, One From The Vault. Very rhythmic very spacy, you can listen to it many times, and enjoy something new every time.', - u'<a href="http://www.cs.cmu.edu/~mleone/gdead/dead-lyrics/Franklin\'s_Tower.txt">Franklin\'s Tower</a>, a live version from One From The Vault.', - u'<a href="http://www.scripting.com/mp3s/youWinAgain.mp3">The news is out</a>, all over town..<p>\nYou\'ve been seen, out runnin round. <p>\nThe lyrics are <a href="http://www.cs.cmu.edu/~mleone/gdead/dead-lyrics/You_Win_Again.txt">here</a>, short and sweet. <p>\n<i>You win again!</i>', - u"It's been a few days since I added a song to the Grateful Dead channel. Now that there are all these new Radio users, many of whom are tuned into this channel (it's #16 on the hotlist of upstreaming Radio users, there's no way of knowing how many non-upstreaming users are subscribing, have to do something about this..). Anyway, tonight's song is a live version of Weather Report Suite from Dick's Picks Volume 7. It's wistful music. Of course a beautiful song, oft-quoted here on Scripting News. <i>A little change, the wind and rain.</i>", - u'Kevin Drennan started a <a href="http://deadend.editthispage.com/">Grateful Dead Weblog</a>. Hey it\'s cool, he even has a <a href="http://deadend.editthispage.com/directory/61">directory</a>. <i>A Frontier 7 feature.</i>', - u'Moshe Weitzman says Shakedown Street is what I\'m lookin for for tonight. I\'m listening right now. It\'s one of my favorites. "Don\'t tell me this town ain\'t got no heart." Too bright. I like the jazziness of Weather Report Suite. Dreamy and soft. How about The Other One? "Spanish lady come to me.."', - u'The HTML rendering almost <a href="http://validator.w3.org/check/referer">validates</a>. Close. Hey I wonder if anyone has ever published a style guide for ALT attributes on images? What are you supposed to say in the ALT attribute? I sure don\'t know. If you\'re blind send me an email if u cn rd ths.', - u'This is a test of a change I just made. Still diggin..', - ] - self.verify_entries(expected_list, entries) - - def testOnlyLink(self): - """Tests when an RSS item only has a link element.""" - header_footer, entries = self.load_feed('rss2_only_link.xml') - expected_list = [ - u'http://liftoff.msfc.nasa.gov/news/2003/news-VASIMR.asp', - u'http://liftoff.msfc.nasa.gov/news/2003/news-laundry.asp', - u'http://liftoff.msfc.nasa.gov/news/2003/news-starcity.asp', - ] - self.verify_entries(expected_list, entries) - - def testOnlyTitle(self): - """Tests when an RSS item only has a title element.""" - header_footer, entries = self.load_feed('rss2_only_title.xml') - expected_list = [ - u"Astronauts' Dirty Laundry", - u'Star City', - u'The Engine That Does More', - ] - self.verify_entries(expected_list, entries) - - def testFailsOnAtom(self): - """Tests that parsing an Atom feed as RSS will fail.""" - data = open(os.path.join(self.testdata, 'parsing.xml')).read() - try: - feed_diff.filter(data, 'rss') - except feed_diff.Error, e: - self.assertTrue('Enclosing tag is not ' in str(e)) - else: - self.fail() - - -class RssRdfFeedDiffTest(TestBase): - - format = 'rss' - feed_open = '')) - self.verify_entries(expected_list, entries) - - -class FilterTest(TestBase): - - format = 'atom' - - def testEntities(self): - """Tests that external entities cause parsing to fail.""" - try: - self.load_feed('xhtml_entities.xml') - self.fail('Should have raised an exception') - except feed_diff.Error, e: - # TODO(bslatkin): Fix this datafile in head. - # This ensures that hte failure is because of bad entities, not a - # missing test data file. - self.assertFalse('IOError' in str(e)) - - -if __name__ == '__main__': - ## feed_diff.DEBUG = True - ## logging.getLogger().setLevel(logging.DEBUG) - unittest.main() diff --git a/hub/feed_diff_testdata/atom_namespace.xml b/hub/feed_diff_testdata/atom_namespace.xml deleted file mode 100644 index b9e40df..0000000 --- a/hub/feed_diff_testdata/atom_namespace.xml +++ /dev/null @@ -1,60 +0,0 @@ - - - http://example.com/feeds/delta - - - foo@example.com - - http://example.com/feeds/delta/125 - - 2010-03-16T09:13:48.224281Z - paho.org/HealthC_ID/1115006 - 2010-03-12T12:12:12Z - - - - - Foo Hospital - - - - - 45.256 -71.92 - - - 2010-03-12T12:12:12Z - - - - - - bar@example.com - - http://example.com/feeds/delta/124 - - 2010-03-16T09:13:20.073577Z - paho.org/HealthC_ID/1115006 - 2010-03-01T01:02:03Z - - - - - Foo Hospital - - - - - true - - false - - 2010-03-15T23:43:52.183786Z - - - - diff --git a/hub/feed_diff_testdata/atom_no_id.xml b/hub/feed_diff_testdata/atom_no_id.xml deleted file mode 100644 index 6e6d4c3..0000000 --- a/hub/feed_diff_testdata/atom_no_id.xml +++ /dev/null @@ -1,29 +0,0 @@ - - - -dive into mark -everything old is new again -2008-08-23T04:49:22Z - - - - - -Mark -http://diveintomark.org/ - -<![CDATA[The ampersands of Linux]]> - -tag:diveintomark.org,2008-08-14:/archives/20080814215936 -2008-08-14T23:08:54Z -2008-08-14T21:59:36Z -Please try to contain your excitement. -<p>Taking an idea from <a href="http://www.simplebits.com/notebook/2008/08/14/ampersands.html">Use the Best Available Ampersand</a> and a list of pre-installed fonts from the <a href="http://www.apaddedcell.com/web-fonts">Complete Guide to Pre-Installed Fonts in Linux, Mac, and Windows</a>, I present &#8220;The Ampersands of Linux&#8221;:</p> - -<p><img src="http://wearehugh.com/public/2008/08/ampersands-of-linux3.png" alt="[ampersands in 28 fonts]" height="900" width="600"></p> - -<p>(<a href="http://wearehugh.com/public/2008/08/ampersands-of-linux.html"><abbr>HTML</abbr></a>)</p> - -<p>Please try to contain your excitement.</p> - - diff --git a/hub/feed_diff_testdata/attribute_escaping.xml b/hub/feed_diff_testdata/attribute_escaping.xml deleted file mode 100644 index ea52571..0000000 --- a/hub/feed_diff_testdata/attribute_escaping.xml +++ /dev/null @@ -1,19 +0,0 @@ - - - Foo Bar has a blog - - 2008-10-01T06:57:56Z - - Foo Bar - - http://www.foo.com/ - - - My feed - http://www.foo.com/1 - 2008-10-01T06:57:56Z - - some detail here &nbsp; - - - diff --git a/hub/feed_diff_testdata/bad_atom_feed.xml b/hub/feed_diff_testdata/bad_atom_feed.xml deleted file mode 100644 index aff0906..0000000 --- a/hub/feed_diff_testdata/bad_atom_feed.xml +++ /dev/null @@ -1,19 +0,0 @@ - - - Foo Bar's blog - - 2008-10-01T06:57:56Z - - Foo Bar - - http://www.foo.com/ - - - My feed - http://www.foo.com/1 - 2008-10-01T06:57:56Z - - some detail here &nbsp; - - - diff --git a/hub/feed_diff_testdata/bad_feed.xml b/hub/feed_diff_testdata/bad_feed.xml deleted file mode 100644 index 6b77920..0000000 --- a/hub/feed_diff_testdata/bad_feed.xml +++ /dev/null @@ -1 +0,0 @@ - diff --git a/hub/feed_diff_testdata/cdata_test.xml b/hub/feed_diff_testdata/cdata_test.xml deleted file mode 100644 index 48ab6a5..0000000 --- a/hub/feed_diff_testdata/cdata_test.xml +++ /dev/null @@ -1,47 +0,0 @@ - - -お得なクーポン情報 - - - - -2010-11-16T07:09:01Z - -tag:blog.livedoor.jp,2010:coupon_123 - -coupon_123 - - -livedoor Blog -Copyright (c) 2010, coupon_123 - -りんね【マッサージ・鍼灸院】のクーポン情報！⇒⇒クーポンをお持ちの方アロマコース10％オフ - -2010-11-15T22:08:57Z -2010-11-16T07:08:57+09:00 -tag:blog.livedoor.jp,2010:coupon_123.1635380 - -　★お得情報一覧はこちら - -東京都豊島区東池袋1丁目46-13ホリグチビル１Ｆ 営業：11：00～21：00&nbsp; 定休：毎週日曜日定休 - -クーポンをお持ちの方アロマコース10％オフ - -http://www.toshimaku-town.com/coupon/ts026964 - - - -
-　★お得情報一覧はこちら
-
-東京都豊島区東池袋1丁目46-13ホリグチビル１Ｆ 営業：11：00～21：00  定休：毎週日曜日定休
-
-クーポンをお持ちの方アロマコース10％オフ
-
-http://www.toshimaku-town.com/coupon/ts026964
]]> - - -coupon_123 - - - diff --git a/hub/feed_diff_testdata/entity_escaping.xml b/hub/feed_diff_testdata/entity_escaping.xml deleted file mode 100644 index d939948..0000000 --- a/hub/feed_diff_testdata/entity_escaping.xml +++ /dev/null @@ -1,19 +0,0 @@ - - - Foo Bar's blog - - 2008-10-01T06:57:56Z - - Foo Bar - - http://www.foo.com/ - - - My feed - http://www.foo.com/1 - 2008-10-01T06:57:56Z - - some detail here &nbsp; - - - diff --git a/hub/feed_diff_testdata/missing_entry_id.xml b/hub/feed_diff_testdata/missing_entry_id.xml deleted file mode 100644 index b6cb516..0000000 --- a/hub/feed_diff_testdata/missing_entry_id.xml +++ /dev/null @@ -1,18 +0,0 @@ - - - Foo Bar's blog - - 2008-10-01T06:57:56Z - - Foo Bar - - http://www.foo.com/ - - - My feed - 2008-10-01T06:57:56Z - - some detail here &nbsp; - - - diff --git a/hub/feed_diff_testdata/no_xml_header.xml b/hub/feed_diff_testdata/no_xml_header.xml deleted file mode 100644 index f0a4d27..0000000 --- a/hub/feed_diff_testdata/no_xml_header.xml +++ /dev/null @@ -1,18 +0,0 @@ - - Foo Bar's blog - - 2008-10-01T06:57:56Z - - Foo Bar - - http://www.foo.com/ - - - My feed - http://www.foo.com/1 - 2008-10-01T06:57:56Z - - some detail here &nbsp; - - - diff --git a/hub/feed_diff_testdata/parsing.xml b/hub/feed_diff_testdata/parsing.xml deleted file mode 100644 index fd941b7..0000000 --- a/hub/feed_diff_testdata/parsing.xml +++ /dev/null @@ -1,348 +0,0 @@ - - - -dive into mark -everything old is new again -tag:diveintomark.org,2001-07-29:/ -2008-08-23T04:49:22Z - - -Subscribe with My Yahoo!Subscribe with NewsGatorSubscribe with My AOLSubscribe with RojoSubscribe with BloglinesSubscribe with NetvibesSubscribe with GoogleSubscribe with PageflakesMu. <h1>Mu.</h1> Mu. - -Mark -http://diveintomark.org/ - -<![CDATA[The ampersands of Linux]]> - -tag:diveintomark.org,2008-08-14:/archives/20080814215936 -2008-08-14T23:08:54Z -2008-08-14T21:59:36Z -Please try to contain your excitement. -<p>Taking an idea from <a href="http://www.simplebits.com/notebook/2008/08/14/ampersands.html">Use the Best Available Ampersand</a> and a list of pre-installed fonts from the <a href="http://www.apaddedcell.com/web-fonts">Complete Guide to Pre-Installed Fonts in Linux, Mac, and Windows</a>, I present &#8220;The Ampersands of Linux&#8221;:</p> - -<p><img src="http://wearehugh.com/public/2008/08/ampersands-of-linux3.png" alt="[ampersands in 28 fonts]" height="900" width="600"></p> - -<p>(<a href="http://wearehugh.com/public/2008/08/ampersands-of-linux.html"><abbr>HTML</abbr></a>)</p> - -<p>Please try to contain your excitement.</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[Hello darkness my old friend]]> - -tag:diveintomark.org,2008-08-12:/archives/20080812160843 -2008-08-12T16:08:43Z -2008-08-12T16:08:43Z -Nobody still gives a shit about freedom 0. -<div class="punch" style="width:300px"> -<img src="http://wearehugh.com/public/2008/08/crow.jpg" alt="[crow and moon]" title="" width="300" height="300"> -<p><a href="http://flickr.com/photos/luchilu/2414457426/">The bird and the moon II</a> &copy;&nbsp;<a href="http://flickr.com/people/luchilu/">Luz A. Villa</a> / <a title="used under Creative Commons Attribution 2.0 License" href="http://creativecommons.org/licenses/by/2.0/">CC</a></p> -</div> - -<p>My parents <a href="http://diveintomark.org/archives/2008/01/04/my-parents-desktop">gave up on Linux</a> and bought a Mac Mini. We bought an AppleTV for the kids and <a href="http://handbrake.fr/">filled it with their favorite DVDs</a>. I stood in line for three hours to buy my wife an iPhone 3G for her birthday. And <a href="http://diveintomark.org/archives/2008/01/17/of-canaries-and-coal-mines">nobody gives a shit</a> about freedom 0.</p> - -<p>Discuss.</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[A very serious question]]> - -tag:diveintomark.org,2008-08-07:/archives/20080807233337 -2008-08-12T01:23:03Z -2008-08-07T23:33:37Z -So, hypothetically speaking, let&#8217;s say you want to design a system where you had absolute control over which applications your customers were allowed to install on your device. Certainly you would want to ensure that you were the only source for applications. But for extraordinary cases, you might also need to create a [...] -<p>So, hypothetically speaking, let&#8217;s say you want to design a system where you had <a href="http://www.mikeash.com/?page=pyblog/welcome-to-iphone-your-crappy-mac-of-tomorrow-today.html">absolute control</a> over which applications your customers were allowed to install on <a href="http://www.russellbeattie.com/blog/iphone-reconciliation">your device</a>. Certainly you would want to <a href="http://blogs.oreilly.com/iphone/2008/07/one-little-article.html">ensure that you were the only source for applications</a>. But for extraordinary cases, you might also need to create <a href="http://arstechnica.com/journals/apple.ars/2008/08/07/the-goings-on-behind-the-iphone-application-blacklist">a blacklist of applications</a>.</p> - -<p>Each entry in the blacklist would also need a human-readable <b>title</b> &#8212; presumably the name of the app &#8212; and perhaps even a human-readable <b>description</b> to explain why the app was blacklisted. But each entry would also need a <b>unique identifier</b>, of course, so you don&#8217;t accidentally get confused between six apps named &#8220;TODO.&#8221; Finally, you would probably want to include the <b>date</b> that the entry was added to the list.</p> - -<p>Furthermore, since you anticipate <a href="http://www.wsu.edu/~brians/errors/continual.html">continually</a> <a href="http://www.macrumors.com/2008/08/01/netshare-tethering-app-reappears-on-app-store/">adding</a> <a href="http://forums.macrumors.com/showpost.php?p=5953784&amp;postcount=24">new</a> <a href="http://www.alleyinsider.com/2008/8/worthless-1000-i-am-rich-iphone-app-disappears">applications</a> to this blacklist to <a href="http://diveintomark.org/archives/2007/10/16/oh-good-grief#comment-10497">protect your and your partners&#8217; business model</a>, you would need your proprietary <a href="http://earthlingsoft.net/ssp/blog/2006/10/itunes_store_sucks">non-browser-based</a> client to <a href="http://www.appleinsider.com/articles/08/08/06/researcher_discovers_long_publicized_iphone_app_kill_switch.html">periodically poll the list for changes</a>.</p> - -<p>All of which raises a very serious question: <b><i>what data format should you use for the list?</i></b></p> - -<p>If you answered <abbr>&#8220;JSON&#8221;</abbr> then congratulations, you <del>win the <a href="https://iphone-services.apple.com/clbl/unauthorizedApps">Trendy Tech of the Month Award</a></del> <a href="http://diveintomark.org/archives/2008/08/07/a-very-serious-question#comment-12525">lose</a>! To collect your prize, please proceed through the door marked &#8220;<a href="http://en.wikipedia.org/wiki/Barnum%27s_American_Museum">This way to the egress</a>.&#8221; Some restrictions apply.</p> - -<p><b>Update</b>: OK, OK, <a href="http://daringfireball.net/2008/08/core_location_blacklist">it&#8217;s a &#8220;Core Location&#8221; blacklist</a>. Big deal. I&#8217;ll see your tree and <a href="http://online.wsj.com/article/SB121842341491928977.html?mod=googlenews_wsj">raise you a forest</a>:</p> - -<blockquote cite="http://online.wsj.com/article/SB121842341491928977.html?mod=googlenews_wsj"> -<p>&#8230; an independent engineer discovered code inside the iPhone that suggested iPhones routinely check an Apple Web site that could, in theory trigger the removal of the undesirable software from the devices.</p> - -<p>Mr. Jobs confirmed such a capability exists, but argued that Apple needs it in case it inadvertently allows a malicious program &#8212; one that stole users&#8217; personal data, for example &#8212; to be distributed to iPhones through the App Store.</p> -</blockquote> - -<p>As <a href="http://diveintomark.org/archives/2007/10/16/oh-good-grief#comment-10497">I&#8217;ve said before</a>, &#8220;protecting users from malicious programs&#8221; is code for &#8220;cryptographically enforcing restrictions on applications to protect our and our partners’ business model.&#8221; The bullshit about &#8220;stealing personal data&#8221; is just a rhetorical sleight of hand, like the <abbr>RIAA</abbr> claiming that piracy hurts &#8220;artists and other rights holders&#8221; when 99% of artists don&#8217;t own the rights to their own songs. How many apps has Apple de-listed over privacy concerns? <a href="http://gizmodo.com/5028459/aurora-feint-iphone-app-delisted-for-lousy-security-practices">Only one that I know of</a>, and it was quickly reinstated after a quick update. How many apps has Apple de-listed (or prevented being written in the first place) to protect their business? <a href="http://gizmodo.com/5027790/why-we-still-need-the-iphone-app-black-market">Lots</a> and <a href="http://lifehacker.com/400148/iphone-20-jailbreak-apps-you-cant-find-in-the-itunes-store">lots</a>.</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[The 4 “B”s]]> - -tag:diveintomark.org,2008-08-07:/archives/20080807025755 -2008-08-07T02:57:55Z -2008-08-07T02:57:55Z -Little boys are so easy. -<div class="punch" style="width:240px"> -<img src="http://wearehugh.com/public/2008/08/blocks.jpg" alt="[colored blocks]" title="" width="240" height="159"> -<p><a href="http://flickr.com/photos/jamoker/1258248356/">prehistoric toys</a> &copy;&nbsp;<a href="http://flickr.com/people/jamoker/">The Jamoker</a> / <a title="used under Creative Commons Attribution 2.0 License" href="http://creativecommons.org/licenses/by/2.0/">CC</a></p> -</div> - -<p>Little boys are so easy. It&#8217;s amazing how many games you can play with nothing but the 4 &#8220;B&#8221;s: blocks, balls, boxes, and bears.</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[Little drummer boy]]> - -tag:diveintomark.org,2008-08-06:/archives/20080806144009 -2008-08-06T14:40:09Z -2008-08-06T14:40:09Z -I never really understood how people found bugs like this... -<div class="punch" style="width:240px"> -<img src="http://wearehugh.com/public/2008/08/snare-drums.jpg" alt="[snare drums]" title="" width="240" height="292"> -<p><a href="http://flickr.com/photos/fayjo/338585382/">Pearl Masters</a> &copy;&nbsp;<a href="http://flickr.com/people/fayjo/">Jeremy Pharo</a> / <a title="used under Creative Commons Attribution 2.0 License" href="http://creativecommons.org/licenses/by/2.0/">CC</a></p> -</div> - -<p>For reasons that are not particularly interesting, I found myself reading <a href="http://www.jwz.org/xscreensaver/faq.html">the XScreensaver <abbr>FAQ</abbr></a> last night, which answers the question, &#8220;<a href="http://www.jwz.org/xscreensaver/faq.html#toolkits">The unlock dialog is funny looking, why not use GTK?</a>&#8221; That led me to JWZ&#8217;s mini-rant <a href="http://www.jwz.org/xscreensaver/toolkits.html">On Toolkits</a>, which reminded me of <a href="http://secunia.com/advisories/9184/">this ancient vulnerability in the OS X screensaver</a> where you could unlock the screen by typing 1280 characters in the password dialog. I remember reading about it at the time, but I never really understood how people found bugs like this until I had kids.</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[Placating people with options]]> - -tag:diveintomark.org,2008-08-05:/archives/20080805155619 -2008-08-05T19:09:22Z -2008-08-05T15:56:19Z -Google Code is -- and has always been -- a tool to fight license proliferation. It is only incidentally useful. -<p><cite>Matthew Paul Thomas</cite>: <a href="http://mpt.net.nz/archive/2008/08/01/free-software-usability">Why Free Software has poor usability, and how to improve it</a>. Many of the problems he lists apply to all software. Here&#8217;s one that&#8217;s been on my mind recently:</p> - -<blockquote cite="http://mpt.net.nz/archive/2008/08/01/free-software-usability"> -<p>10. Placating people with options.</p> -</blockquote> - -<p>In other news, <a href="http://www.linuxtoday.com/news_story.php3?ltsn=2008-08-01-012-35-NW">Google Code blacklists Mozilla Public License</a>. Some <a href="http://redmonk.com/sogrady/2008/08/04/links-for-2008-08-04-deliciouscom/">smart</a> <a href="http://blogs.sun.com/webmink/entry/links_for_2008_08_04">people</a> don&#8217;t seem to understand why Google would &#8220;reduce&#8221; users&#8217; &#8220;choices.&#8221; This is like complaining that the <abbr>GPL</abbr> is too &#8220;political&#8221; to be a software license because it &#8220;restricts&#8221; users&#8217; &#8220;freedom&#8221; to take without giving back. You&#8217;re missing the point; the <abbr>GPL</abbr> is <em>designed</em> to be a political manifesto (cleverly disguised as a software license).</p> - -<p>Another example: my <a href="http://feedparser.org/">Universal Feed Parser</a> was <a href="http://diveintomark.org/archives/2002/08/13/ultraliberal_rss_parser">conceived as a weapon</a> against what I considered the gravest error of XML: <a href="http://diveintomark.org/archives/2004/01/16/draconianism">draconian error handling</a>. Recently, someone asked me to implement a switch that makes it not fall back on lax parsing in the case of an XML wellformedness error. I said no, not because it would be difficult to implement, but because <em>that defeats its entire reason for being</em>.</p> - -<p>Google Project Hosting is &#8212; and has always been &#8212; <a href="http://google-opensource.blogspot.com/2008/05/standing-against-license-proliferation.html">a tool to fight license proliferation</a>. It is only incidentally useful.</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[Weblogs: content w/o context, collaboration, capital, or coruscation]]> - -tag:diveintomark.org,2008-08-05:/archives/20080805020410 -2008-08-05T02:04:10Z -2008-08-05T02:04:10Z -A response to danah boyd. -<p>On her weblog, danah boyd writes:</p> - -<blockquote cite="http://www.zephoria.org/thoughts/archives/2008/08/01/knol_content_wo.html"> -<p>[Compared to Wikipedia,] weblogs take an entirely opposite approach to knowledge production. A weblog&#8217;s entire structure is built around single authors, control and individualism. There aren&#8217;t even mechanisms for multiple authors and the tools available for collaboration are extremely limited. &#8220;Collaboration&#8221; still assumes a primary author.</p> - -<p>&#8230; Weblogs are quickly becoming a &#8220;unit of spam&#8221; instead of a unit of knowledge. Y&#8217;see - a system that is driven by individualism quickly becomes a tool for self-promoters.</p> - -<p>&#8230; Frankly, from my POV, weblogs look like an abysmal failure. There&#8217;s no life to the content. Already articles are being forgotten and left to rot, along with a lot of other web content. There&#8217;s no common format or standards and there&#8217;s a lot more crap than gems.</p> -</blockquote> - -<p>Oops, no, I&#8217;m sorry. She was <a href="http://www.zephoria.org/thoughts/archives/2008/08/01/knol_content_wo.html">talking about Google Knol</a>. My bad.</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[HOWTO feed medication to your dog]]> - -tag:diveintomark.org,2008-07-29:/archives/20080729021401 -2008-08-01T00:05:25Z -2008-07-29T02:14:01Z -I'm told that peanut butter also works. -<ol style="list-style:none;margin-left:0;padding-left:0"> -<li><p>Take a quarter slice of American cheese.</p> -<p><img src="http://wearehugh.com/public/2008/07/01-cheese.jpg" alt="[cheese slice in hand]" width="640" height="188"></p></li> -<li><p>Roll the cheese into a ball and insert the pills.</p> -<p><img src="http://wearehugh.com/public/2008/07/02-pills.jpg" alt="[cheese ball with pills inside]" width="640" height="188"></p></li> -<li><p>Feed the cheese ball to your dog.</p> -<p><img src="http://wearehugh.com/public/2008/07/03-feed.jpg" alt="[feeding the cheese to the dog]" width="640" height="188"></p></li> -</ol> - -<p>I&#8217;m told that peanut butter also works, but it&#8217;s messier.</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[A helluva thing]]> - -tag:diveintomark.org,2008-07-23:/archives/20080723030709 -2008-07-23T16:55:41Z -2008-07-23T03:07:09Z -Timothy McVeigh blew up a building and killed 168 people. What did we give him? A trial. -<p>It&#8217;s a helluva thing, a trial by jury. It was a radical notion 200 years ago, and it&#8217;s still a radical notion today.</p> - -<p>I served on a jury once. Getting called for jury duty sucks, because most of the time you just sit in the jury lounge all day and then go home. But actually serving on a jury is a totally different thing. I think everyone should experience it at least once. In one sense, it&#8217;s just like you see on TV, except everything takes longer and you can&#8217;t go to the bathroom every 12 minutes. But it&#8217;s weird, if you&#8217;ve seen it on TV, because you realize that you already know the script. &#8220;Burden of proof,&#8221; &#8220;innocent until proven guilty,&#8221; &#8220;proof beyond a reasonable doubt.&#8221; The judge lays it all out for you, from scratch, even though most people have seen the scene and heard the speech and read the words a hundred times.</p> - -<p>Everything is slanted towards the defense. Big stuff, little stuff, process stuff, everything. We learned later (during sentencing) that the defendant in our case had several prior convictions, but the <abbr>DA</abbr> wasn&#8217;t allowed to bring them up during the trial. Witnesses were always being cut off in mid-sentence, but the defendant was given a wide berth to tell his version of events. We didn&#8217;t even know exactly what the charge meant until the defense lawyer made his closing argument. That, in particular, was incredibly frustrating. I made all sorts of notes like &#8220;is this important? don&#8217;t know, check later.&#8221; The judge said it was to force us to listen to everyone and everything as fairly as possible. It was frustrating on purpose, but it worked.</p> - -<p>And I remember thinking at the time, &#8220;This thing. Right here, this thing. This is what we say America is about.&#8221; Everyone is innocent until proven guilty, and everybody gets their day in court. We suspected that <a href="http://en.wikipedia.org/wiki/Hans_Reiser">Hans Reiser killed his wife</a>. What did we give him? A trial. We suspected that <a href="http://en.wikipedia.org/wiki/Oklahoma_City_bombing">Timothy McVeigh blew up a building and killed 168 people</a>. What did we give him? A trial. (<abbr>BTW</abbr>, this is why <a href="http://www.aclu.org/safefree/detention/commissions.html">people get so upset over our mishandling of terror suspects</a>. What could possibly be more un-American than saying that some people don&#8217;t deserve a fair trial?)</p> - -<p>The case I served on wasn&#8217;t anything you&#8217;ll ever hear about, or read about, or see on TV. Just some neighbors who had ongoing petty feuds for years and years, until one day one of them went too far and made a real death threat. You&#8217;d say he &#8220;crossed the line.&#8221; I think the actual charge was called &#8220;commencement of threats,&#8221; which basically means he crossed one of the invisible lines that holds society together.</p> - -<p>Some people spend their whole life right on the edge of being able to function in a civilized society. I knew a guy like that, growing up outside Philadelphia. His name was Eric. He always seemed to be in trouble with the law. Never anything serious, and not your standard crimes like robbery or drugs or weapons. Just&#8230; not quite understanding the boundaries between himself and everyone else. He could make friends quickly, but then he lost them just as quickly. He never had a steady girlfriend. He couldn&#8217;t maintain any sort of long-term relationship. I think an ex-girlfriend got a restraining order against him one time. And he&#8217;d get arrested for stuff like &#8220;criminal trespass&#8221; and &#8220;commencement of threats.&#8221;</p> - -<p>Society is about drawing lines that everyone acknowledges and respects. Some people see the lines and cross them anyway and hope they don&#8217;t get caught. Eric didn&#8217;t even see the lines. They didn&#8217;t make any sense to him, so when he crossed them, he didn&#8217;t understand why he got in trouble. And you just wanted to smack him and say, &#8220;Just stay out of trouble, Eric! Just leave people alone.&#8221; And he did, most of the time. But &#8220;most of the time&#8221; is not &#8220;all of the time.&#8221; And it&#8217;s a crude word, but I think he was a little bit crazy. Not really crazy, like Hannibal Lecter crazy. He just&#8230; couldn&#8217;t see the lines. You don&#8217;t have to be crazy all the time, to be crazy.</p> - -<p>Anyway, our case came and went. The wheels of justice grind slowly, but there&#8217;s only so much you can say about neighbors yelling at each other. I think the whole trial only lasted a day and a half, from jury selection to sentencing. In the end, we deliberated and found the defendant guilty beyond a reasonable doubt. The victim asked, and the judge agreed, and we the jurors were pleased to hear, that he should get a suspended sentence and a mental health assessment, with mandatory followup counseling. I&#8217;d guess he was offered deals and plea bargains, and I&#8217;d guess that everyone in his life begged him to take it. But he wanted his day in court, and he wanted a trial by a jury of his peers, and so that&#8217;s what we did. And he mounted a vigorous defense, and he was innocent right up until the moment we decided he was guilty.</p> - -<p>I&#8217;m not going to get all puffed up about the glory of the system or the honor of performing my civic duty or whatever. The system is broken in a lot of ways, and there&#8217;s a reason they call it a duty &#8212; because it sounds a lot better in the abstract than it feels in the particular, slogging through downtown traffic and standing in line at the metal detectors and sitting quietly while people go on and on about their fucked up lives. But I also got a glimpse of a marvelous and precarious machine, built up and crusted over from two centuries of radical tradition, grinding ever so slowly forward. And it&#8217;s a helluva thing.</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[Things that are awesome]]> - -tag:diveintomark.org,2008-07-17:/archives/20080717044506 -2008-07-17T04:47:24Z -2008-07-17T04:45:06Z -Trader Joe's, because food wasn't expensive enough already. -<ul> -<li><a href="http://fontmatrix.net/">FontMatrix</a>, which helped me pick the God-awful fonts I&#8217;m foisting on the world</li> -<li><a href="http://www.lesswatts.org/projects/powertop/">PowerTOP</a>, because I love viewing new cross-sections of my computing environment</li> -<li><a href="http://wordle.net/">Wordle</a> (<a href="http://bigpicture.typepad.com/comments/2008/07/bernanke-word-c.html">example</a>), despite being a <i>Java applet written in 2008</i></li> -<li><a href="http://openjdk.java.net/">OpenJDK</a>, which is <a href="http://packages.debian.org/openjdk">now in Debian main</a></li> -<li><a href="http://developer.yahoo.com/yslow/">YSlow</a>, which proved that my <code>Cache-Control</code> headers really did blow goats</li> -<li><a href="http://ocaoimh.ie/wp-super-cache/">WP-SuperCache</a>, which fixed them (sorry, goats)</li> -<li><a href="http://www.youtube.com/watch?v=WGoi1MSGu64">Flight of the Conchords</a> (note: they are actually <a href="http://www.youtube.com/watch?v=wd8yxDivs5g">twice as awesome</a> as everything else on this list)</li> -<li><a href="http://www.traderjoes.com/">Trader Joe&#8217;s</a>, because food wasn&#8217;t expensive enough already</li> -<li><a href="http://www.toblerone.com/">Toblerone</a>, just because</li> -</ul> - -<p>And you?</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[Protocol buffers: the early reviews are in]]> - -tag:diveintomark.org,2008-07-13:/archives/20080713011654 -2008-07-13T04:19:40Z -2008-07-13T01:16:54Z -No wireless. Less space than a Nomad. Lame. -<p>Google (my current employer) has finally <a href="http://google-opensource.blogspot.com/2008/07/protocol-buffers-googles-data.html">open sourced protocol buffers</a>, the data interchange format we use for internal server-to-server communication. The blogosphere&#8217;s response? &#8220;<a href="http://www.oreillynet.com/xml/blog/2008/07/google_hates_xml.html?CMP=OTC-TY3388567169&amp;ATT=Google+hates+XML">No wireless</a>. <a href="http://blogs.tedneward.com/CommentView,guid,98ba2332-0f84-4697-b165-87ee357309cb.aspx">Less space than a Nomad</a>. <a href="http://steve.vinoski.net/blog/2008/07/11/protocol-buffers-no-big-deal/">Lame</a>.&#8221;</p> - -<p>Aaaaanyway&#8230;</p> - -<p>Protocol buffers are &#8220;<a href="http://c2.com/cgi/wiki?JustIsaDangerousWord">just</a>&#8221; cross-platform data structures. <a href="http://www.coriolinus.net/2008/07/08/protocol-buffers/">All you have to write is the schema</a> (a <code>.proto</code> file), then generate bindings in <a href="http://code.google.com/apis/protocolbuffers/docs/cpptutorial.html">C++</a>, <a href="http://code.google.com/apis/protocolbuffers/docs/javatutorial.html">Java</a>, or <a href="http://code.google.com/apis/protocolbuffers/docs/pythontutorial.html">Python</a>. (Or <a href="http://hackage.haskell.org/cgi-bin/hackage-scripts/package/protocol-buffers-0.0.5">Haskell</a>. Or <a href="http://groups.google.com/group/protobuf-perl">Perl</a>.) The <code>.proto</code> file is <a href="http://www.betanews.com/article/Google_releases_its_data_encoding_format_to_compete_with_XML/1215530589">just a schema</a>; it doesn&#8217;t contain any data except default values. All getting and setting is done in code. The serialized over-the-wire format is designed to minimize network traffic, and deserialization (especially in C++) is designed to maximize performance. I can&#8217;t begin to describe how much effort Google spends maximizing performance at every level. We would tear down our data centers and rewire them with <a href="http://news.cnet.com/8301-17938_105-9967991-1.html">$500 ethernet cables</a> if you could prove that it would reduce latency by 1%.</p> - -<p>Besides being blindingly fast, protocol buffers have lots of neat features. <a href="http://scottkirkwood.blogspot.com/2008/07/google-opensources-protocol-buffers.html">A zero-size <abbr>PB</abbr> returns default values</a>. <a href="http://zunger.livejournal.com/164024.html">You can nest <abbr>PB</abbr>s inside each other</a>. And most importantly, <abbr>PB</abbr>s are <a href="http://news.ycombinator.com/item?id=239445">both backward and forward compatible</a>, which means you can <a href="http://www.mattcutts.com/blog/google-releases-protocol-buffers/">upgrade servers gradually</a> and they can still talk to each other in the interim. (When you have as many machines as Google has, it&#8217;s always the interim somewhere.)</p> - -<p>Comparisons to other data formats was, I suppose, inevitable. <a href="http://www.thenewsbeforethenews.com/2008/07/10/everything-old-is-new-again/">Old-timers may remember <abbr>ASN.1</abbr></a> or <a href="http://tech.slashdot.org/tech/08/07/08/201245.shtml"><abbr>IIOP</abbr></a>. Kids these days seem to <a href="http://www.webmasterworld.com/xml/3693285.htm">compare everything to <abbr>XML</abbr></a> or <a href="http://www.freshblurbs.com/google-protocol-buffers-good-bad-and-ugly"><abbr>JSON</abbr></a>. They&#8217;re actually closer to Facebook&#8217;s <a href="http://stuartsierra.com/2008/07/10/thrift-vs-protocol-buffers">Thrift</a> (<a href="http://news.ycombinator.com/item?id=239276">written by ex-Googlers</a>) or <a href="http://www.25hoursaday.com/weblog/CommentView.aspx?guid=898f56ef-0439-4100-90da-08701be03c13">SQL Server&#8217;s <abbr>TDS</abbr></a>. Protocol buffers won&#8217;t <a href="http://zimboe.wordpress.com/2008/07/10/farewell-xml/">kill <abbr>XML</abbr></a> (no matter how much <a href="http://www.sharms.org/blog/?p=168">you wish they would</a>), nor will they replace <abbr>JSON</abbr>, <abbr>ASN.1</abbr>, or <a title="the world's first and only implementation of RFC 1149" href="http://www.blug.linux.no/rfc1149/">carrier pigeon</a>. But they&#8217;re simple and they&#8217;re fast and <a href="http://www.webmonkey.com/blog/Google_s_Open_Source_Protocol_Buffers_Offer_Scalability__Speed">they scale like crazy</a>, and that&#8217;s the way Google likes it.</p> - - - - -Mark -http://diveintomark.org/ - -<![CDATA[NY’s top child porn]]> - -tag:diveintomark.org,2008-07-12:/archives/20080712042845 -2008-07-12T04:28:45Z -2008-07-12T04:28:45Z -I really like pluralizing "Attorney General." And verbing nouns. And parenthesizing. -<p>Despite the promising URL, <a rel="nofollow" href="http://www.nystopchildporn.com/">NYsTopChildPorn.com</a> does not, in fact, contain NY&#8217;s top child porn. (&#8221;Package contained bobcat. <a href="http://xkcd.com/325/">Would not buy again</a>.&#8221;) It will, however, be blocked by <em>every web filtering program ever</em> based solely on the domain name &#8212; an irony which will sadly be lost on the Attorneys General. I bet they bring in a metric buttload of weird search traffic before they fold, though.</p> - -<p>Yeah, I know, I&#8217;m joking about child porn. Carlin is dead, Pesci bless him, and somebody&#8217;s gotta start <a href="http://www.youtube.com/watch?v=3av_qRR_DWc">picking up the slack</a>.</p> - -<p>(The site itself is not notable in any way except as a reason to point out the obvious design flaw &#8212; that <em>you&#8217;re declaring war on a protocol</em>, and, you know, good luck with that.)</p> - -<p>(I really like pluralizing &#8220;Attorney General.&#8221; And verbing nouns. And parenthesizing.)</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[New Orc City]]> - -tag:diveintomark.org,2008-07-06:/archives/20080706022239 -2008-07-06T04:12:31Z -2008-07-06T02:22:39Z - - -I found this example of Papyrus on my doorstep last night &#169;&#160;Sarah Marriage / CC - - -The wife and the first born are in New York City for the long weekend, except the second born pronounces it &#8220;New Orc City,&#8221; which sounds much more interesting if you ask me. This is not the first time Ethan [...] -<div class="punch" style="width:180px"> -<img src="http://wearehugh.com/public/2008/07/papyrus.jpg" alt="[example of Papyrus font]" title="" width="180" height="240"> -<p><a href="http://flickr.com/photos/semarr/125189245/">I found this example of Papyrus on my doorstep last night</a> &copy;&nbsp;<a href="http://flickr.com/people/semarr/">Sarah Marriage</a> / <a title="used under Creative Commons Attribution 2.0 License" href="http://creativecommons.org/licenses/by/2.0/">CC</a></p> -</div> - -<p>The wife and the first born are in New York City for the long weekend, except the second born pronounces it &#8220;New Orc City,&#8221; which sounds much more interesting if you ask me. This is not the first time Ethan has traveled, but it&#8217;s the first time that he and his brother have been separated for more than 8 hours. It has also given them their first opportunity to talk to each other on the telephone, long distance. I assume it won&#8217;t be the last.</p> - -<p>Wesley and I have been having a wonderful time doing all manner of things without, you know, competition. Watching his <a title="actually just one movie over and over" href="http://www.imdb.com/title/tt0055254/">favorite movies</a>, wading in the <a href="http://www.enoriver.org/Festival/">Eno River</a>, and spotting butterflies at the <a href="http://www.ncmls.org/">Museum of Life and Science</a>. No pics, sorry (the wife has the camera in New Orc City), but here&#8217;s some pictures from our trip 2 years ago: a <a href="http://flickr.com/photos/f8dy/121701744/">butterfly</a>, a <a href="http://flickr.com/photos/f8dy/121701637/">sheep</a>, and a <a href="http://flickr.com/photos/f8dy/121701704/">pot-bellied pig</a>. I swear the pig hasn&#8217;t moved in 2 years.</p> - -<p>On a coming-full-circle kind of note, the Festival of the Eno uses <a href="/archives/2008/06/21/minimalism#comment-12293">Papyrus</a> in their video materials. We saw it on the shuttle bus on the way back to the parking lot. My mother was sitting next to me, and I got all excited and poked her and pointed to the screen above us and said, &#8220;Hey, I know that font! Everybody hates that font!&#8221; Who says designers are useless?</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[Adobe 9]]> - -tag:diveintomark.org,2008-07-04:/archives/20080704050619 -2008-07-04T20:18:42Z -2008-07-04T05:06:19Z -You can't make this stuff up. -<div class="punch" style="width:240px"> -<img src="http://wearehugh.com/public/2008/07/upgrade-are-failed.jpg" alt="[upgrade are failed]" title="" width="240" height="180"> -<p><a href="http://flickr.com/photos/collinanderson/2413624779/">Upgrade are failed!</a> &copy;&nbsp;<a href="http://flickr.com/people/collinanderson/">Collin Anderson</a> / <a title="used under Creative Commons Attribution 2.0 License" href="http://creativecommons.org/licenses/by/2.0/">CC</a></p> -</div> - -<p>Adobe<a title="you may think I'm intentionally overusing the marks for comedic effect, but I'm not (overusing them, that is)" href="http://www.adobe.com/misc/trade.html">&reg;</a> Reader&reg; 9 is <a href="http://gusmueller.com/blog/archives/2008/07/adobe_reader_9_is_out!.html">out</a>. It&#8217;s now almost half as fast as <a href="http://www.foxitsoftware.com/pdf/reader_2/down_reader.htm">Foxit Reader</a>. It lets you <a href="http://www.download.com/8301-2007_4-9982192-12.html">embed Flash in PDF</a> and <a href="http://blogs.adobe.com/loridefurio/2008/07/pdf_widget_on_a.html">embed PDF in Flash</a>. Adobe supports both kinds of music, <a href="http://www.microsoft.com/">country</a> and <a href="http://www.apple.com/">western</a>. They&#8217;ve also &#8220;<a href="http://blogs.adobe.com/adobereader/2008/06/adobe_reader_9_is_here_1.html">conveniently</a>&#8221; bundled Adobe&reg; AIR&trade; <a href="http://www.tuaw.com/2008/07/02/adobe-reader-9-released/#c12973868">for no apparent reason</a> and added synergistic integration with <a href="https://www.acrobat.com/">their cloud</a>, which claims it doesn&#8217;t support my browser and then requires both Javascript and Flash to sign up for an Adobe&reg; ID, the use of which is governed by this <a type="application/pdf" href="http://www.adobe.com/go/acrobat_com_tou_en">draconian service agreement</a>, which is a PDF.</p> - -<p>You can&#8217;t make this stuff up. And apparently it gets worse if you try to, you know, <a href="http://blog.micropledge.com/2008/07/adobe-reader-9/">actually install it</a>.</p> - -<p>It occurs to me that, at some point in the not-too-<a href="http://www.youtube.com/watch?v=WGoi1MSGu64">distant future</a>, we&#8217;re going to achieve a harmonic convergence with these mega-platforms. &#8220;Adobe&reg; Acrobat&reg; version 9 with Adobe&reg; Flash&reg; version 10 with Adobe&reg; Photoshop&reg; CS3 with Adobe&reg; AIR&trade; beta 3&#8243; will get truncated to &#8220;Adobe 9.&#8221; Coming soon on <a href="http://www.overheardinnewyork.com/">Overheard in New York</a>: &#8220;Hey, are you on Adobe 9?&#8221; &#8220;No, I&#8217;m on Microsoft 14.&#8221; &#8220;Pity. I was hoping we could have sex.&#8221; Or something like that. Who knows, with these wacky kids today and their vendor-specific runtimes?</p> - - - -Mark -http://diveintomark.org/ - -<![CDATA[Microformats and accessibility: the soap opera that never ends]]> - -tag:diveintomark.org,2008-06-29:/archives/20080629044756 -2008-06-29T04:55:43Z -2008-06-29T04:47:56Z -As far as I can tell, the only thing that leading accessibility experts agree on is that nobody listens to leading accessibility experts. -<div class="punch" style="width:240px"> -<img src="http://wearehugh.com/public/2008/06/ducks-butt.jpg" alt="[duck with its head underwater]" title="" width="240" height="160"> -<p><a href="http://flickr.com/photos/spacepleb/249761636/">ducks butt</a> &copy;&nbsp;<a href="http://flickr.com/people/spacepleb/">Dave Gough</a> / <a title="used under Creative Commons Attribution 2.0 License" href="http://creativecommons.org/licenses/by/2.0/">CC</a></p> -</div> - -<p>As far as I can tell, the only thing that leading accessibility experts agree on is that <a href="http://adactio.com/journal/1451/">nobody listens to leading accessibility experts</a>, especially not <a href="http://www.webstandards.org/2008/06/23/haccessibility-redux/#comment-71549">the microformats cabal</a>, which <a href="http://microformats.org/wiki/datetime-design-pattern#Accessibility_issues">has never cared about accessibility</a>, <a href="http://microformats.org/wiki/assistive-technology-abbr-results">has never bothered to test it</a>, and <a href="http://www.isolani.co.uk/blog/access/AccessibilityOfDateTimeMicroformat">has never acknowledged</a> those <a href="http://lab.dotjay.co.uk/tests/screen-readers/microformats/datetime-design-pattern/">who have tested it</a>. In fact, <a href="http://www.bbc.co.uk/blogs/radiolabs/2008/06/removing_microformats_from_bbc.shtml">the BBC recently removed one microformat</a> from their site because one piece of it may be confusing to some screen reader users with a certain non-default configuration. This proves what leading accessibility experts have been saying all along, that <a href="http://adactio.com/journal/1457/">all microformats are inaccessible</a>, and we should <a href="http://ejohn.org/blog/bbc-removing-microformat-support/">all just use RDF</a>.</p> - -<p>Meanwhile, the devilish cabal is <a href="http://microformats.org/wiki/datetime-design-pattern#date_and_time_separation_using_value_excerption">secretly solving the problem</a> on their public wiki page, their public mailing list, and their public IRC channel. But will it be <a href="http://www.bbc.co.uk/blogs/radiolabs/2008/06/microformats_and_rdfa_and_rdf.shtml">enough for the BBC</a>? Be sure to tune in next week, when we&#8217;ll <a href="http://www.imdb.com/title/tt0071853/quotes">drown a leading accessibility expert</a> to see if she&#8217;s a witch.</p> - - diff --git a/hub/feed_diff_testdata/rdf_10_weirdness.xml b/hub/feed_diff_testdata/rdf_10_weirdness.xml deleted file mode 100644 index 94e5674..0000000 --- a/hub/feed_diff_testdata/rdf_10_weirdness.xml +++ /dev/null @@ -1,360 +0,0 @@ - - - - -Slashdot -http://slashdot.org/ -News for nerds, stuff that matters -en-us -Copyright 1997-2009, Geeknet, Inc. All Rights Reserved. -2010-06-03T21:20:16+00:00 -Geeknet, Inc. - -help@slashdot.org -Technology -hourly -1 -1970-01-01T00:00+00:00 - - - - - - - - - - - - - - - - - - - - - - - - - - -Slashdot - -http://a.fsdn.com/sd/topics/topicslashdot.gif -http://slashdot.org/ - - - -How To Get Rejected From the App Store -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/tmmQTFyzGb8/How-To-Get-Rejected-From-the-App-Store -snydeq writes "Fatal Exception's Neil McAllister catalogs 12 sure-fire ways to get your app rejected from Apple's notoriously fickle App Store. From executing interpreted code, to using Apple's APIs without permission, to designing your UI, each transgression has been abstracted from real-life rejections &mdash; for the most part because Apple seems to be making up the rules as it goes along. 'It'd be nice for Apple to make conditions for rejection clear,' McAllister writes. 'Apple has been tinkering with the language of its iPhone SDK license agreement lately, but that hasn't done much to clarify the rules &mdash; unless you're Adobe. For everyone else, the App Store's requirements seem as vague and capricious as ever.'"<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fapple.slashdot.org%2Fstory%2F10%2F06%2F03%2F2017220%2FHow-To-Get-Rejected-From-the-App-Store" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - - <a href="http://twitter.com/home?status=How+To+Get+Rejected+From+the+App+Store%3A+http%3A%2F%2Fbit.ly%2F9nfrph" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://apple.slashdot.org/story/10/06/03/2017220/How-To-Get-Rejected-From-the-App-Store?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1674524&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/qnH42oYOpn-HJu8_ddYFIXVOYgo/0/da"><img src="http://feedads.g.doubleclick.net/~at/qnH42oYOpn-HJu8_ddYFIXVOYgo/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/qnH42oYOpn-HJu8_ddYFIXVOYgo/1/da"><img src="http://feedads.g.doubleclick.net/~at/qnH42oYOpn-HJu8_ddYFIXVOYgo/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/tmmQTFyzGb8" height="1" width="1"/> -timothy -2010-06-03T20:54:00+00:00 - -business -feature-the-steve-in-green-turtleneck -apple -28 -28,24,23,16,5,1,0 -http://apple.slashdot.org/story/10/06/03/2017220/How-To-Get-Rejected-From-the-App-Store?from=rss - - -Frank Zappa's Influence On Linux and FOSS Development -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/cshWw102qTE/Frank-Zappas-Influence-On-Linux-and-FOSS-Development - -Roblimo writes "Zappa's 'Dinah-Moe Hummm' is totally about Linux, at least in spirit, while the song 'Montana,' with its talk of zirconium-encrusted tweezers and dental floss, 'is obviously about Mac users.' Not only that: In the early '70s Zappa wrote a song called 'Penguin in Bondage,' an obvious foretelling of the anti-Linux lawsuits and threats from SCO, Microsoft, and other evildoers. Zappa was also a heavy user of the Synclavier, an electronic music machine that was a precursor to today's 'studio on a computer' recording and sound editing software. According to an article on DevX, today Zappa would no doubt be using Linux and Ardour for most of his recording and composition."<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Flinux.slashdot.org%2Fstory%2F10%2F06%2F03%2F196234%2FFrank-Zappas-Influence-On-Linux-and-FOSS-Development" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=Frank+Zappa's+Influence+On+Linux+and+FOSS+Development%3A+http%3A%2F%2Fbit.ly%2F9s0FmS" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://linux.slashdot.org/story/10/06/03/196234/Frank-Zappas-Influence-On-Linux-and-FOSS-Development?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1674468&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/pqPkV5zqIqnjjKi4JwhUaWaKvSs/0/da"><img src="http://feedads.g.doubleclick.net/~at/pqPkV5zqIqnjjKi4JwhUaWaKvSs/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/pqPkV5zqIqnjjKi4JwhUaWaKvSs/1/da"><img src="http://feedads.g.doubleclick.net/~at/pqPkV5zqIqnjjKi4JwhUaWaKvSs/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/cshWw102qTE" height="1" width="1"/> -timothy -2010-06-03T20:11:00+00:00 - -gnu -oh-yeah-try-to-disprove-it -linux -85 -85,82,62,48,7,3,3 -http://linux.slashdot.org/story/10/06/03/196234/Frank-Zappas-Influence-On-Linux-and-FOSS-Development?from=rss - - -Six Major 3G and 4G Networks Tested Nationwide -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/ziiB2Fy7vGY/Six-Major-3G-and-4G-Networks-Tested-Nationwide - -adeelarshad82 writes "PCMag recently tested six 3G and 4G networks to determine which ones were the fastest (and slowest) in 18 different US cities. They focused on data, not calls, and used their own testing script and methodology, which combined various kinds of uploads and downloads. Using laptops, more than a dozen people ran more than 10,000 tests; they found AT&amp;T is both the fastest national 3G network, and the least consistent. Sprint's 3G system was the slowest of the 'big four' carriers, but the most consistent. When the test results were broken down by regions, AT&amp;T led on speed in the Southeast, Central, and West, but T-Mobile took the crown in the Northeast region. Sprint's 4G network was fast where it was available, but it was surprisingly slower than 3G in some cities. The fastest AT&amp;T download seen, at 5.05 megabits/sec, was right behind Apple's headquarters at 1 Infinite Loop in Cupertino, CA. The fastest connection in any of the tests was a blazing 9.11 megabits down on Sprint 4G in the Midtown neighborhood of Atlanta, GA. The slowest city, on average, was Raleigh, with average 3G downloads of 880kbits/sec."<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Ftech.slashdot.org%2Fstory%2F10%2F06%2F03%2F1836232%2FSix-Major-3G-and-4G-Networks-Tested-Nationwide" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=Six+Major+3G+and+4G+Networks+Tested+Nationwide%3A+http%3A%2F%2Fbit.ly%2F9KEFzt" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://tech.slashdot.org/story/10/06/03/1836232/Six-Major-3G-and-4G-Networks-Tested-Nationwide?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1674452&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/zEQ1VfCz-qeWOcC7iheee68Oneo/0/da"><img src="http://feedads.g.doubleclick.net/~at/zEQ1VfCz-qeWOcC7iheee68Oneo/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/zEQ1VfCz-qeWOcC7iheee68Oneo/1/da"><img src="http://feedads.g.doubleclick.net/~at/zEQ1VfCz-qeWOcC7iheee68Oneo/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/ziiB2Fy7vGY" height="1" width="1"/> -timothy -2010-06-03T19:32:00+00:00 - -internet -actually-tested-locally -technology -65 -65,63,52,39,11,8,4 -http://tech.slashdot.org/story/10/06/03/1836232/Six-Major-3G-and-4G-Networks-Tested-Nationwide?from=rss - - -Mobile Phones vs. Supercomputers of the Past -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/D7AUWrUlSys/Mobile-Phones-vs-Supercomputers-of-the-Past - -An anonymous reader writes "The recently published Top 500 list of the world's fastest supercomputers is based on the Linpack benchmark developed decades ago by Jack Dongarra. This same test has been ported to Android mobile phones, which means that we can compare the performance of our phones against that of the supercomputers of the past. For example, a tweaked Motorola Droid can hit 52 Mflop/s, which is more than 15 times faster than the CPUs used in the 1979 Cray-1." But even today's most powerful cellphones don't come with an integrated bench.<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fhardware.slashdot.org%2Fstory%2F10%2F06%2F03%2F1740214%2FMobile-Phones-vs-Supercomputers-of-the-Past" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=Mobile+Phones+vs.+Supercomputers+of+the+Past%3A+http%3A%2F%2Fbit.ly%2FasUgMi" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://hardware.slashdot.org/story/10/06/03/1740214/Mobile-Phones-vs-Supercomputers-of-the-Past?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1674396&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/Tj3131YW0lSjS0yDrJlqPDmeQXA/0/da"><img src="http://feedads.g.doubleclick.net/~at/Tj3131YW0lSjS0yDrJlqPDmeQXA/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/Tj3131YW0lSjS0yDrJlqPDmeQXA/1/da"><img src="http://feedads.g.doubleclick.net/~at/Tj3131YW0lSjS0yDrJlqPDmeQXA/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/D7AUWrUlSys" height="1" width="1"/> -timothy -2010-06-03T18:49:00+00:00 - -supercomputing -crays-are-pure-sculpture -hardware -137 -137,135,115,90,21,11,6 -http://hardware.slashdot.org/story/10/06/03/1740214/Mobile-Phones-vs-Supercomputers-of-the-Past?from=rss - - -FTC Staff Discuss a Tax on Electronics To Support the News Business -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/RWSAy1nVfYQ/FTC-Staff-Discuss-a-Tax-on-Electronics-To-Support-the-News-Business - -dptalia links to this piece describing a staff discussion draft from the Federal Trade Commission, writing "The FTC is concerned about the death of the 'news.' Specifically newspapers. Rather than look to how old media models can be adapted to the Internet, they instead suggest taxing consumer electronics to support a huge newspaper bailout. Additionally, they suggest making facts 'proprietary' and allowing news organizations to copyright them." - -Note, though, "The good news in all this is that the FTC's bureaucrats try hard to recommend little. They just discuss. And much of what the agency staff ponders are political impossibilities."<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fpolitics.slashdot.org%2Fstory%2F10%2F06%2F03%2F1730254%2FFTC-Staff-Discuss-a-Tax-on-Electronics-To-Support-the-News-Business" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=FTC+Staff+Discuss+a+Tax+on+Electronics+To+Support+the+News+Business%3A+http%3A%2F%2Fbit.ly%2FcWrHHx" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://politics.slashdot.org/story/10/06/03/1730254/FTC-Staff-Discuss-a-Tax-on-Electronics-To-Support-the-News-Business?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1674376&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/6FyJ4q29U8zi6oajNj1WizX1GQQ/0/da"><img src="http://feedads.g.doubleclick.net/~at/6FyJ4q29U8zi6oajNj1WizX1GQQ/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/6FyJ4q29U8zi6oajNj1WizX1GQQ/1/da"><img src="http://feedads.g.doubleclick.net/~at/6FyJ4q29U8zi6oajNj1WizX1GQQ/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/RWSAy1nVfYQ" height="1" width="1"/> -timothy -2010-06-03T18:03:00+00:00 - -themedia -now-that's-what-I-call-top-down-management -politics -270 -270,270,225,175,37,16,11 -http://politics.slashdot.org/story/10/06/03/1730254/FTC-Staff-Discuss-a-Tax-on-Electronics-To-Support-the-News-Business?from=rss - - -Yahoo Treading Carefully Before Exposing More Private Data -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/wYu2IZPqdzM/Yahoo-Treading-Carefully-Before-Exposing-More-Private-Data - -crimeandpunishment writes "Yahoo hopes to turn on a new sharing option without turning off its users. The company is trying to avoid the privacy backlash that has befallen Facebook and Google. It's advising its email account holders, all 280M of them, to review their privacy settings in advance of Yahoo's new features that will share users' online activities and interests with people in their address books, unless they take steps to prevent it."<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fyro.slashdot.org%2Fstory%2F10%2F06%2F03%2F162247%2FYahoo-Treading-Carefully-Before-Exposing-More-Private-Data" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=Yahoo+Treading+Carefully+Before+Exposing+More+Private+Data%3A+http%3A%2F%2Fbit.ly%2FakVpBO" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://yro.slashdot.org/story/10/06/03/162247/Yahoo-Treading-Carefully-Before-Exposing-More-Private-Data?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1674294&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/ubm3QT0AQfS0J8kJ0Xde_GTSXuI/0/da"><img src="http://feedads.g.doubleclick.net/~at/ubm3QT0AQfS0J8kJ0Xde_GTSXuI/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/ubm3QT0AQfS0J8kJ0Xde_GTSXuI/1/da"><img src="http://feedads.g.doubleclick.net/~at/ubm3QT0AQfS0J8kJ0Xde_GTSXuI/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/wYu2IZPqdzM" height="1" width="1"/> -kdawson -2010-06-03T17:15:00+00:00 - -privacy -can-you-say-buzz -yro -81 -81,79,67,56,19,12,11 -http://yro.slashdot.org/story/10/06/03/162247/Yahoo-Treading-Carefully-Before-Exposing-More-Private-Data?from=rss - - -Police Officers Seek Right Not To Be Recorded -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/OsEit_oEJG8/Police-Officers-Seek-Right-Not-To-Be-Recorded - -linzeal writes "When the police act as though cameras were the equivalent of guns pointed at them, there is a sense in which they are correct. Cameras have become the most effective weapon that ordinary people have to protect against and to expose police abuse. And the police want it to stop. Judges, juries, and legislatures support the police overwhelmingly on this issue, with only a few cases where those accused of 'shooting' the cops being vindicated through the courts."<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fyro.slashdot.org%2Fstory%2F10%2F06%2F03%2F1548225%2FPolice-Officers-Seek-Right-Not-To-Be-Recorded" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=Police+Officers+Seek+Right+Not+To+Be+Recorded%3A+http%3A%2F%2Fbit.ly%2F9F5Zhn" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://yro.slashdot.org/story/10/06/03/1548225/Police-Officers-Seek-Right-Not-To-Be-Recorded?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1674280&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/d0x5YGFOTmjEqB4lo79jBGiqlWo/0/da"><img src="http://feedads.g.doubleclick.net/~at/d0x5YGFOTmjEqB4lo79jBGiqlWo/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/d0x5YGFOTmjEqB4lo79jBGiqlWo/1/da"><img src="http://feedads.g.doubleclick.net/~at/d0x5YGFOTmjEqB4lo79jBGiqlWo/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/OsEit_oEJG8" height="1" width="1"/> -kdawson -2010-06-03T16:28:00+00:00 - -crime -ain't-nobody's-bidness-if-we-do -yro -789 -789,781,636,502,122,84,64 -http://yro.slashdot.org/story/10/06/03/1548225/Police-Officers-Seek-Right-Not-To-Be-Recorded?from=rss - - -OH Senate Passes Bill Banning Human-Animal Hybrids -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/qALRtOq3asc/OH-Senate-Passes-Bill-Banning-Human-Animal-Hybrids - -An anonymous reader writes "The sci-fi movie Splice seems to have scared the Ohio's State Senator Steve Buehrer. The Ohio Senate has passed Sen. Buehrer's bill banning 'the creation, transportation, or receipt of a human-animal hybrid, the transfer of a nonhuman embryo into a human womb, and the transfer of a human embryo into a nonhuman womb.' So much for Teenage Mutant Ninja Turtles."<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fidle.slashdot.org%2Fstory%2F10%2F06%2F03%2F1422213%2FOH-Senate-Passes-Bill-Banning-Human-Animal-Hybrids" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=OH+Senate+Passes+Bill+Banning+Human-Animal+Hybrids%3A+http%3A%2F%2Fbit.ly%2F9Rzi4u" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://idle.slashdot.org/story/10/06/03/1422213/OH-Senate-Passes-Bill-Banning-Human-Animal-Hybrids?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1674156&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/O2YUM8RDSLbHWAZ7FYD8uGjf9Gk/0/da"><img src="http://feedads.g.doubleclick.net/~at/O2YUM8RDSLbHWAZ7FYD8uGjf9Gk/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/O2YUM8RDSLbHWAZ7FYD8uGjf9Gk/1/da"><img src="http://feedads.g.doubleclick.net/~at/O2YUM8RDSLbHWAZ7FYD8uGjf9Gk/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/qALRtOq3asc" height="1" width="1"/> -samzenpus -2010-06-03T16:10:00+00:00 - -biotech -no-centaurs-allowed -idle -140 -140,138,116,87,16,10,5 -http://idle.slashdot.org/story/10/06/03/1422213/OH-Senate-Passes-Bill-Banning-Human-Animal-Hybrids?from=rss - - -Part-Human, Part-Machine Transistor Devised -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/sH47rA1Mhcs/Part-Human-Part-Machine-Transistor-Devised - -asukasoryu writes "Man and machine can now be linked more intimately than ever, according to a new article in the journal ACS Nano Letters. Scientists have embedded a nano-sized transistor inside a cell-like membrane and powered it using the cell's own fuel. To create the implanted circuit, the UC scientists combined a carbon nanotube transistor, lipid bilayer coating, ion pump, and ATP. The ion pump changes the electrical charge inside the cell, which then changes the electrical charge going through the transistor, which the scientists could measure and monitor."<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fhardware.slashdot.org%2Fstory%2F10%2F06%2F03%2F157205%2FPart-Human-Part-Machine-Transistor-Devised" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=Part-Human%2C+Part-Machine+Transistor+Devised%3A+http%3A%2F%2Fbit.ly%2FaaeR9U" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://hardware.slashdot.org/story/10/06/03/157205/Part-Human-Part-Machine-Transistor-Devised?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1674234&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/Myrxz7xqD6ztwnzMUpnHiW0x7wU/0/da"><img src="http://feedads.g.doubleclick.net/~at/Myrxz7xqD6ztwnzMUpnHiW0x7wU/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/Myrxz7xqD6ztwnzMUpnHiW0x7wU/1/da"><img src="http://feedads.g.doubleclick.net/~at/Myrxz7xqD6ztwnzMUpnHiW0x7wU/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/sH47rA1Mhcs" height="1" width="1"/> -kdawson -2010-06-03T15:39:00+00:00 - -biotech -mitochondria-look-up -hardware -57 -57,54,46,33,15,10,6 -http://hardware.slashdot.org/story/10/06/03/157205/Part-Human-Part-Machine-Transistor-Devised?from=rss - - -Why Are Indian Kids So Good At Spelling? -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/lAWnaU6YgIs/Why-Are-Indian-Kids-So-Good-At-Spelling - -theodp writes "Slate's Ben Paynter looks into why Indian kids dominate the Scripps National Spelling Bee, and concludes it's because they have their own minor-league spelling bee circuit (having the discipline to spell 7,000 to 8,000 words a day probably helps too!). Indian-Americans make up about 1% of the US population, notes Paynter, but this year an estimated 11% of the competitors at Scripps will hail from regional contests run by the North South Foundation. The NSF competitions function as a kind of nerd Olympiad for Indian-Americans &mdash; there are separate divisions for math, science, vocabulary, geography, essay writing, and even public speaking &mdash; and a way to raise money for college scholarships for underprivileged students in India. BTW, Strollerderby has the scoop on Whatever Happened to the Spellbound Kids? (RIP, Ted Brigham)."<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fnews.slashdot.org%2Fstory%2F10%2F06%2F03%2F1333252%2FWhy-Are-Indian-Kids-So-Good-At-Spelling" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=Why+Are+Indian+Kids+So+Good+At+Spelling%3F%3A+http%3A%2F%2Fbit.ly%2F9p6g5Z" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://news.slashdot.org/story/10/06/03/1333252/Why-Are-Indian-Kids-So-Good-At-Spelling?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1674088&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/ZByOTHGO1peZ7CsinQ_HpRRAXMA/0/da"><img src="http://feedads.g.doubleclick.net/~at/ZByOTHGO1peZ7CsinQ_HpRRAXMA/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/ZByOTHGO1peZ7CsinQ_HpRRAXMA/1/da"><img src="http://feedads.g.doubleclick.net/~at/ZByOTHGO1peZ7CsinQ_HpRRAXMA/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/lAWnaU6YgIs" height="1" width="1"/> -StoneLion -2010-06-03T14:48:00+00:00 - -education -i-n-t-e-l-l-i-g-e-n-t -news -386 -386,384,288,235,59,31,13 -http://news.slashdot.org/story/10/06/03/1333252/Why-Are-Indian-Kids-So-Good-At-Spelling?from=rss - - -Mars500 Mission Begins -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/JcnvobAj0DE/Mars500-Mission-Begins - -krou writes "The six participants in the Mars500 project have entered their sealed facility. The project, which lasts for 18 months, is designed to try and simulate a mission to Mars, completely isolated and cut off from the outside world, with a '20-minute, one-way time-delay in communications to mirror the real lag in sending messages over the vast distance between Mars and Earth.' They also have limited consumables, with everything required being loaded onboard from the start. You can follow developments via the blog, or the Twitter feed of Diego Urbina, one of the would-be cosmonauts."<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fscience.slashdot.org%2Fstory%2F10%2F06%2F03%2F1326248%2FMars500-Mission-Begins" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=Mars500+Mission+Begins%3A+http%3A%2F%2Fbit.ly%2F8X46k9" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://science.slashdot.org/story/10/06/03/1326248/Mars500-Mission-Begins?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1674074&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/0m5VIgNdNIn3qTvqkeUm7Bm_5Ss/0/da"><img src="http://feedads.g.doubleclick.net/~at/0m5VIgNdNIn3qTvqkeUm7Bm_5Ss/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/0m5VIgNdNIn3qTvqkeUm7Bm_5Ss/1/da"><img src="http://feedads.g.doubleclick.net/~at/0m5VIgNdNIn3qTvqkeUm7Bm_5Ss/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/JcnvobAj0DE" height="1" width="1"/> -samzenpus -2010-06-03T14:00:00+00:00 - -mars -I-think-I-saw-this-movie -science -194 -194,186,158,129,39,16,8 -http://science.slashdot.org/story/10/06/03/1326248/Mars500-Mission-Begins?from=rss - - -Military Develops "Green" Cleaners For Terrorist Attack Sites -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/WQA5Xo_6cwA/Military-Develops-Green-Cleaners-For-Terrorist-Attack-Sites - -An anonymous reader writes "Chemists with the U.S. military have developed a set of ultra-strength cleaners to be used in the aftermath of a terrorist attack. The formulas are reportedly tough enough to get rid of nerve gas, mustard gas, radioactive isotopes, and anthrax. But they are also non-toxic, based on ingredients found in foods, cosmetics, and other consumer products."<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fidle.slashdot.org%2Fstory%2F10%2F06%2F03%2F0256204%2FMilitary-Develops-Green-Cleaners-For-Terrorist-Attack-Sites" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=Military+Develops+%22Green%22+Cleaners+For+Terrorist+Attack+Sites%3A+http%3A%2F%2Fbit.ly%2Fd5B0na" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://idle.slashdot.org/story/10/06/03/0256204/Military-Develops-Green-Cleaners-For-Terrorist-Attack-Sites?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1673468&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/PDXSpTgm3sywZaYwq6gq_hqte1s/0/da"><img src="http://feedads.g.doubleclick.net/~at/PDXSpTgm3sywZaYwq6gq_hqte1s/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/PDXSpTgm3sywZaYwq6gq_hqte1s/1/da"><img src="http://feedads.g.doubleclick.net/~at/PDXSpTgm3sywZaYwq6gq_hqte1s/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/WQA5Xo_6cwA" height="1" width="1"/> -samzenpus -2010-06-03T13:10:00+00:00 - -military -ultra-concentrated -idle -81 -81,76,71,54,20,12,3 -http://idle.slashdot.org/story/10/06/03/0256204/Military-Develops-Green-Cleaners-For-Terrorist-Attack-Sites?from=rss - - -Bill Gives Feds "Emergency" Powers To Secure Civilian Nets -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/iW74en1N7Ro/Bill-Gives-Feds-Emergency-Powers-To-Secure-Civilian-Nets - -ziani writes "Joe Lieberman wants to give the federal government the power to take over civilian networks' security if there's an 'imminent cyber threat.' From the article: 'Lieberman and Collins' solution is one of the more far-reaching proposals. In the Senators' draft bill, "the President may issue a declaration of an imminent cyber threat to covered critical infrastructure." Once such a declaration is made, the director of a DHS National Center for Cybersecurity and Communications is supposed to "develop and coordinate emergency measures or actions necessary to preserve the reliable operation, and mitigate or remediate the consequences of the potential disruption, of covered critical infrastructure."'"<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fnews.slashdot.org%2Fstory%2F10%2F06%2F03%2F038203%2FBill-Gives-Feds-Emergency-Powers-To-Secure-Civilian-Nets" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=Bill+Gives+Feds+%22Emergency%22+Powers+To+Secure+Civilian+Nets%3A+http%3A%2F%2Fbit.ly%2FbPhuuU" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://news.slashdot.org/story/10/06/03/038203/Bill-Gives-Feds-Emergency-Powers-To-Secure-Civilian-Nets?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1673478&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/rWboIySEo5PuQp4g7XzQ7ObY6BI/0/da"><img src="http://feedads.g.doubleclick.net/~at/rWboIySEo5PuQp4g7XzQ7ObY6BI/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/rWboIySEo5PuQp4g7XzQ7ObY6BI/1/da"><img src="http://feedads.g.doubleclick.net/~at/rWboIySEo5PuQp4g7XzQ7ObY6BI/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/iW74en1N7Ro" height="1" width="1"/> -samzenpus -2010-06-03T11:57:00+00:00 - -usa -all-your-nets-are-belong-to-us -news -444 -444,439,343,268,62,42,25 -http://news.slashdot.org/story/10/06/03/038203/Bill-Gives-Feds-Emergency-Powers-To-Secure-Civilian-Nets?from=rss - - -Iridium Pushes Ahead Satellite Project -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/-gWGIAF-QGY/Iridium-Pushes-Ahead-Satellite-Project - -oxide7 writes "Iridium (IRDM) continues its push into the market for satellite data and telemetry services, as it announced the company that would build its second generation of satellites. Iridium's old network of 66 satellites was designed for voice calls; the new satellites will also be able to handle data more efficiently, and include cameras as well. The company also plans to share the satellite platforms with some scientists for use in studying the Earth."<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fscience.slashdot.org%2Fstory%2F10%2F06%2F03%2F006256%2FIridium-Pushes-Ahead-Satellite-Project" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=Iridium+Pushes+Ahead+Satellite+Project%3A+http%3A%2F%2Fbit.ly%2FconYqH" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://science.slashdot.org/story/10/06/03/006256/Iridium-Pushes-Ahead-Satellite-Project?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1673374&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/_4xqZu9UTaB0_CeYB0dLBjj7YDo/0/da"><img src="http://feedads.g.doubleclick.net/~at/_4xqZu9UTaB0_CeYB0dLBjj7YDo/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/_4xqZu9UTaB0_CeYB0dLBjj7YDo/1/da"><img src="http://feedads.g.doubleclick.net/~at/_4xqZu9UTaB0_CeYB0dLBjj7YDo/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/-gWGIAF-QGY" height="1" width="1"/> -samzenpus -2010-06-03T06:55:00+00:00 - -space -space-business -science -75 -75,74,65,58,29,16,11 -http://science.slashdot.org/story/10/06/03/006256/Iridium-Pushes-Ahead-Satellite-Project?from=rss - - -Doctor Slams Hospital's "Please" Policy -http://rss.slashdot.org/~r/Slashdot/slashdot/~3/Fyn4QmQHquA/Doctor-Slams-Hospitals-Please-Policy - -Administrators at England's Worthing Hospital are insisting that doctors say the magic word when writing orders for blood tests on weekends. If a doctor refuses to write "please" on the order, the test will be refused. From the article: "However, a doctor at the hospital said on condition of anonymity that he sees the policy as a money-saving measure that could prove dangerous for patients. 'I was shocked to come in on Sunday and find none of my bloods had been done from the night before because I'd not written "please,"' the doctor said. 'I had no results to guide treatment of patients. Myself and a senior nurse had to take the bloods ourselves, which added hours to our 12-hour shifts. This system puts patients' lives at risk. Doctors are wasting time doing the job of the technicians.'"<p><a href="http://www.facebook.com/sharer.php?u=http%3A%2F%2Fscience.slashdot.org%2Fstory%2F10%2F06%2F03%2F0118209%2FDoctor-Slams-Hospitals-Please-Policy" target="_blank" title="Share on Facebook"><img src="http://a.fsdn.com/sd/facebook_icon_large.png"></a> - - <a href="http://twitter.com/home?status=Doctor+Slams+Hospital's+%22Please%22+Policy%3A+http%3A%2F%2Fbit.ly%2FcEKPgY" target="_blank" title="Share on Twitter"><img src="http://a.fsdn.com/sd/twitter_icon_large.png"></a></p><p><a href="http://science.slashdot.org/story/10/06/03/0118209/Doctor-Slams-Hospitals-Please-Policy?from=rss">Read more of this story</a> at Slashdot.</p><iframe src="http://slashdot.org/slashdot-it.pl?op=discuss&amp;id=1673418&amp;smallembed=1" style="height: 300px; width: 100%; border: none;"></iframe> - -<p><a href="http://feedads.g.doubleclick.net/~at/zun8Y5ECDPrhhF4bOJhnZhw9wb0/0/da"><img src="http://feedads.g.doubleclick.net/~at/zun8Y5ECDPrhhF4bOJhnZhw9wb0/0/di" border="0" ismap="true"></img></a><br/> -<a href="http://feedads.g.doubleclick.net/~at/zun8Y5ECDPrhhF4bOJhnZhw9wb0/1/da"><img src="http://feedads.g.doubleclick.net/~at/zun8Y5ECDPrhhF4bOJhnZhw9wb0/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/Slashdot/slashdot/~4/Fyn4QmQHquA" height="1" width="1"/> -samzenpus -2010-06-03T05:07:00+00:00 - -medicine -paging-doctor-manners -science -500 -500,495,378,303,97,50,26 -http://science.slashdot.org/story/10/06/03/0118209/Doctor-Slams-Hospitals-Please-Policy?from=rss - - -Search Slashdot -Search Slashdot stories - -query -http://slashdot.org/search.pl - - - diff --git a/hub/feed_diff_testdata/rss2_only_link.xml b/hub/feed_diff_testdata/rss2_only_link.xml deleted file mode 100644 index ba254d6..0000000 --- a/hub/feed_diff_testdata/rss2_only_link.xml +++ /dev/null @@ -1,24 +0,0 @@ - - - - Liftoff News - http://liftoff.msfc.nasa.gov/ - Liftoff to Space Exploration. - en-us - Tue, 10 Jun 2003 04:00:00 GMT - Tue, 10 Jun 2003 09:41:01 GMT - http://blogs.law.harvard.edu/tech/rss - Weblog Editor 2.0 - editor@example.com - webmaster@example.com - - http://liftoff.msfc.nasa.gov/news/2003/news-starcity.asp - - - http://liftoff.msfc.nasa.gov/news/2003/news-VASIMR.asp - - - http://liftoff.msfc.nasa.gov/news/2003/news-laundry.asp - - - \ No newline at end of file diff --git a/hub/feed_diff_testdata/rss2_only_title.xml b/hub/feed_diff_testdata/rss2_only_title.xml deleted file mode 100644 index 1b2a2f2..0000000 --- a/hub/feed_diff_testdata/rss2_only_title.xml +++ /dev/null @@ -1,24 +0,0 @@ - - - - Liftoff News - http://liftoff.msfc.nasa.gov/ - Liftoff to Space Exploration. - en-us - Tue, 10 Jun 2003 04:00:00 GMT - Tue, 10 Jun 2003 09:41:01 GMT - http://blogs.law.harvard.edu/tech/rss - Weblog Editor 2.0 - editor@example.com - webmaster@example.com - - Star City - - - The Engine That Does More - - - Astronauts' Dirty Laundry - - - \ No newline at end of file diff --git a/hub/feed_diff_testdata/rss2sample.xml b/hub/feed_diff_testdata/rss2sample.xml deleted file mode 100644 index bcc516d..0000000 --- a/hub/feed_diff_testdata/rss2sample.xml +++ /dev/null @@ -1,42 +0,0 @@ - - - - Liftoff News - http://liftoff.msfc.nasa.gov/ - Liftoff to Space Exploration. - en-us - Tue, 10 Jun 2003 04:00:00 GMT - Tue, 10 Jun 2003 09:41:01 GMT - http://blogs.law.harvard.edu/tech/rss - Weblog Editor 2.0 - editor@example.com - webmaster@example.com - - - Star City - http://liftoff.msfc.nasa.gov/news/2003/news-starcity.asp - How do Americans get ready to work with Russians aboard the International Space Station? They take a crash course in culture, language and protocol at Russia's <a href="http://howe.iki.rssi.ru/GCTC/gctc_e.htm">Star City</a>. - Tue, 03 Jun 2003 09:39:21 GMT - http://liftoff.msfc.nasa.gov/2003/06/03.html#item573 - - - Sky watchers in Europe, Asia, and parts of Alaska and Canada will experience a <a href="http://science.nasa.gov/headlines/y2003/30may_solareclipse.htm">partial eclipse of the Sun</a> on Saturday, May 31st. - Fri, 30 May 2003 11:06:42 GMT - http://liftoff.msfc.nasa.gov/2003/05/30.html#item572 - - - The Engine That Does More - http://liftoff.msfc.nasa.gov/news/2003/news-VASIMR.asp - Before man travels to Mars, NASA hopes to design new engines that will let us fly through the Solar System more quickly. The proposed VASIMR engine would do that. - Tue, 27 May 2003 08:37:32 GMT - http://liftoff.msfc.nasa.gov/2003/05/27.html#item571 - - - Astronauts' Dirty Laundry - http://liftoff.msfc.nasa.gov/news/2003/news-laundry.asp - Compared to earlier spacecraft, the International Space Station has many luxuries, but laundry facilities are not one of them. Instead, astronauts have other options. - Tue, 20 May 2003 08:56:02 GMT - http://liftoff.msfc.nasa.gov/2003/05/20.html#item570 - - - \ No newline at end of file diff --git a/hub/feed_diff_testdata/rss_no_link.xml b/hub/feed_diff_testdata/rss_no_link.xml deleted file mode 100644 index 1deec62..0000000 --- a/hub/feed_diff_testdata/rss_no_link.xml +++ /dev/null @@ -1,24 +0,0 @@ - - - - WriteTheWeb - News for web users that write back - en-us - Copyright 2000, WriteTheWeb team. - editor@writetheweb.com - webmaster@writetheweb.com - - WriteTheWeb - http://writetheweb.com/images/mynetscape88.gif - http://writetheweb.com - 88 - 31 - News for web users that write back - - - Giving the world a pluggable Gnutella - http://writetheweb.com/read.php?item=24 - WorldOS is a framework on which to build programs that work like Freenet or Gnutella -allowing distributed applications using peer-to-peer routing. - - - \ No newline at end of file diff --git a/hub/feed_diff_testdata/rss_rdf.xml b/hub/feed_diff_testdata/rss_rdf.xml deleted file mode 100644 index ecc92b6..0000000 --- a/hub/feed_diff_testdata/rss_rdf.xml +++ /dev/null @@ -1,30 +0,0 @@ - - - - WriteTheWeb - http://writetheweb.com - News for web users that write back - en-us - Copyright 2000, WriteTheWeb team. - editor@writetheweb.com - webmaster@writetheweb.com - - WriteTheWeb - http://writetheweb.com/images/mynetscape88.gif - http://writetheweb.com - 88 - 31 - News for web users that write back - - - Giving the world a pluggable Gnutella - http://writetheweb.com/read.php?item=24 - WorldOS is a framework on which to build programs that work like Freenet or Gnutella -allowing distributed applications using peer-to-peer routing. - - - Syndication discussions hot up - http://writetheweb.com/read.php?item=23 - After a period of dormancy, the Syndication mailing list has become active again, with contributions from leaders in traditional media and Web syndication. - - - diff --git a/hub/feed_diff_testdata/sampleRss091.xml b/hub/feed_diff_testdata/sampleRss091.xml deleted file mode 100644 index b86ca2d..0000000 --- a/hub/feed_diff_testdata/sampleRss091.xml +++ /dev/null @@ -1,50 +0,0 @@ - - - - WriteTheWeb - http://writetheweb.com - News for web users that write back - en-us - Copyright 2000, WriteTheWeb team. - editor@writetheweb.com - webmaster@writetheweb.com - - WriteTheWeb - http://writetheweb.com/images/mynetscape88.gif - http://writetheweb.com - 88 - 31 - News for web users that write back - - - Giving the world a pluggable Gnutella - http://writetheweb.com/read.php?item=24 - WorldOS is a framework on which to build programs that work like Freenet or Gnutella -allowing distributed applications using peer-to-peer routing. - - - Syndication discussions hot up - http://writetheweb.com/read.php?item=23 - After a period of dormancy, the Syndication mailing list has become active again, with contributions from leaders in traditional media and Web syndication. - - - Personal web server integrates file sharing and messaging - http://writetheweb.com/read.php?item=22 - The Magi Project is an innovative project to create a combined personal web server and messaging system that enables the sharing and synchronization of information across desktop, laptop and palmtop devices. - - - Syndication and Metadata - http://writetheweb.com/read.php?item=21 - RSS is probably the best known metadata format around. RDF is probably one of the least understood. In this essay, published on my O'Reilly Network weblog, I argue that the next generation of RSS should be based on RDF. - - - UK bloggers get organised - http://writetheweb.com/read.php?item=20 - Looks like the weblogs scene is gathering pace beyond the shores of the US. There's now a UK-specific page on weblogs.com, and a mailing list at egroups. - - - Yournamehere.com more important than anything - http://writetheweb.com/read.php?item=19 - Whatever you're publishing on the web, your site name is the most valuable asset you have, according to Carl Steadman. - - - \ No newline at end of file diff --git a/hub/feed_diff_testdata/sampleRss092.xml b/hub/feed_diff_testdata/sampleRss092.xml deleted file mode 100644 index db26c52..0000000 --- a/hub/feed_diff_testdata/sampleRss092.xml +++ /dev/null @@ -1,49 +0,0 @@ - - - - - Dave Winer: Grateful Dead - http://www.scripting.com/blog/categories/gratefulDead.html - A high-fidelity Grateful Dead song every day. This is where we're experimenting with enclosures on RSS news items that download when you're not using your computer. If it works (it will) it will be the end of the Click-And-Wait multimedia experience on the Internet. - Fri, 13 Apr 2001 19:23:02 GMT - http://backend.userland.com/rss092 - dave@userland.com (Dave Winer) - dave@userland.com (Dave Winer) - - - It's been a few days since I added a song to the Grateful Dead channel. Now that there are all these new Radio users, many of whom are tuned into this channel (it's #16 on the hotlist of upstreaming Radio users, there's no way of knowing how many non-upstreaming users are subscribing, have to do something about this..). Anyway, tonight's song is a live version of Weather Report Suite from Dick's Picks Volume 7. It's wistful music. Of course a beautiful song, oft-quoted here on Scripting News. <i>A little change, the wind and rain.</i> - - - - - Kevin Drennan started a <a href="http://deadend.editthispage.com/">Grateful Dead Weblog</a>. Hey it's cool, he even has a <a href="http://deadend.editthispage.com/directory/61">directory</a>. <i>A Frontier 7 feature.</i> - Scripting News - - - <a href="http://arts.ucsc.edu/GDead/AGDL/other1.html">The Other One</a>, live instrumental, One From The Vault. Very rhythmic very spacy, you can listen to it many times, and enjoy something new every time. - - - - This is a test of a change I just made. Still diggin.. - - - The HTML rendering almost <a href="http://validator.w3.org/check/referer">validates</a>. Close. Hey I wonder if anyone has ever published a style guide for ALT attributes on images? What are you supposed to say in the ALT attribute? I sure don't know. If you're blind send me an email if u cn rd ths. - - - <a href="http://www.cs.cmu.edu/~mleone/gdead/dead-lyrics/Franklin's_Tower.txt">Franklin's Tower</a>, a live version from One From The Vault. - - - - Moshe Weitzman says Shakedown Street is what I'm lookin for for tonight. I'm listening right now. It's one of my favorites. "Don't tell me this town ain't got no heart." Too bright. I like the jazziness of Weather Report Suite. Dreamy and soft. How about The Other One? "Spanish lady come to me.." - Scripting News - - - <a href="http://www.scripting.com/mp3s/youWinAgain.mp3">The news is out</a>, all over town..<p> -You've been seen, out runnin round. <p> -The lyrics are <a href="http://www.cs.cmu.edu/~mleone/gdead/dead-lyrics/You_Win_Again.txt">here</a>, short and sweet. <p> -<i>You win again!</i> - - - - - \ No newline at end of file diff --git a/hub/feed_diff_testdata/whitespace_id.xml b/hub/feed_diff_testdata/whitespace_id.xml deleted file mode 100644 index 2a8fbb0..0000000 --- a/hub/feed_diff_testdata/whitespace_id.xml +++ /dev/null @@ -1,34 +0,0 @@ - - - -dive into mark -everything old is new again -2008-08-23T04:49:22Z - - - - - my feed id here - - - - - -Mark -http://diveintomark.org/ - -<![CDATA[The ampersands of Linux]]> - -tag:diveintomark.org,2008-08-14:/archives/20080814215936 -2008-08-14T23:08:54Z -2008-08-14T21:59:36Z -Please try to contain your excitement. -<p>Taking an idea from <a href="http://www.simplebits.com/notebook/2008/08/14/ampersands.html">Use the Best Available Ampersand</a> and a list of pre-installed fonts from the <a href="http://www.apaddedcell.com/web-fonts">Complete Guide to Pre-Installed Fonts in Linux, Mac, and Windows</a>, I present &#8220;The Ampersands of Linux&#8221;:</p> - -<p><img src="http://wearehugh.com/public/2008/08/ampersands-of-linux3.png" alt="[ampersands in 28 fonts]" height="900" width="600"></p> - -<p>(<a href="http://wearehugh.com/public/2008/08/ampersands-of-linux.html"><abbr>HTML</abbr></a>)</p> - -<p>Please try to contain your excitement.</p> - - diff --git a/hub/feed_diff_testdata/xhtml_entities.xml b/hub/feed_diff_testdata/xhtml_entities.xml deleted file mode 100644 index b33f8cf..0000000 --- a/hub/feed_diff_testdata/xhtml_entities.xml +++ /dev/null @@ -1,3 +0,0 @@ - - -© diff --git a/hub/feed_identifier.py b/hub/feed_identifier.py deleted file mode 100644 index 530b209..0000000 --- a/hub/feed_identifier.py +++ /dev/null @@ -1,137 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -__author__ = 'bslatkin@gmail.com (Brett Slatkin)' - -"""Atom/RSS feed parser that determines a feed's canonical ID.""" - -import cStringIO -import logging -import re -import xml.sax -import xml.sax.handler -import xml.sax.saxutils - - -# Set to true to see stack level messages and other debugging information. -DEBUG = False - - -class TrivialEntityResolver(xml.sax.handler.EntityResolver): - """Pass-through entity resolver.""" - - def resolveEntity(self, publicId, systemId): - return cStringIO.StringIO() - - -class FeedIdentifier(xml.sax.handler.ContentHandler): - """Base SAX content handler for identifying feeds.""" - - target_tag_stack = None - - def __init__(self, parser): - """Initializer. - - Args: - parser: Instance of the xml.sax parser being used with this handler. - """ - self.parser = parser - self.link = [] - self.tag_stack = [] - self.capture_next_element = False - - # SAX methods - def startElement(self, name, attrs): - if not self.link: - if DEBUG: logging.debug('Start stack level for %r', name) - self.tag_stack.append(name) - if len(self.tag_stack) == len(self.target_tag_stack): - equal = True - for value, predicate in zip(self.tag_stack, self.target_tag_stack): - if not predicate(value): - equal = False - break - if equal: - self.capture_next_element = True - - def endElement(self, name): - if self.link: - self.capture_next_element = False - else: - if DEBUG: logging.debug('End stack level %r', name) - self.tag_stack.pop() - - def characters(self, content): - if self.capture_next_element: - self.link.append(content) - - def get_link(self): - if not self.link: - return None - else: - return ''.join(self.link).strip() - - -class AtomFeedIdentifier(FeedIdentifier): - """SAX content handler for identifying Atom feeds.""" - - target_tag_stack = [ - re.compile(k).match for k in ( - '([^:]+:)?feed$', - '([^:]+:)?id$')] - - -class RssFeedIdentifier(FeedIdentifier): - """SAX content handler for identifying RSS feeds.""" - - target_tag_stack = ( - [re.compile('^(?i)(rss)|(.*rdf)$').match] + - [re.compile(k).match for k in ('channel', 'link')]) - - -def identify(data, format): - """Identifies a feed. - - Args: - data: String containing the data of the XML feed to parse. - format: String naming the format of the data. Should be 'rss' or 'atom'. - - Returns: - The ID of the feed, or None if one could not be determined (due to parse - errors, etc). - - Raises: - xml.sax.SAXException on parse errors. - """ - data_stream = cStringIO.StringIO(data) - parser = xml.sax.make_parser() - - if format == 'atom': - handler = AtomFeedIdentifier(parser) - elif format == 'rss': - handler = RssFeedIdentifier(parser) - else: - assert False, 'Invalid feed format "%s"' % format - - parser.setContentHandler(handler) - parser.setEntityResolver(TrivialEntityResolver()) - parser.parse(data_stream) - - return handler.get_link() - - -__all__ = ['identify', 'DEBUG'] diff --git a/hub/feed_identifier_test.py b/hub/feed_identifier_test.py deleted file mode 100755 index 8c6dd46..0000000 --- a/hub/feed_identifier_test.py +++ /dev/null @@ -1,108 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -__author__ = 'bslatkin@gmail.com (Brett Slatkin)' - -"""Tests for the feed_identifier module.""" - -import logging -import os -import unittest -import xml.sax - -import feed_identifier - - -class TestBase(unittest.TestCase): - - def setUp(self): - self.testdata = os.path.join(os.path.dirname(__file__), - 'feed_diff_testdata') - - def load(self, path): - return open(os.path.join(self.testdata, path)).read() - - -class AtomTest(TestBase): - """Tests for identifying Atom-formatted feeds.""" - - def testGood(self): - feed_id = feed_identifier.identify(self.load('parsing.xml'), 'atom') - self.assertEquals('tag:diveintomark.org,2001-07-29:/', feed_id) - - def testNoFeedId(self): - feed_id = feed_identifier.identify(self.load('atom_no_id.xml'), 'atom') - self.assertTrue(feed_id is None) - - def testIncorrectFormat(self): - feed_id = feed_identifier.identify(self.load('rss_rdf.xml'), 'atom') - self.assertTrue(feed_id is None) - - def testWhitespace(self): - feed_id = feed_identifier.identify(self.load('whitespace_id.xml'), 'atom') - self.assertEquals('my feed id here', feed_id) - - def testBadFormat(self): - self.assertRaises(xml.sax.SAXParseException, - feed_identifier.identify, - self.load('bad_feed.xml'), - 'atom') - - def testFullNamespace(self): - feed_id = feed_identifier.identify(self.load('atom_namespace.xml'), 'atom') - self.assertEquals('http://example.com/feeds/delta', feed_id) - - -class RssTest(TestBase): - """Tests for identifying RSS-formatted feeds.""" - - def testGood091(self): - feed_id = feed_identifier.identify(self.load('sampleRss091.xml'), 'rss') - self.assertEquals('http://writetheweb.com', feed_id) - - def testGood092(self): - feed_id = feed_identifier.identify(self.load('sampleRss092.xml'), 'rss') - self.assertEquals( - 'http://www.scripting.com/blog/categories/gratefulDead.html', - feed_id) - - def testGood20(self): - feed_id = feed_identifier.identify(self.load('rss2sample.xml'), 'rss') - self.assertEquals('http://liftoff.msfc.nasa.gov/', feed_id) - - def testGoodRdf(self): - feed_id = feed_identifier.identify(self.load('rss_rdf.xml'), 'rss') - self.assertEquals('http://writetheweb.com', feed_id) - - def testNoFeedId(self): - feed_id = feed_identifier.identify(self.load('rss_no_link.xml'), 'rss') - self.assertTrue(feed_id is None) - - def testIncorrectFormat(self): - feed_id = feed_identifier.identify(self.load('parsing.xml'), 'rss') - self.assertTrue(feed_id is None) - - def testBadFormat(self): - self.assertRaises(xml.sax.SAXParseException, - feed_identifier.identify, - self.load('bad_feed.xml'), - 'rss') - - -if __name__ == '__main__': - feed_identifier.DEBUG = True - unittest.main() diff --git a/hub/fork_join_queue.py b/hub/fork_join_queue.py deleted file mode 100644 index 1a97495..0000000 --- a/hub/fork_join_queue.py +++ /dev/null @@ -1,512 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2010 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Fork-join queue for App Engine. - -The Task Queue API executes tasks in a push manner instead of polling with -visibility time like Amazon SQS and other workqueue systems. However, often -you may need to process multiple pieces of queued work simultaneously in a -single App Engine request; the benefit being that you can minimize the -impact of high latency API calls that block and occupy a thread by doing many -asynchronous calls in parallel. - -Fork-join queues have three important parameters: - - * Batch Time: How often new task entities added to the queue should be - coalesced to run as a single unit in parallel. This should be low - enough to not drastically affect latency, but high enough that its - batching effects result in fewer overall occupied threads. - - * Batch Size: How many task entities to run at a time in a single request. - This should be tuned for your asynchronous work's maximum wall-clock time - and the maximum asynchronous API calls need to do in parallel. - - * Shard count: (optional) How many parallel shards to use for this queue. - This represents the minimum parallelism you'll see since you won't get - coalescing until you have at least as many tasks as shards. - -How it works: - -1. Incoming, Datastore entities representing work items are assigned an index -number and committed. A shard number is assigned for load-balancing based on -the index assigned. - -2. After the work entities are committed to the Datastore, corresponding -push-oriented taskqueue tasks are put on the push queue. These push tasks have -an ETA of the next highest time interval for the fork-queue based on the batch -time. The magical part here is that many task entities in the same batch time -will "dedupe" their push-task enqueueing by getting a tombstone/exists error -because they have overlapping task names (based on the work index). Thus, many -separate physical tasks entities will *fan-in* to a single logical task. - -3. The push task runs *after* all work item entities have been written to the -Datastore (guaranteed with a reader/writer lock). The task queries for work in -its particular work index region. It then handles these tasks (in user code) -and allows the task to complete. The task entities need not be deleted. - -4. (optional) When tasks are popped from the fork-join queue, a continuation -task will be enqueued immediately after the batch size is received to do -more work in parallel in smaller chunk sizes. - - -Obligatory diagram (where numbers correspond to batch generations): - -|---------|---------|---> time - ^ ^ ^ ^ ^ ^ ^ ^ ^ - 1 1 1 1 R 2 2 2 R - u u - n n - 1 2 - - -Nota Bene: A naive approach to pull-oriented queues (constantly query on an -'eta' parameter sorting by 'eta' descending, then delete finished entities) may -result in poor performance because of how the Datastore's garbage collection -interacts with Datastore queries and Bigtable's tablet splitting behavior. -Using contiguous row indexes on any work item properties can have the same -effect, so a hash of the sequential work index is used to ensure balancing -across tablets. -""" - -import datetime -import logging -import os -import random -import time - -from google.net.proto import ProtocolBuffer -from google.appengine.api import memcache -from google.appengine.api import taskqueue -from google.appengine.ext import db - -# TODO: Consider using multiple work indexes to alleviate the memcache -# hotspot for the writer path. - -################################################################################ - -def knuth_hash(number): - """A decent hash function for integers.""" - return (number * 2654435761) % 2**32 - - -def datetime_from_stamp(stamp): - """Converts a UNIX timestamp to a datetime.datetime including microseconds.""" - result = datetime.datetime.utcfromtimestamp(stamp) - result += datetime.timedelta(microseconds=10**6 * (stamp - int(stamp))) - return result - - -class Error(Exception): - """Base-class for exceptions in this module.""" - -class WriterLockError(Error): - """When the task adder could not increment the writer lock.""" - -class CannotGetIndexError(Error): - """When the task adder could not get a starting index from memcache.""" - -class TaskConflictError(Error): - """The added task has already ran, meaning the work index is invalid.""" - -class MemcacheError(Error): - """Enqueuing the work item in memcache failed.""" - - -class ForkJoinQueue(object): - """A fork-join queue for App Engine.""" - - FAKE_ZERO = 2**16 - LOCK_OFFSET = FAKE_ZERO / 2 - - def __init__(self, - model_class, - index_property, - task_path, - queue_name, - batch_size=None, - batch_period_ms=None, - lock_timeout_ms=None, - sync_timeout_ms=None, - stall_timeout_ms=None, - acquire_timeout_ms=None, - acquire_attempts=None): - """Initializer. - - Args: - model_class: The model class for work items. - index_property: The model class's property for work indexes. - task_path: Path where joined tasks should run. - queue_name: Queue on which joined tasks should run. - batch_size: How many work items to process at a time before spawning - another task generation to handle more. - batch_period_ms: How often, in milliseconds, to batch work items. - lock_timeout_ms: How long to wait, in milliseconds, for all writers - before a joined task executes. - sync_timeout_ms: How long it takes, in milliseconds, for writers to - finish enqueueing work before readers should attempt to acquire the - lock again. - stall_timeout_ms: How often task queue naming overlaps should be - rotated, in milliseconds, in order to prevent the queue stall caused - by memcache outages. - acquire_timeout_ms: How long to wait, in milliseconds, for writers to - acquire a new index on each attempt. - acquire_attempts: How many times writers should attempt to get new - indexes before raising an error. - """ - # TODO: Add validation. - self.model_class = model_class - self.name = 'fjq-' + model_class.kind() - self.index_property = index_property - self.task_path = task_path - self.queue_name = queue_name - self.batch_size = batch_size - self.lock_timeout = lock_timeout_ms / 1000.0 - self.sync_attempts = int(1.0 * lock_timeout_ms / sync_timeout_ms) - self.sync_timeout = sync_timeout_ms / 1000.0 - self.stall_timeout = stall_timeout_ms / 1000.0 - self.acquire_timeout = acquire_timeout_ms / 1000.0 - self.acquire_attempts = acquire_attempts - if batch_period_ms == 0: - self.batch_delta = None - else: - self.batch_delta = datetime.timedelta(microseconds=batch_period_ms * 1000) - - def get_queue_name(self, index): - """Returns the name of the queue to use based on the given work index.""" - return self.queue_name - - @property - def lock_name(self): - """Returns the lock key prefix for the current prefix name.""" - return self.name + '-lock' - - @property - def add_counter_template(self): - """Returns the add counter prefix template for the current prefix name.""" - return self.name + '-add-lock:%d' - - @property - def index_name(self): - """Returns the index key prefix for the current prefix name.""" - return self.name + '-index' - - def next_index(self, - memget=memcache.get, - memincr=memcache.incr, - memdecr=memcache.decr): - """Reserves the next work index. - - Args: - memget, memincr, memdecr: Used for testing. - - Returns: - The next work index to use for work. - """ - for i in xrange(self.acquire_attempts): - next_index = memget(self.index_name) - if next_index is None: - memcache.add(self.index_name, 1) - next_index = memget(self.index_name) - if next_index is None: - # Can't get it or add it, which means memcache is probably down. - # Handle this as a separate fast-path to prevent memcache overload - # during memcache failures. - raise CannotGetIndexError( - 'Cannot establish new task index in memcache.') - - next_index = knuth_hash(int(next_index)) - add_counter = self.add_counter_template % next_index - count = memincr(add_counter, 1, initial_value=self.FAKE_ZERO) - if count < self.FAKE_ZERO: - # When the counter is super negative that means this index has been - # locked and we can no longer add tasks to it. We need to "refund" the - # reader lock we took to ensure the worker doesn't wait for it. - memdecr(add_counter, 1) - else: - return next_index - time.sleep(self.acquire_timeout) - else: - # Force the index forward; here we're stuck in a loop where the memcache - # index was evicted and all new lock acqusitions are reusing old locks - # that were already closed off to new writers. - memincr(self.index_name) - raise WriterLockError('Task adder could not increment writer lock.') - - def add(self, index, gettime=time.time): - """Adds a task for a work index, decrementing the writer lock.""" - now_stamp = gettime() - # Nearest gap used to kickstart the queues when a task is dropped or - # memcache is evicted. This prevents new task names from overlapping with - # old ones. - nearest_gap = int(now_stamp / self.stall_timeout) - # Include major version in the task name to ensure that test tasks - # enqueued from a non-default major version will run in the new context - # instead of the default major version. - major_version, minor_version = os.environ['CURRENT_VERSION_ID'].split('.') - task_name = '%s-%s-%d-%d-%d' % ( - self.name, major_version, nearest_gap, index, 0) - - # When the batch_period_ms is zero, then there should be no ETA, the task - # should run immediately and the reader will busy wait for all writers. - if self.batch_delta is None: - eta = None - else: - eta = datetime_from_stamp(now_stamp) + self.batch_delta - - try: - taskqueue.Task( - method='POST', - name=task_name, - url=self.task_path, - eta=eta - ).add(self.get_queue_name(index)) - if self.batch_delta is None: - # When the batch_period_ms is zero, we want to immediately move the - # index to the next position as soon as the current batch finishes - # writing its task. This will only run for the first successful task - # inserter. - memcache.incr(self.index_name) - except taskqueue.TaskAlreadyExistsError: - # This is okay. It means the task has already been inserted by another - # add() call for this same batch. We're holding the lock at this point - # so we know that job won't start yet. - pass - except taskqueue.TombstonedTaskError, e: - # This is bad. This means 1) the lock we held expired and the task already - # ran, 2) this task name somehow overlaps with an old task. Return the - # error to the caller so they can try again. - raise TaskConflictError('Task named tombstoned: %s' % e) - finally: - # Don't bother checking the decr status; worst-case the worker job - # will time out after some number of seconds and proceed anyways. - memcache.decr(self.add_counter_template % index, 1) - - def _increment_index(self, last_index): - """Moves the work index forward and waits for all writers. - - Args: - last_index: The last index that was used for the reader/writer lock. - - Returns: - True if all writers were definitely finished; False if the reader/writer - lock timed out and we are proceeding anyways. - """ - # Increment the batch index counter so incoming jobs will use a new index. - # Don't bother setting an initial value here because next_index() will - # do this when it notices no current index is present. Do this *before* - # closing the reader/writer lock below to decrease active writers on the - # current index. - # We do this even in the case that batch_period_ms was zero, just in case - # that memcache operation failed for some reason, we'd rather have more - # batches then have the work index pipeline stall. - memcache.incr(self.index_name) - - # Prevent new writers by making the counter extremely negative. If the - # decrement fails here we can't recover anyways, so just let the worker go. - add_counter = self.add_counter_template % last_index - memcache.decr(add_counter, self.LOCK_OFFSET) - - for i in xrange(self.sync_attempts): - counter = memcache.get(add_counter) - # Less than or equal LOCK_OFFSET here in case a writer decrements twice - # due to rerunning failure tasks. - if counter is None or int(counter) <= self.LOCK_OFFSET: - # Worst-case the counter will be gone due to memcache eviction, which - # means the worker can procede with without waiting for writers - # and just process whatever it can find. This may drop some work. - return True - time.sleep(self.sync_timeout) - else: - logging.critical('Worker for %s gave up waiting for writers', self.name) - - return False - - def _query_work(self, index, cursor): - """Queries for work in the Datastore.""" - query = (self.model_class.all() - .filter('%s =' % self.index_property.name, index) - .order('__key__')) - if cursor: - query.with_cursor(cursor) - result_list = query.fetch(self.batch_size) - return result_list, query.cursor() - - def pop_request(self, request): - """Pops work to be done based on a task queue request. - - Args: - request: webapp.Request with the task payload. - - Returns: - A list of work items, if any. - """ - # TODO: Use request.headers['X-AppEngine-TaskName'] instead of environ. - return self.pop(os.environ['HTTP_X_APPENGINE_TASKNAME'], - request.get('cursor')) - - def pop(self, task_name, cursor=None): - """Pops work to be done based on just the task name. - - Args: - task_name: The name of the task. - cursor: The value of the cursor for this task (optional). - - Returns: - A list of work items, if any. - """ - rest, index, generation = task_name.rsplit('-', 2) - index, generation = int(index), int(generation) - - if not cursor: - # The root worker task already waited for all writers, so continuation - # tasks can start processing immediately. - self._increment_index(index) - - result_list, cursor = self._query_work(index, cursor) - - if len(result_list) == self.batch_size: - for i in xrange(3): - try: - taskqueue.Task( - method='POST', - name='%s-%d-%d' % (rest, index, generation + 1), - url=self.task_path, - params={'cursor': cursor} - ).add(self.get_queue_name(index)) - break - except (taskqueue.TaskAlreadyExistsError, - taskqueue.TombstonedTaskError): - # This means the continuation chain already started and this root - # task failed for some reason; no problem. - break - except (taskqueue.TransientError, taskqueue.InternalError): - # Ignore transient taskqueue errors. - if i == 2: - raise - - return result_list - - -class ShardedForkJoinQueue(ForkJoinQueue): - """A fork-join queue that shards actual work across multiple task queues.""" - - def __init__(self, *args, **kwargs): - """Initialized. - - Args: - *args, **kwargs: Passed to ForkJoinQueue. - shard_count: How many queues there are for sharding the incoming work. - """ - self.shard_count = kwargs.pop('shard_count') - ForkJoinQueue.__init__(self, *args, **kwargs) - - def get_queue_name(self, index): - return self.queue_name % {'shard': 1 + (index % self.shard_count)} - - -class MemcacheForkJoinQueue(ShardedForkJoinQueue): - """A fork-join queue that only stores work items in memcache. - - To use, call next_index() to get the work index then call the put() method, - passing one or more model instances to enqueued in memcache. - - Also a sharded queue for maximum throughput. - """ - - def __init__(self, *args, **kwargs): - """Initializer. - - Args: - *args, **kwargs: Passed to ShardedForkJoinQueue. - expiration_seconds: How long items inserted into memcache should remain - until they are evicted due to timeout. Default is 0, meaning they - will never be evicted. - """ - if 'expiration_seconds' in kwargs: - self.expiration_seconds = kwargs.pop('expiration_seconds') - else: - self.expiration_seconds = 0 - ShardedForkJoinQueue.__init__(self, *args, **kwargs) - - def _create_length_key(self, index): - """Creates a length memecache key for the length of the in-memory queue.""" - return '%s:length:%d' % (self.name, index) - - def _create_index_key(self, index, number): - """Creates an index memcache key for the given in-memory queue location.""" - return '%s:index:%d-%d' % (self.name, index, number) - - def put(self, - index, - entity_list, - memincr=memcache.incr, - memset=memcache.set_multi): - """Enqueue a model instance on this queue. - - Does not write to the Datastore. - - Args: - index: The work index for this entity. - entity_list: List of work entities to insert into the in-memory queue. - memincr, memset: Used for testing. - - Raises: - MemcacheError if the entities were not successfully added. - """ - length_key = self._create_length_key(index) - end = memincr(length_key, len(entity_list), initial_value=0) - if end is None: - raise MemcacheError('Could not increment length key %r' % length_key) - - start = end - len(entity_list) - key_map = {} - for number, entity in zip(xrange(start, end), entity_list): - key_map[self._create_index_key(index, number)] = db.model_to_protobuf( - entity) - - result = memset(key_map, time=self.expiration_seconds) - if result: - raise MemcacheError('Could not set memcache keys %r' % result) - - def _query_work(self, index, cursor): - """Queries for work in memcache.""" - if cursor: - try: - cursor = int(cursor) - except ValueError: - # This is an old style task that resides in the Datastore, not - # memcache. Use the parent implementation instead. - return super(MemcacheForkJoinQueue, self)._query_work(index, cursor) - else: - cursor = 0 - - key_list = [self._create_index_key(index, n) - for n in xrange(cursor, cursor + self.batch_size)] - results = memcache.get_multi(key_list) - - result_list = [] - for key in key_list: - proto = results.get(key) - if not proto: - continue - try: - result_list.append(db.model_from_protobuf(proto)) - except ProtocolBuffer.ProtocolBufferDecodeError: - logging.exception('Could not decode EntityPb at memcache key %r: %r', - key, proto) - - return result_list, cursor + self.batch_size diff --git a/hub/fork_join_queue_test.py b/hub/fork_join_queue_test.py deleted file mode 100755 index 3b351dc..0000000 --- a/hub/fork_join_queue_test.py +++ /dev/null @@ -1,539 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2010 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Tests for the fork_join_queue module.""" - -import datetime -import logging -logging.basicConfig(format='%(levelname)-8s %(filename)s] %(message)s') -import os -import random -import sys -import unittest - -import testutil -testutil.fix_path() - -from google.appengine.api import apiproxy_stub_map -from google.appengine.api import memcache -from google.appengine.ext import db -from google.appengine.ext import webapp - -import fork_join_queue - -################################################################################ - -class TestModel(db.Model): - work_index = db.IntegerProperty() - number = db.IntegerProperty() - - -TEST_QUEUE = fork_join_queue.ForkJoinQueue( - TestModel, - TestModel.work_index, - '/path/to/my/task', - 'default', - batch_size=3, - batch_period_ms=2200, - lock_timeout_ms=1000, - sync_timeout_ms=250, - stall_timeout_ms=30000, - acquire_timeout_ms=50, - acquire_attempts=20) - - -TEST_QUEUE_ZERO_BATCH_TIME = fork_join_queue.ForkJoinQueue( - TestModel, - TestModel.work_index, - '/path/to/my/task', - 'default', - batch_size=3, - batch_period_ms=0, - lock_timeout_ms=1000, - sync_timeout_ms=250, - stall_timeout_ms=30000, - acquire_timeout_ms=50, - acquire_attempts=20) - - -SHARDED_QUEUE = fork_join_queue.ShardedForkJoinQueue( - TestModel, - TestModel.work_index, - '/path/to/my/task', - 'default-%(shard)s', - batch_size=3, - batch_period_ms=2200, - lock_timeout_ms=1000, - sync_timeout_ms=250, - stall_timeout_ms=30000, - acquire_timeout_ms=50, - acquire_attempts=20, - shard_count=4) - - -MEMCACHE_QUEUE = fork_join_queue.MemcacheForkJoinQueue( - TestModel, - TestModel.work_index, - '/path/to/my/task', - 'default', - batch_size=3, - batch_period_ms=2200, - lock_timeout_ms=1000, - sync_timeout_ms=250, - stall_timeout_ms=30000, - acquire_timeout_ms=50, - acquire_attempts=20, - shard_count=4) - - -class ForkJoinQueueTest(unittest.TestCase): - """Tests for the ForkJoinQueue class.""" - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing(require_indexes=False) - self.now1 = 1274078068.886692 - self.now2 = 1274078097.79072 - self.gettime1 = lambda: self.now1 - self.gettime2 = lambda: self.now2 - os.environ['CURRENT_VERSION_ID'] = 'myversion.1234' - if 'HTTP_X_APPENGINE_TASKNAME' in os.environ: - del os.environ['HTTP_X_APPENGINE_TASKNAME'] - - def expect_task(self, - index, - generation=0, - now_time=None, - cursor=None, - batch_period_ms=2200000): - """Creates an expected task dictionary.""" - if now_time is None: - now_time = self.now1 - gap_number = int(now_time / 30.0) - import math - work_item = { - 'name': 'fjq-TestModel-myversion-%d-%d-%d' % ( - gap_number, index, generation), - # Working around weird rounding behavior of task queue stub. - 'eta': (10**6 * now_time) + batch_period_ms, - } - if cursor is not None: - work_item['cursor'] = cursor - return work_item - - def assertTasksEqual(self, expected_tasks, found_tasks, - check_eta=True): - """Asserts two lists of tasks are equal.""" - found_tasks.sort(key=lambda t: t['eta']) - for expected, found in zip(expected_tasks, found_tasks): - self.assertEquals(expected['name'], found['name']) - if check_eta: - # Round these task ETAs to integers because the taskqueue stub does - # not support floating-point ETAs. - self.assertEquals(round(expected['eta'] / 10**6), - round(found['eta'] / 10**6)) - self.assertEquals(expected.get('cursor'), - found.get('params', {}).get('cursor')) - self.assertEquals('POST', found['method']) - self.assertEquals('/path/to/my/task', found['url']) - self.assertEquals(len(expected_tasks), len(found_tasks)) - - def testAddOne(self): - """Tests adding a single entity to the queue.""" - t = TestModel(number=1) - t.work_index = TEST_QUEUE.next_index() - t.put() - TEST_QUEUE.add(t.work_index, gettime=self.gettime1) - self.assertTasksEqual( - [self.expect_task(t.work_index)], - testutil.get_tasks('default', usec_eta=True)) - - def testAddMultiple(self): - """Tests adding multiple tasks on the same index.""" - t1 = TestModel(number=1) - t2 = TestModel(number=2) - t3 = TestModel(number=3) - - tasks = [t1, t2, t3] - work_index = TEST_QUEUE.next_index() - for t in tasks: - t.work_index = work_index - db.put(tasks) - TEST_QUEUE.add(work_index, gettime=self.gettime1) - - self.assertTasksEqual( - [self.expect_task(work_index)], - testutil.get_tasks('default', usec_eta=True)) - - def testAddMultipleDifferent(self): - """Tests adding multiple different tasks to different indexes.""" - t1 = TestModel(number=1) - t2 = TestModel(number=2) - t3 = TestModel(number=3) - - tasks1 = [t1, t2, t3] - work_index = TEST_QUEUE.next_index() - for t in tasks1: - t.work_index = work_index - db.put(tasks1) - TEST_QUEUE.add(work_index, gettime=self.gettime1) - - memcache.incr('fjq-TestModel-index') - - t4 = TestModel(number=4) - t5 = TestModel(number=5) - t6 = TestModel(number=6) - - tasks2 = [t4, t5, t6] - work_index2 = TEST_QUEUE.next_index() - for t in tasks2: - t.work_index = work_index2 - db.put(tasks2) - TEST_QUEUE.add(work_index2, gettime=self.gettime2) - - self.assertNotEqual(work_index, work_index2) - self.assertTasksEqual( - [self.expect_task(work_index), - self.expect_task(work_index2, now_time=self.now2)], - testutil.get_tasks('default', usec_eta=True)) - - def testAddAlreadyExists(self): - """Tests when the added task already exists.""" - t = TestModel(number=1) - t.work_index = TEST_QUEUE.next_index() - t.put() - TEST_QUEUE.add(t.work_index, gettime=self.gettime1) - TEST_QUEUE.add(t.work_index, gettime=self.gettime1) - - def testNextIndexError(self): - """Tests when the next index cannot be retrieved.""" - self.assertRaises( - fork_join_queue.CannotGetIndexError, - TEST_QUEUE.next_index, - memget=lambda x: None) - - def testNextIndexBusyWait(self): - """Tests busy waiting for a new index.""" - calls = [3] - def incr(*args, **kwargs): - result = memcache.incr(*args, **kwargs) - memcache.incr(TEST_QUEUE.index_name) - if calls[0] > 0: - calls[0] -= 1 - return 100 - else: - return result - - last_index = TEST_QUEUE.next_index(memincr=incr) - for i in xrange(1, 4): - self.assertEquals( - TEST_QUEUE.FAKE_ZERO, - int(memcache.get(TEST_QUEUE.add_counter_template % - fork_join_queue.knuth_hash(i)))) - self.assertEquals( - TEST_QUEUE.FAKE_ZERO + 1, # Extra 1 is for the writer lock! - int(memcache.get(TEST_QUEUE.add_counter_template % - fork_join_queue.knuth_hash(4)))) - - def testNextIndexBusyWaitFail(self): - """Tests when busy waiting for a new index fails.""" - seen_keys = [] - def fake_incr(key, *args, **kwargs): - seen_keys.append(key) - return 100 - self.assertRaises( - fork_join_queue.WriterLockError, - TEST_QUEUE.next_index, - memincr=fake_incr) - self.assertEquals( - (['fjq-TestModel-add-lock:2654435761'] * 20) + - ['fjq-TestModel-index'], - seen_keys) - - def testPopOne(self): - """Tests popping a single entity from the queue.""" - t1 = TestModel(work_index=TEST_QUEUE.next_index(), number=1) - - # Ensure these other tasks don't interfere. - t2 = TestModel(number=2) - t3 = TestModel(number=3) - db.put([t1, t2, t3]) - TEST_QUEUE.add(t1.work_index) - - request = testutil.create_test_request('POST', None) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = \ - self.expect_task(t1.work_index)['name'] - result = TEST_QUEUE.pop_request(request) - - self.assertEquals(1, len(result)) - self.assertEquals(t1.key(), result[0].key()) - self.assertEquals(t1.work_index, result[0].work_index) - self.assertEquals(1, result[0].number) - - def testPopMultiple(self): - """Tests popping multiple entities from a queue. - - Should also cause a continuation task to be inserted to handle entities - after the current batch size. - """ - work_index = TEST_QUEUE.next_index() - tasks = [] - for i in xrange(6): - # Simplify tests by assigning the key names of the TestModel, making it - # so the values returned by pop_request() below are predictable. - key = db.Key.from_path(TestModel.kind(), i+1) - tasks.append(TestModel(key=key, work_index=work_index, number=i)) - db.put(tasks) - TEST_QUEUE.add(work_index, gettime=self.gettime1) - - # First pop request. - request = testutil.create_test_request('POST', None) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = \ - self.expect_task(work_index)['name'] - result_list = TEST_QUEUE.pop_request(request) - - self.assertEquals(3, len(result_list)) - for i, result in enumerate(result_list): - self.assertEquals(work_index, result.work_index) - self.assertEquals(i, result.number) - - # Continuation one. - next_task = testutil.get_tasks('default', - expected_count=2, - index=1, - usec_eta=True) - self.assertTrue('cursor' in next_task['params']) - self.assertTrue(next_task['name'].endswith('-1')) - - request = testutil.create_test_request('POST', None, - *next_task['params'].items()) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = next_task['name'] - result_list = TEST_QUEUE.pop_request(request) - self.assertEquals(3, len(result_list)) - for i, result in enumerate(result_list): - self.assertEquals(work_index, result.work_index) - self.assertEquals(i + 3, result.number) - - # Continuation two. - next_task = testutil.get_tasks('default', - expected_count=3, - index=2, - usec_eta=True) - next_params = next_task['params'] - self.assertTrue('cursor' in next_params) - self.assertTrue(next_task['name'].endswith('-2')) - - request = testutil.create_test_request('POST', None, - *next_task['params'].items()) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = next_task['name'] - result_list = TEST_QUEUE.pop_request(request) - self.assertEquals([], result_list) - testutil.get_tasks('default', expected_count=3, usec_eta=True) - - def testPopAlreadyExists(self): - """Tests popping work items when the continuation task already exists.""" - work_index = TEST_QUEUE.next_index() - tasks = [] - for i in xrange(6): - tasks.append(TestModel(work_index=work_index, number=i)) - db.put(tasks) - TEST_QUEUE.add(work_index, gettime=self.gettime1) - testutil.get_tasks('default', expected_count=1) - - request = testutil.create_test_request('POST', None) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = \ - self.expect_task(work_index)['name'] - - result_list = TEST_QUEUE.pop_request(request) - testutil.get_tasks('default', expected_count=2) - - result_list = TEST_QUEUE.pop_request(request) - testutil.get_tasks('default', expected_count=2) - - def testIncrementIndexFail(self): - """Tests when the reader-writer lock is lost.""" - work_index = TEST_QUEUE.next_index() - memcache.delete(TEST_QUEUE.add_counter_template % work_index) - self.assertTrue(TEST_QUEUE._increment_index(work_index)) - - def testIncrementIndexBusyWait(self): - """Tests busy waiting for the writer lock.""" - work_index = TEST_QUEUE.next_index() - self.assertFalse(TEST_QUEUE._increment_index(work_index)) - - def testZeroBatchTime(self): - """Tests that zero batch time results in no task ETA.""" - work_index = TEST_QUEUE_ZERO_BATCH_TIME.next_index() - task = TestModel(work_index=work_index, number=1) - db.put(task) - - before_index = memcache.get(TEST_QUEUE_ZERO_BATCH_TIME.index_name) - self.assertEquals( - work_index, fork_join_queue.knuth_hash(before_index)) - TEST_QUEUE_ZERO_BATCH_TIME.add(work_index, gettime=self.gettime1) - - # This confirms the behavior that batch_period_ms of zero will cause - # immediate increment after adding the tasks. - after_index = memcache.get(TEST_QUEUE_ZERO_BATCH_TIME.index_name) - self.assertEquals(before_index + 1, after_index) - - self.assertTasksEqual( - [self.expect_task(work_index)], - testutil.get_tasks('default', usec_eta=True), - check_eta=False) - - def testShardedQueue(self): - """Tests adding and popping from a sharded queue with continuation.""" - from google.appengine.api import apiproxy_stub_map - stub = apiproxy_stub_map.apiproxy.GetStub('taskqueue') - stub._queues[None]._all_queues_valid = True - try: - work_index = SHARDED_QUEUE.next_index() - tasks = [] - for i in xrange(5): - # Simplify tests by assigning the key names of the TestModel, making it - # so the values returned by pop_request() below are predictable. - key = db.Key.from_path(TestModel.kind(), i+1) - tasks.append(TestModel(key=key, work_index=work_index, number=i)) - db.put(tasks) - SHARDED_QUEUE.add(work_index, gettime=self.gettime1) - queue_name = 'default-%d' % (1 + (work_index % 4)) - testutil.get_tasks(queue_name, expected_count=1) - - # First pop request. - request = testutil.create_test_request('POST', None) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = \ - self.expect_task(work_index)['name'] - result_list = SHARDED_QUEUE.pop_request(request) - - self.assertEquals(3, len(result_list)) - for i, result in enumerate(result_list): - self.assertEquals(work_index, result.work_index) - self.assertEquals(i, result.number) - - # Continuation one. - next_task = testutil.get_tasks(queue_name, - expected_count=2, - index=1) - self.assertTrue('cursor' in next_task['params']) - self.assertTrue(next_task['name'].endswith('-1')) - finally: - stub._queues[None]._all_queues_valid = False - - def testMemcacheQueue(self): - """Tests adding and popping from an in-memory queue with continuation.""" - work_index = MEMCACHE_QUEUE.next_index() - work_items = [TestModel(key=db.Key.from_path(TestModel.kind(), i), - work_index=work_index, number=i) - for i in xrange(1, 6)] - MEMCACHE_QUEUE.put(work_index, work_items) - MEMCACHE_QUEUE.add(work_index, gettime=self.gettime1) - testutil.get_tasks('default', expected_count=1) - - # First pop request. - request = testutil.create_test_request('POST', None) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = \ - self.expect_task(work_index)['name'] - result_list = MEMCACHE_QUEUE.pop_request(request) - - self.assertEquals(3, len(result_list)) - for i, result in enumerate(result_list): - self.assertEquals(work_index, result.work_index) - self.assertEquals(i + 1, result.number) - - # Continuation task enqueued. - next_task = testutil.get_tasks('default', - expected_count=2, - index=1) - self.assertEquals(3, int(next_task['params']['cursor'])) - self.assertTrue(next_task['name'].endswith('-1')) - - # Second pop request. - request = testutil.create_test_request( - 'POST', None, *next_task['params'].items()) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = next_task['name'] - result_list = MEMCACHE_QUEUE.pop_request(request) - - self.assertEquals(2, len(result_list)) - for i, result in enumerate(result_list): - self.assertEquals(work_index, result.work_index) - self.assertEquals(i + 4, result.number) - - def testMemcacheQueue_IncrError(self): - """Tests calling put() when memcache increment fails.""" - work_index = MEMCACHE_QUEUE.next_index() - entity = TestModel(work_index=work_index, number=0) - self.assertRaises(fork_join_queue.MemcacheError, - MEMCACHE_QUEUE.put, - work_index, [entity], - memincr=lambda *a, **k: None) - - def testMemcacheQueue_PutSetError(self): - """Tests calling put() when memcache set fails.""" - work_index = MEMCACHE_QUEUE.next_index() - entity = TestModel(work_index=work_index, number=0) - self.assertRaises(fork_join_queue.MemcacheError, - MEMCACHE_QUEUE.put, - work_index, [entity], - memset=lambda *a, **k: ['blah']) - - def testMemcacheQueue_PopError(self): - """Tests calling pop() when memcache is down.""" - work_index = MEMCACHE_QUEUE.next_index() - entity = TestModel(work_index=work_index, number=0) - MEMCACHE_QUEUE.put(work_index, [entity]) - memcache.flush_all() - - request = testutil.create_test_request('POST', None) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = \ - self.expect_task(work_index)['name'] - result_list = MEMCACHE_QUEUE.pop_request(request) - self.assertEquals([], result_list) - - def testMemcacheQueue_PopHoles(self): - """Tests when there are holes in the memcache array.""" - work_index = MEMCACHE_QUEUE.next_index() - work_items = [TestModel(key=db.Key.from_path(TestModel.kind(), i), - work_index=work_index, number=i) - for i in xrange(1, 6)] - MEMCACHE_QUEUE.put(work_index, work_items) - memcache.delete(MEMCACHE_QUEUE._create_index_key(work_index, 1)) - - request = testutil.create_test_request('POST', None) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = \ - self.expect_task(work_index)['name'] - result_list = MEMCACHE_QUEUE.pop_request(request) - self.assertEquals([1, 3], [r.number for r in result_list]) - - def testMemcacheQueue_PopDecodeError(self): - """Tests when proto decoding fails on the pop() call.""" - work_index = MEMCACHE_QUEUE.next_index() - work_items = [TestModel(key=db.Key.from_path(TestModel.kind(), i), - work_index=work_index, number=i) - for i in xrange(1, 6)] - MEMCACHE_QUEUE.put(work_index, work_items) - - memcache.set(MEMCACHE_QUEUE._create_index_key(work_index, 1), 'bad data') - request = testutil.create_test_request('POST', None) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = \ - self.expect_task(work_index)['name'] - result_list = MEMCACHE_QUEUE.pop_request(request) - -################################################################################ - -if __name__ == '__main__': - unittest.main() diff --git a/hub/google3/__init__.py b/hub/google3/__init__.py deleted file mode 100644 index e69de29..0000000 diff --git a/hub/google3/apphosting/__init__.py b/hub/google3/apphosting/__init__.py deleted file mode 100644 index e69de29..0000000 diff --git a/hub/google3/apphosting/runtime/__init__.py b/hub/google3/apphosting/runtime/__init__.py deleted file mode 100644 index e69de29..0000000 diff --git a/hub/google3/apphosting/runtime/_apphosting_runtime___python__apiproxy.py b/hub/google3/apphosting/runtime/_apphosting_runtime___python__apiproxy.py deleted file mode 100644 index db390f7..0000000 --- a/hub/google3/apphosting/runtime/_apphosting_runtime___python__apiproxy.py +++ /dev/null @@ -1,2 +0,0 @@ -#!/usr/bin/env python -"""THIS IS AN EMPTY FILE.""" \ No newline at end of file diff --git a/hub/index.yaml b/hub/index.yaml deleted file mode 100644 index 8ce7787..0000000 --- a/hub/index.yaml +++ /dev/null @@ -1,19 +0,0 @@ -indexes: - -# For iterating through subscribers to deliver events to. -- kind: Subscription - properties: - - name: subscription_state - - name: topic_hash - - name: callback_hash - - -# AUTOGENERATED - -# This index.yaml is automatically updated whenever the dev_appserver -# detects that a new type of query is run. If you want to manage the -# index.yaml file manually, remove the above marker line (the line -# saying "# AUTOGENERATED"). If you want to manage some indexes -# manually, move them above the marker line. The index.yaml file is -# automatically uploaded to the admin console when you next deploy -# your application using appcfg.py. diff --git a/hub/main.py b/hub/main.py deleted file mode 100644 index fc4a876..0000000 --- a/hub/main.py +++ /dev/null @@ -1,3562 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2008 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""PubSubHubbub protocol Hub implementation built on Google App Engine. - -=== Model classes: - -* Subscription: A single subscriber's lease on a topic URL. Also represents a - work item of a subscription that is awaiting confirmation (sub. or unsub). - -* FeedToFetch: Work item inserted when a publish event occurs. This will be - moved to the Task Queue API once available. - -* KnownFeed: Materialized view of all distinct topic URLs. Written by - background task every time a new subscription is made for a topic URL. - Used for mapping from input topic URLs to feed IDs and then back to topic - URLs, to properly handle any feed aliases. Also used for doing bootstrap - polling of feeds. - -* KnownFeedIdentity: Reverse index of feed ID to topic URLs. Used in - conjunction with KnownFeed to properly canonicalize feed aliases on - subscription and pinging. - -* KnownFeedStats: Statistics about a topic URL. Used to provide subscriber - counts to publishers on feed fetch. - -* FeedRecord: Metadata information about a feed, the last time it was polled, - and any headers that may affect future polling. Also contains any debugging - information about the last feed fetch and why it may have failed. - -* FeedEntryRecord: Record of a single entry in a single feed. May eventually - be garbage collected after enough time has passed since it was last seen. - -* EventToDeliver: Work item that contains the content to deliver for a feed - event. Maintains current position in subscribers and number of delivery - failures. Used to coordinate delivery retries. Will be deleted in successful - cases or stick around in the event of complete failures for debugging. - -* PollingMarker: Work item that keeps track of the last time all KnownFeed - instances were fetched. Used to do bootstrap polling. - - -=== Entity groups: - -Subscription entities are in their own entity group to allow for a high number -of simultaneous subscriptions for the same topic URL. FeedToFetch is also in -its own entity group for the same reason. FeedRecord, FeedEntryRecord, and -EventToDeliver entries are all in the same entity group, however, to ensure that -each feed polling is either full committed and delivered to subscribers or fails -and will be retried at a later time. - - ------------ - | FeedRecord | - -----+------ - | - | - +-------------+-------------+ - | | - | | - --------+-------- --------+------- -| FeedEntryRecord | | EventToDeliver | - ----------------- ---------------- -""" - -# Bigger TODOs (in priority order) -# -# - Improve polling algorithm to keep stats on each feed. -# -# - Do not poll a feed if we've gotten an event from the publisher in less -# than the polling period. - -import datetime -import gc -import hashlib -import hmac -import logging -import os -import random -import sgmllib -import time -import traceback -import urllib -import urlparse -import wsgiref.handlers -import xml.sax - -from google.appengine import runtime -from google.appengine.api import datastore_types -from google.appengine.api import memcache -from google.appengine.api import urlfetch -from google.appengine.api import urlfetch_errors -from google.appengine.api import taskqueue -from google.appengine.api import users -from google.appengine.ext import db -from google.appengine.ext import webapp -from google.appengine.ext.webapp import template -from google.appengine.runtime import apiproxy_errors - -import async_apiproxy -import dos -import feed_diff -import feed_identifier -import fork_join_queue -import urlfetch_async - -import mapreduce.control -import mapreduce.model - -async_proxy = async_apiproxy.AsyncAPIProxy() - -################################################################################ -# Config parameters - -DEBUG = True - -if DEBUG: - logging.getLogger().setLevel(logging.DEBUG) - -# How many subscribers to contact at a time when delivering events. -EVENT_SUBSCRIBER_CHUNK_SIZE = 50 - -# Maximum number of times to attempt a subscription retry. -MAX_SUBSCRIPTION_CONFIRM_FAILURES = 4 - -# Period to use for exponential backoff on subscription confirm retries. -SUBSCRIPTION_RETRY_PERIOD = 30 # seconds - -# Maximum number of times to attempt to pull a feed. -MAX_FEED_PULL_FAILURES = 4 - -# Period to use for exponential backoff on feed pulling. -FEED_PULL_RETRY_PERIOD = 30 # seconds - -# Maximum number of times to attempt to deliver a feed event. -MAX_DELIVERY_FAILURES = 4 - -# Period to use for exponential backoff on feed event delivery. -DELIVERY_RETRY_PERIOD = 30 # seconds - -# Period at which feed IDs should be refreshed. -FEED_IDENTITY_UPDATE_PERIOD = (20 * 24 * 60 * 60) # 20 days - -# Number of polling feeds to fetch from the Datastore at a time. -BOOSTRAP_FEED_CHUNK_SIZE = 50 - -# How many old Subscription instances to clean up at a time. -SUBSCRIPTION_CLEANUP_CHUNK_SIZE = 100 - -# How far before expiration to refresh subscriptions. -SUBSCRIPTION_CHECK_BUFFER_SECONDS = (24 * 60 * 60) # 24 hours - -# How many mapper shards to use for reconfirming subscriptions. -SUBSCRIPTION_RECONFIRM_SHARD_COUNT = 4 - -# How often to poll feeds. -POLLING_BOOTSTRAP_PERIOD = 10800 # in seconds; 3 hours - -# Default expiration time of a lease. -DEFAULT_LEASE_SECONDS = (5 * 24 * 60 * 60) # 5 days - -# Maximum expiration time of a lease. -MAX_LEASE_SECONDS = (10 * 24 * 60 * 60) # 10 days - -# Maximum number of redirects to follow when feed fetching. -MAX_REDIRECTS = 7 - -# Maximum time to wait for fetching a feed in seconds. -MAX_FETCH_SECONDS = 10 - -# Number of times to try to split FeedEntryRecord, EventToDeliver, and -# FeedRecord entities when putting them and their size is too large. -PUT_SPLITTING_ATTEMPTS = 10 - -# Maximum number of FeedEntryRecord entries to look up in parallel. -MAX_FEED_ENTRY_RECORD_LOOKUPS = 500 - -# Maximum number of FeedEntryRecord entries to save at the same time when -# a new EventToDeliver is being written. -MAX_FEED_RECORD_SAVES = 100 - -# Maximum number of new FeedEntryRecords to process and insert at a time. Any -# remaining will be split into another EventToDeliver instance. -MAX_NEW_FEED_ENTRY_RECORDS = 200 - -################################################################################ -# URL scoring Parameters - -# Fetching feeds -FETCH_SCORER = dos.UrlScorer( - period=300, # Seconds - min_requests=5, # per second - max_failure_percentage=0.8, - prefix='pull_feed') - -# Pushing events -DELIVERY_SCORER = dos.UrlScorer( - period=300, # Seconds - min_requests=0.5, # per second - max_failure_percentage=0.8, - prefix='deliver_events') - - -################################################################################ -# Fetching samplers - -FETCH_URL_SAMPLE_MINUTE = dos.ReservoirConfig( - 'fetch_url_1m', - period=60, - samples=10000, - by_url=True, - value_units='% errors') - -FETCH_URL_SAMPLE_30_MINUTE = dos.ReservoirConfig( - 'fetch_url_30m', - period=1800, - samples=10000, - by_url=True, - value_units='% errors') - -FETCH_URL_SAMPLE_HOUR = dos.ReservoirConfig( - 'fetch_url_1h', - period=3600, - samples=10000, - by_url=True, - value_units='% errors') - -FETCH_URL_SAMPLE_DAY = dos.ReservoirConfig( - 'fetch_url_1d', - period=86400, - samples=10000, - by_url=True, - value_units='% errors') - -FETCH_DOMAIN_SAMPLE_MINUTE = dos.ReservoirConfig( - 'fetch_domain_1m', - period=60, - samples=10000, - by_domain=True, - value_units='% errors') - -FETCH_DOMAIN_SAMPLE_30_MINUTE = dos.ReservoirConfig( - 'fetch_domain_30m', - period=1800, - samples=10000, - by_domain=True, - value_units='% errors') - -FETCH_DOMAIN_SAMPLE_HOUR = dos.ReservoirConfig( - 'fetch_domain_1h', - period=3600, - samples=10000, - by_domain=True, - value_units='% errors') - -FETCH_DOMAIN_SAMPLE_DAY = dos.ReservoirConfig( - 'fetch_domain_1d', - period=86400, - samples=10000, - by_domain=True, - value_units='% errors') - -FETCH_URL_SAMPLE_MINUTE_LATENCY = dos.ReservoirConfig( - 'fetch_url_1m_latency', - period=60, - samples=10000, - by_url=True, - value_units='ms') - -FETCH_URL_SAMPLE_30_MINUTE_LATENCY = dos.ReservoirConfig( - 'fetch_url_30m_latency', - period=1800, - samples=10000, - by_url=True, - value_units='ms') - -FETCH_URL_SAMPLE_HOUR_LATENCY = dos.ReservoirConfig( - 'fetch_url_1h_latency', - period=3600, - samples=10000, - by_url=True, - value_units='ms') - -FETCH_URL_SAMPLE_DAY_LATENCY = dos.ReservoirConfig( - 'fetch_url_1d_latency', - period=86400, - samples=10000, - by_url=True, - value_units='ms') - -FETCH_DOMAIN_SAMPLE_MINUTE_LATENCY = dos.ReservoirConfig( - 'fetch_domain_1m_latency', - period=60, - samples=10000, - by_domain=True, - value_units='ms') - -FETCH_DOMAIN_SAMPLE_30_MINUTE_LATENCY = dos.ReservoirConfig( - 'fetch_domain_30m_latency', - period=1800, - samples=10000, - by_domain=True, - value_units='ms') - -FETCH_DOMAIN_SAMPLE_HOUR_LATENCY = dos.ReservoirConfig( - 'fetch_domain_1h_latency', - period=3600, - samples=10000, - by_domain=True, - value_units='ms') - -FETCH_DOMAIN_SAMPLE_DAY_LATENCY = dos.ReservoirConfig( - 'fetch_domain_1d_latency', - period=86400, - samples=10000, - by_domain=True, - value_units='ms') - - -def report_fetch(reporter, url, success, latency): - """Reports statistics information for a feed fetch. - - Args: - reporter: dos.Reporter instance. - url: The URL of the topic URL that was fetched. - success: True if the fetch was successful, False otherwise. - latency: End-to-end fetch latency in milliseconds. - """ - value = 100 * int(not success) - reporter.set(url, FETCH_URL_SAMPLE_MINUTE, value) - reporter.set(url, FETCH_URL_SAMPLE_30_MINUTE, value) - reporter.set(url, FETCH_URL_SAMPLE_HOUR, value) - reporter.set(url, FETCH_URL_SAMPLE_DAY, value) - reporter.set(url, FETCH_DOMAIN_SAMPLE_MINUTE, value) - reporter.set(url, FETCH_DOMAIN_SAMPLE_30_MINUTE, value) - reporter.set(url, FETCH_DOMAIN_SAMPLE_HOUR, value) - reporter.set(url, FETCH_DOMAIN_SAMPLE_DAY, value) - reporter.set(url, FETCH_URL_SAMPLE_MINUTE_LATENCY, latency) - reporter.set(url, FETCH_URL_SAMPLE_30_MINUTE_LATENCY, latency) - reporter.set(url, FETCH_URL_SAMPLE_HOUR_LATENCY, latency) - reporter.set(url, FETCH_URL_SAMPLE_DAY_LATENCY, latency) - reporter.set(url, FETCH_DOMAIN_SAMPLE_MINUTE_LATENCY, latency) - reporter.set(url, FETCH_DOMAIN_SAMPLE_30_MINUTE_LATENCY, latency) - reporter.set(url, FETCH_DOMAIN_SAMPLE_HOUR_LATENCY, latency) - reporter.set(url, FETCH_DOMAIN_SAMPLE_DAY_LATENCY, latency) - - -FETCH_SAMPLER = dos.MultiSampler([ - FETCH_URL_SAMPLE_MINUTE, - FETCH_URL_SAMPLE_30_MINUTE, - FETCH_URL_SAMPLE_HOUR, - FETCH_URL_SAMPLE_DAY, - FETCH_DOMAIN_SAMPLE_MINUTE, - FETCH_DOMAIN_SAMPLE_30_MINUTE, - FETCH_DOMAIN_SAMPLE_HOUR, - FETCH_DOMAIN_SAMPLE_DAY, - FETCH_URL_SAMPLE_MINUTE_LATENCY, - FETCH_URL_SAMPLE_30_MINUTE_LATENCY, - FETCH_URL_SAMPLE_HOUR_LATENCY, - FETCH_URL_SAMPLE_DAY_LATENCY, - FETCH_DOMAIN_SAMPLE_MINUTE_LATENCY, - FETCH_DOMAIN_SAMPLE_30_MINUTE_LATENCY, - FETCH_DOMAIN_SAMPLE_HOUR_LATENCY, - FETCH_DOMAIN_SAMPLE_DAY_LATENCY, -]) - -################################################################################ -# Delivery samplers - -DELIVERY_URL_SAMPLE_MINUTE = dos.ReservoirConfig( - 'delivery_url_1m', - period=60, - samples=10000, - by_url=True, - value_units='% errors') - -DELIVERY_URL_SAMPLE_30_MINUTE = dos.ReservoirConfig( - 'delivery_url_30m', - period=1800, - samples=10000, - by_url=True, - value_units='% errors') - -DELIVERY_URL_SAMPLE_HOUR = dos.ReservoirConfig( - 'delivery_url_1h', - period=3600, - samples=10000, - by_url=True, - value_units='% errors') - -DELIVERY_URL_SAMPLE_DAY = dos.ReservoirConfig( - 'delivery_url_1d', - period=86400, - samples=10000, - by_url=True, - value_units='% errors') - -DELIVERY_DOMAIN_SAMPLE_MINUTE = dos.ReservoirConfig( - 'delivery_domain_1m', - period=60, - samples=10000, - by_domain=True, - value_units='% errors') - -DELIVERY_DOMAIN_SAMPLE_30_MINUTE = dos.ReservoirConfig( - 'delivery_domain_30m', - period=1800, - samples=10000, - by_domain=True, - value_units='% errors') - -DELIVERY_DOMAIN_SAMPLE_HOUR = dos.ReservoirConfig( - 'delivery_domain_1h', - period=3600, - samples=10000, - by_domain=True, - value_units='% errors') - -DELIVERY_DOMAIN_SAMPLE_DAY = dos.ReservoirConfig( - 'delivery_domain_1d', - period=86400, - samples=10000, - by_domain=True, - value_units='% errors') - -DELIVERY_URL_SAMPLE_MINUTE_LATENCY = dos.ReservoirConfig( - 'delivery_url_1m_latency', - period=60, - samples=10000, - by_url=True, - value_units='ms') - -DELIVERY_URL_SAMPLE_30_MINUTE_LATENCY = dos.ReservoirConfig( - 'delivery_url_30m_latency', - period=1800, - samples=10000, - by_url=True, - value_units='ms') - -DELIVERY_URL_SAMPLE_HOUR_LATENCY = dos.ReservoirConfig( - 'delivery_url_1h_latency', - period=3600, - samples=10000, - by_url=True, - value_units='ms') - -DELIVERY_URL_SAMPLE_DAY_LATENCY = dos.ReservoirConfig( - 'delivery_url_1d_latency', - period=86400, - samples=10000, - by_url=True, - value_units='ms') - -DELIVERY_DOMAIN_SAMPLE_MINUTE_LATENCY = dos.ReservoirConfig( - 'delivery_domain_1m_latency', - period=60, - samples=10000, - by_domain=True, - value_units='ms') - -DELIVERY_DOMAIN_SAMPLE_30_MINUTE_LATENCY = dos.ReservoirConfig( - 'delivery_domain_30m_latency', - period=1800, - samples=10000, - by_domain=True, - value_units='ms') - -DELIVERY_DOMAIN_SAMPLE_HOUR_LATENCY = dos.ReservoirConfig( - 'delivery_domain_1h_latency', - period=3600, - samples=10000, - by_domain=True, - value_units='ms') - -DELIVERY_DOMAIN_SAMPLE_DAY_LATENCY = dos.ReservoirConfig( - 'delivery_domain_1d_latency', - period=86400, - samples=10000, - by_domain=True, - value_units='ms') - - -def report_delivery(reporter, url, success, latency): - """Reports statistics information for a event delivery to a callback. - - Args: - reporter: dos.Reporter instance. - url: The URL of the callback that received the event. - success: True if the delivery was successful, False otherwise. - latency: End-to-end fetch latency in milliseconds. - """ - value = 100 * int(not success) - reporter.set(url, DELIVERY_URL_SAMPLE_MINUTE, value) - reporter.set(url, DELIVERY_URL_SAMPLE_30_MINUTE, value) - reporter.set(url, DELIVERY_URL_SAMPLE_HOUR, value) - reporter.set(url, DELIVERY_URL_SAMPLE_DAY, value) - reporter.set(url, DELIVERY_DOMAIN_SAMPLE_MINUTE, value) - reporter.set(url, DELIVERY_DOMAIN_SAMPLE_30_MINUTE, value) - reporter.set(url, DELIVERY_DOMAIN_SAMPLE_HOUR, value) - reporter.set(url, DELIVERY_DOMAIN_SAMPLE_DAY, value) - reporter.set(url, DELIVERY_URL_SAMPLE_MINUTE_LATENCY, latency) - reporter.set(url, DELIVERY_URL_SAMPLE_30_MINUTE_LATENCY, latency) - reporter.set(url, DELIVERY_URL_SAMPLE_HOUR_LATENCY, latency) - reporter.set(url, DELIVERY_URL_SAMPLE_DAY_LATENCY, latency) - reporter.set(url, DELIVERY_DOMAIN_SAMPLE_MINUTE_LATENCY, latency) - reporter.set(url, DELIVERY_DOMAIN_SAMPLE_30_MINUTE_LATENCY, latency) - reporter.set(url, DELIVERY_DOMAIN_SAMPLE_HOUR_LATENCY, latency) - reporter.set(url, DELIVERY_DOMAIN_SAMPLE_DAY_LATENCY, latency) - - -DELIVERY_SAMPLER = dos.MultiSampler([ - DELIVERY_URL_SAMPLE_MINUTE, - DELIVERY_URL_SAMPLE_30_MINUTE, - DELIVERY_URL_SAMPLE_HOUR, - DELIVERY_URL_SAMPLE_DAY, - DELIVERY_DOMAIN_SAMPLE_MINUTE, - DELIVERY_DOMAIN_SAMPLE_30_MINUTE, - DELIVERY_DOMAIN_SAMPLE_HOUR, - DELIVERY_DOMAIN_SAMPLE_DAY, - DELIVERY_URL_SAMPLE_MINUTE_LATENCY, - DELIVERY_URL_SAMPLE_30_MINUTE_LATENCY, - DELIVERY_URL_SAMPLE_HOUR_LATENCY, - DELIVERY_URL_SAMPLE_DAY_LATENCY, - DELIVERY_DOMAIN_SAMPLE_MINUTE_LATENCY, - DELIVERY_DOMAIN_SAMPLE_30_MINUTE_LATENCY, - DELIVERY_DOMAIN_SAMPLE_HOUR_LATENCY, - DELIVERY_DOMAIN_SAMPLE_DAY_LATENCY, -]) - -################################################################################ -# Constants - -ATOM = 'atom' -RSS = 'rss' -ARBITRARY = 'arbitrary' - -VALID_PORTS = frozenset([ - '80', '443', '4443', '8080', '8081', '8082', '8083', '8084', '8085', - '8086', '8087', '8088', '8089', '8188', '8444', '8990']) - -EVENT_QUEUE = 'event-delivery' - -EVENT_RETRIES_QUEUE = 'event-delivery-retries' - -FEED_QUEUE = 'feed-pulls' - -FEED_RETRIES_QUEUE = 'feed-pulls-retries' - -POLLING_QUEUE = 'polling' - -SUBSCRIPTION_QUEUE = 'subscriptions' - -MAPPINGS_QUEUE = 'mappings' - -################################################################################ -# Helper functions - -def utf8encoded(data): - """Encodes a string as utf-8 data and returns an ascii string. - - Args: - data: The string data to encode. - - Returns: - An ascii string, or None if the 'data' parameter was None. - """ - if data is None: - return None - if isinstance(data, unicode): - return unicode(data).encode('utf-8') - else: - return data - - -def normalize_iri(url): - """Converts a URL (possibly containing unicode characters) to an IRI. - - Args: - url: String (normal or unicode) containing a URL, presumably having - already been percent-decoded by a web framework receiving request - parameters in a POST body or GET request's URL. - - Returns: - A properly encoded IRI (see RFC 3987). - """ - def chr_or_escape(unicode_char): - if ord(unicode_char) > 0x7f: - return urllib.quote(unicode_char.encode('utf-8')) - else: - return unicode_char - return ''.join(chr_or_escape(c) for c in unicode(url)) - - -def sha1_hash(value): - """Returns the sha1 hash of the supplied value.""" - return hashlib.sha1(utf8encoded(value)).hexdigest() - - -def get_hash_key_name(value): - """Returns a valid entity key_name that's a hash of the supplied value.""" - return 'hash_' + sha1_hash(value) - - -def sha1_hmac(secret, data): - """Returns the sha1 hmac for a chunk of data and a secret.""" - # For Python 2.6, which can only compute hmacs on non-unicode data. - secret = utf8encoded(secret) - data = utf8encoded(data) - return hmac.new(secret, data, hashlib.sha1).hexdigest() - - -def is_dev_env(): - """Returns True if we're running in the development environment.""" - return 'Dev' in os.environ.get('SERVER_SOFTWARE', '') - - -def work_queue_only(func): - """Decorator that only allows a request if from cron job, task, or an admin. - - Also allows access if running in development server environment. - - Args: - func: A webapp.RequestHandler method. - - Returns: - Function that will return a 401 error if not from an authorized source. - """ - def decorated(myself, *args, **kwargs): - if ('X-AppEngine-Cron' in myself.request.headers or - 'X-AppEngine-TaskName' in myself.request.headers or - is_dev_env() or users.is_current_user_admin()): - return func(myself, *args, **kwargs) - elif users.get_current_user() is None: - myself.redirect(users.create_login_url(myself.request.url)) - else: - myself.response.set_status(401) - myself.response.out.write('Handler only accessible for work queues') - return decorated - - -def is_valid_url(url): - """Returns True if the URL is valid, False otherwise.""" - split = urlparse.urlparse(url) - if not split.scheme in ('http', 'https'): - logging.debug('URL scheme is invalid: %s', url) - return False - - netloc, port = (split.netloc.split(':', 1) + [''])[:2] - if port and not is_dev_env() and port not in VALID_PORTS: - logging.debug('URL port is invalid: %s', url) - return False - - if split.fragment: - logging.debug('URL includes fragment: %s', url) - return False - - return True - - -_VALID_CHARS = ( - 'A', 'B', 'C', 'D', 'E', 'F', 'G', 'H', 'I', 'J', 'K', 'L', 'M', - 'N', 'O', 'P', 'Q', 'R', 'S', 'T', 'U', 'V', 'W', 'X', 'Y', 'Z', - 'a', 'b', 'c', 'd', 'e', 'f', 'g', 'h', 'i', 'j', 'k', 'l', 'm', - 'n', 'o', 'p', 'q', 'r', 's', 't', 'u', 'v', 'w', 'x', 'y', 'z', - '0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '-', '_', -) - - -def get_random_challenge(): - """Returns a string containing a random challenge token.""" - return ''.join(random.choice(_VALID_CHARS) for i in xrange(128)) - -################################################################################ -# Models - -class Subscription(db.Model): - """Represents a single subscription to a topic for a callback URL.""" - - STATE_NOT_VERIFIED = 'not_verified' - STATE_VERIFIED = 'verified' - STATE_TO_DELETE = 'to_delete' - STATES = frozenset([ - STATE_NOT_VERIFIED, - STATE_VERIFIED, - STATE_TO_DELETE, - ]) - - callback = db.TextProperty(required=True) - callback_hash = db.StringProperty(required=True) - topic = db.TextProperty(required=True) - topic_hash = db.StringProperty(required=True) - created_time = db.DateTimeProperty(auto_now_add=True) - last_modified = db.DateTimeProperty(auto_now=True) - lease_seconds = db.IntegerProperty(default=DEFAULT_LEASE_SECONDS) - expiration_time = db.DateTimeProperty(required=True) - eta = db.DateTimeProperty(auto_now_add=True) - confirm_failures = db.IntegerProperty(default=0) - verify_token = db.TextProperty() - secret = db.TextProperty() - hmac_algorithm = db.TextProperty() - subscription_state = db.StringProperty(default=STATE_NOT_VERIFIED, - choices=STATES) - - @staticmethod - def create_key_name(callback, topic): - """Returns the key name for a Subscription entity. - - Args: - callback: URL of the callback subscriber. - topic: URL of the topic being subscribed to. - - Returns: - String containing the key name for the corresponding Subscription. - """ - return get_hash_key_name(u'%s\n%s' % (callback, topic)) - - @classmethod - def insert(cls, - callback, - topic, - verify_token, - secret, - hash_func='sha1', - lease_seconds=DEFAULT_LEASE_SECONDS, - now=datetime.datetime.now): - """Marks a callback URL as being subscribed to a topic. - - Creates a new subscription if None already exists. Forces any existing, - pending request (i.e., async) to immediately enter the verified state. - - Args: - callback: URL that will receive callbacks. - topic: The topic to subscribe to. - verify_token: The verification token to use to confirm the - subscription request. - secret: Shared secret used for HMACs. - hash_func: String with the name of the hash function to use for HMACs. - lease_seconds: Number of seconds the client would like the subscription - to last before expiring. Must be a number. - now: Callable that returns the current time as a datetime instance. Used - for testing - - Returns: - True if the subscription was newly created, False otherwise. - """ - key_name = cls.create_key_name(callback, topic) - now_time = now() - def txn(): - sub_is_new = False - sub = cls.get_by_key_name(key_name) - if sub is None: - sub_is_new = True - sub = cls(key_name=key_name, - callback=callback, - callback_hash=sha1_hash(callback), - topic=topic, - topic_hash=sha1_hash(topic), - verify_token=verify_token, - secret=secret, - hash_func=hash_func, - lease_seconds=lease_seconds, - expiration_time=now_time) - sub.subscription_state = cls.STATE_VERIFIED - sub.expiration_time = now_time + datetime.timedelta(seconds=lease_seconds) - sub.confirm_failures = 0 - sub.verify_token = verify_token - sub.secret = secret - sub.put() - return sub_is_new - return db.run_in_transaction(txn) - - @classmethod - def request_insert(cls, - callback, - topic, - verify_token, - secret, - auto_reconfirm=False, - hash_func='sha1', - lease_seconds=DEFAULT_LEASE_SECONDS, - now=datetime.datetime.now): - """Records that a callback URL needs verification before being subscribed. - - Creates a new subscription request (for asynchronous verification) if None - already exists. Any existing subscription request will be overridden; - for instance, if a subscription has already been verified, this method - will cause it to be reconfirmed. - - Args: - callback: URL that will receive callbacks. - topic: The topic to subscribe to. - verify_token: The verification token to use to confirm the - subscription request. - secret: Shared secret used for HMACs. - auto_reconfirm: True if this task is being run by the auto-reconfirmation - offline process; False if this is a user-requested task. Defaults - to False. - hash_func: String with the name of the hash function to use for HMACs. - lease_seconds: Number of seconds the client would like the subscription - to last before expiring. Must be a number. - now: Callable that returns the current time as a datetime instance. Used - for testing - - Returns: - True if the subscription request was newly created, False otherwise. - """ - key_name = cls.create_key_name(callback, topic) - def txn(): - sub_is_new = False - sub = cls.get_by_key_name(key_name) - if sub is None: - sub_is_new = True - sub = cls(key_name=key_name, - callback=callback, - callback_hash=sha1_hash(callback), - topic=topic, - topic_hash=sha1_hash(topic), - secret=secret, - hash_func=hash_func, - verify_token=verify_token, - lease_seconds=lease_seconds, - expiration_time=( - now() + datetime.timedelta(seconds=lease_seconds))) - sub.confirm_failures = 0 - sub.put() - sub.enqueue_task(cls.STATE_VERIFIED, - verify_token, - secret=secret, - auto_reconfirm=auto_reconfirm) - return sub_is_new - return db.run_in_transaction(txn) - - @classmethod - def remove(cls, callback, topic): - """Causes a callback URL to no longer be subscribed to a topic. - - If the callback was not already subscribed to the topic, this method - will do nothing. Otherwise, the subscription will immediately be removed. - - Args: - callback: URL that will receive callbacks. - topic: The topic to subscribe to. - - Returns: - True if the subscription had previously existed, False otherwise. - """ - key_name = cls.create_key_name(callback, topic) - def txn(): - sub = cls.get_by_key_name(key_name) - if sub is not None: - sub.delete() - return True - return False - return db.run_in_transaction(txn) - - @classmethod - def request_remove(cls, callback, topic, verify_token): - """Records that a callback URL needs to be unsubscribed. - - Creates a new request to unsubscribe a callback URL from a topic (where - verification should happen asynchronously). If an unsubscribe request - has already been made, this method will do nothing. - - Args: - callback: URL that will receive callbacks. - topic: The topic to subscribe to. - verify_token: The verification token to use to confirm the - unsubscription request. - - Returns: - True if the Subscription to remove actually exists, False otherwise. - """ - key_name = cls.create_key_name(callback, topic) - def txn(): - sub = cls.get_by_key_name(key_name) - if sub is not None: - sub.confirm_failures = 0 - sub.put() - sub.enqueue_task(cls.STATE_TO_DELETE, verify_token) - return True - else: - return False - return db.run_in_transaction(txn) - - @classmethod - def archive(cls, callback, topic): - """Archives a subscription as no longer active. - - Args: - callback: URL that will receive callbacks. - topic: The topic to subscribe to. - """ - key_name = cls.create_key_name(callback, topic) - def txn(): - sub = cls.get_by_key_name(key_name) - if sub is not None: - sub.subscription_state = cls.STATE_TO_DELETE - sub.confirm_failures = 0 - sub.put() - return db.run_in_transaction(txn) - - @classmethod - def has_subscribers(cls, topic): - """Check if a topic URL has verified subscribers. - - Args: - topic: The topic URL to check for subscribers. - - Returns: - True if it has verified subscribers, False otherwise. - """ - if (cls.all(keys_only=True).filter('topic_hash =', sha1_hash(topic)) - .filter('subscription_state =', cls.STATE_VERIFIED).get() is not None): - return True - else: - return False - - @classmethod - def get_subscribers(cls, topic, count, starting_at_callback=None): - """Gets the list of subscribers starting at an offset. - - Args: - topic: The topic URL to retrieve subscribers for. - count: How many subscribers to retrieve. - starting_at_callback: A string containing the callback hash to offset - to when retrieving more subscribers. The callback at the given offset - *will* be included in the results. If None, then subscribers will - be retrieved from the beginning. - - Returns: - List of Subscription objects that were found, or an empty list if none - were found. - """ - query = cls.all() - query.filter('topic_hash =', sha1_hash(topic)) - query.filter('subscription_state = ', cls.STATE_VERIFIED) - if starting_at_callback: - query.filter('callback_hash >=', sha1_hash(starting_at_callback)) - query.order('callback_hash') - - return query.fetch(count) - - def enqueue_task(self, - next_state, - verify_token, - auto_reconfirm=False, - secret=None): - """Enqueues a task to confirm this Subscription. - - Args: - next_state: The next state this subscription should be in. - verify_token: The verify_token to use when confirming this request. - auto_reconfirm: True if this task is being run by the auto-reconfirmation - offline process; False if this is a user-requested task. Defaults - to False. - secret: Only required for subscription confirmation (not unsubscribe). - The new secret to use for this subscription after successful - confirmation. - """ - RETRIES = 3 - if auto_reconfirm: - target_queue = POLLING_QUEUE - else: - target_queue = SUBSCRIPTION_QUEUE - for i in xrange(RETRIES): - try: - taskqueue.Task( - url='/work/subscriptions', - eta=self.eta, - params={'subscription_key_name': self.key().name(), - 'next_state': next_state, - 'verify_token': verify_token, - 'secret': secret or '', - 'auto_reconfirm': str(auto_reconfirm)} - ).add(target_queue, transactional=True) - except (taskqueue.Error, apiproxy_errors.Error): - logging.exception('Could not insert task to confirm ' - 'topic = %s, callback = %s', - self.topic, self.callback) - if i == (RETRIES - 1): - raise - else: - return - - def confirm_failed(self, - next_state, - verify_token, - auto_reconfirm=False, - secret=None, - max_failures=MAX_SUBSCRIPTION_CONFIRM_FAILURES, - retry_period=SUBSCRIPTION_RETRY_PERIOD, - now=datetime.datetime.utcnow): - """Reports that an asynchronous confirmation request has failed. - - This will delete this entity if the maximum number of failures has been - exceeded. - - Args: - next_state: The next state this subscription should be in. - verify_token: The verify_token to use when confirming this request. - auto_reconfirm: True if this task is being run by the auto-reconfirmation - offline process; False if this is a user-requested task. - secret: The new secret to use for this subscription after successful - confirmation. - max_failures: Maximum failures to allow before giving up. - retry_period: Initial period for doing exponential (base-2) backoff. - now: Returns the current time as a UTC datetime. - - Returns: - True if this Subscription confirmation should be retried again. Returns - False if we should give up and never try again. - """ - def txn(): - if self.confirm_failures >= max_failures: - logging.debug('Max subscription failures exceeded, giving up.') - return False - else: - retry_delay = retry_period * (2 ** self.confirm_failures) - self.eta = now() + datetime.timedelta(seconds=retry_delay) - self.confirm_failures += 1 - self.put() - self.enqueue_task(next_state, - verify_token, - auto_reconfirm=auto_reconfirm, - secret=secret) - return True - return db.run_in_transaction(txn) - - -class FeedToFetch(db.Expando): - """A feed that has new data that needs to be pulled. - - The key name of this entity is a get_hash_key_name() hash of the topic URL, so - multiple inserts will only ever write a single entity. - """ - - topic = db.TextProperty(required=True) - eta = db.DateTimeProperty(auto_now_add=True, indexed=False) - fetching_failures = db.IntegerProperty(default=0, indexed=False) - totally_failed = db.BooleanProperty(default=False, indexed=False) - source_keys = db.StringListProperty(indexed=False) - source_values = db.StringListProperty(indexed=False) - work_index = db.IntegerProperty() - - # TODO(bslatkin): Add fetching failure reason (urlfetch, parsing, etc) and - # surface it on the topic details page. - - FORK_JOIN_QUEUE = None - - @classmethod - def get_by_topic(cls, topic): - """Retrives a FeedToFetch by the topic URL. - - Args: - topic: The URL for the feed. - - Returns: - The FeedToFetch or None if it does not exist. - """ - return cls.get_by_key_name(get_hash_key_name(topic)) - - @classmethod - def insert(cls, topic_list, source_dict=None, memory_only=True): - """Inserts a set of FeedToFetch entities for a set of topics. - - Overwrites any existing entities that are already there. - - Args: - topic_list: List of the topic URLs of feeds that need to be fetched. - source_dict: Dictionary of sources for the feed. Defaults to an empty - dictionary. - memory_only: Only save FeedToFetch records to memory, not to disk. - - Returns: - The list of FeedToFetch records that was created. - """ - if not topic_list: - return - - if source_dict: - source_keys, source_values = zip(*source_dict.items()) # Yay Python! - else: - source_keys, source_values = [], [] - - if os.environ.get('HTTP_X_APPENGINE_QUEUENAME') == POLLING_QUEUE: - cls.FORK_JOIN_QUEUE.queue_name = POLLING_QUEUE - else: - cls.FORK_JOIN_QUEUE.queue_name = FEED_QUEUE - - if memory_only: - work_index = cls.FORK_JOIN_QUEUE.next_index() - else: - work_index = None - try: - feed_list = [ - cls(key=db.Key.from_path(cls.kind(), get_hash_key_name(topic)), - topic=topic, - source_keys=list(source_keys), - source_values=list(source_values), - work_index=work_index) - for topic in set(topic_list)] - if memory_only: - cls.FORK_JOIN_QUEUE.put(work_index, feed_list) - else: - # TODO(bslatkin): Insert fetching tasks here to fix the polling - # mode for this codebase. - db.put(feed_list) - finally: - if memory_only: - cls.FORK_JOIN_QUEUE.add(work_index) - - return feed_list - - def fetch_failed(self, - max_failures=MAX_FEED_PULL_FAILURES, - retry_period=FEED_PULL_RETRY_PERIOD, - now=datetime.datetime.utcnow): - """Reports that feed fetching failed. - - This will mark this feed as failing to fetch. This feed will not be - refetched until insert() is called again. - - Args: - max_failures: Maximum failures to allow before giving up. - retry_period: Initial period for doing exponential (base-2) backoff. - now: Returns the current time as a UTC datetime. - """ - orig_failures = self.fetching_failures - def txn(): - if self.fetching_failures >= max_failures: - logging.debug('Max fetching failures exceeded, giving up.') - self.totally_failed = True - else: - retry_delay = retry_period * (2 ** orig_failures) - logging.debug('Fetching failed. Will retry in %s seconds', - retry_delay) - self.eta = now() + datetime.timedelta(seconds=retry_delay) - self.fetching_failures = orig_failures + 1 - self._enqueue_retry_task() - self.put() - try: - db.run_in_transaction_custom_retries(2, txn) - except: - logging.exception('Could not mark feed fetching as a failure: topic=%r', - self.topic) - - def done(self): - """The feed fetch has completed successfully. - - This will delete this FeedToFetch entity iff the ETA has not changed, - meaning a subsequent publish event did not happen for this topic URL. If - the ETA has changed, then we can safely assume there is a pending Task to - take care of this FeedToFetch and we should leave the entry. - - Returns: - True if the entity was deleted, False otherwise. In the case the - FeedToFetch record never made it into the Datastore (because it only - ever lived in the in-memory cache), this function will return False. - """ - def txn(): - other = db.get(self.key()) - if other and other.eta == self.eta: - other.delete() - return True - else: - return False - return db.run_in_transaction(txn) - - def _enqueue_retry_task(self): - """Enqueues a task to retry fetching this feed.""" - RETRIES = 3 - - if os.environ.get('HTTP_X_APPENGINE_QUEUENAME') == POLLING_QUEUE: - queue_name = POLLING_QUEUE - else: - queue_name = FEED_RETRIES_QUEUE - - for i in xrange(RETRIES): - try: - taskqueue.Task( - url='/work/pull_feeds', - eta=self.eta, - params={'topic': self.topic}).add(queue_name, transactional=True) - except (taskqueue.Error, apiproxy_errors.Error): - if i == (RETRIES - 1): - raise - else: - return - - -FeedToFetch.FORK_JOIN_QUEUE = fork_join_queue.MemcacheForkJoinQueue( - FeedToFetch, - FeedToFetch.work_index, - '/work/pull_feeds', - FEED_QUEUE, - batch_size=15, - batch_period_ms=500, - lock_timeout_ms=10000, - sync_timeout_ms=250, - stall_timeout_ms=30000, - acquire_timeout_ms=10, - acquire_attempts=50, - shard_count=1, - expiration_seconds=600) # Give up on fetches after 10 minutes. - - -class FeedRecord(db.Model): - """Represents record of the feed from when it has been polled. - - This contains everything in a feed except for the entry data. That means any - footers, top-level XML elements, namespace declarations, etc, will be - captured in this entity. - - The key name of this entity is a get_hash_key_name() of the topic URL. - """ - - topic = db.TextProperty(required=True) - header_footer = db.TextProperty() - last_updated = db.DateTimeProperty(auto_now=True, indexed=False) - format = db.TextProperty() # 'atom', 'rss', or 'arbitrary' - - # Content-related headers served by the feed's host. - content_type = db.TextProperty() - last_modified = db.TextProperty() - etag = db.TextProperty() - - @staticmethod - def create_key_name(topic): - """Creates a key name for a FeedRecord for a topic. - - Args: - topic: The topic URL for the FeedRecord. - - Returns: - String containing the key name. - """ - return get_hash_key_name(topic) - - @classmethod - def get_or_create_all(cls, topic_list): - """Retrieves and/or creates FeedRecord entities for the supplied topics. - - Args: - topic_list: List of topics to retrieve. - - Returns: - The list of FeedRecords corresponding to the input topic list in the - same order they were supplied. - """ - key_list = [db.Key.from_path(cls.kind(), cls.create_key_name(t)) - for t in topic_list] - found_list = db.get(key_list) - results = [] - for topic, key, found in zip(topic_list, key_list, found_list): - if found: - results.append(found) - else: - results.append(cls(key=key, topic=topic)) - return results - - @classmethod - def get_or_create(cls, topic): - """Retrieves a FeedRecord by its topic or creates it if non-existent. - - Args: - topic: The topic URL to retrieve the FeedRecord for. - - Returns: - The FeedRecord found for this topic or a new one if it did not already - exist. - """ - return cls.get_or_insert(FeedRecord.create_key_name(topic), topic=topic) - - def update(self, headers, header_footer=None, format=None): - """Updates the polling record of this feed. - - This method will *not* insert this instance into the Datastore. - - Args: - headers: Dictionary of response headers from the feed that should be used - to determine how to poll the feed in the future. - header_footer: Contents of the feed's XML document minus the entry data. - if not supplied, the old value will remain. Only saved for feeds. - format: The last parsing format that worked correctly for this feed. - Should be 'rss', 'atom', or 'arbitrary'. - """ - try: - self.content_type = headers.get('Content-Type', '').lower() - except UnicodeDecodeError: - logging.exception('Content-Type header had bad encoding') - - try: - self.last_modified = headers.get('Last-Modified') - except UnicodeDecodeError: - logging.exception('Last-Modified header had bad encoding') - - try: - self.etag = headers.get('ETag') - except UnicodeDecodeError: - logging.exception('ETag header had bad encoding') - - if format is not None: - self.format = format - if header_footer is not None and self.format != ARBITRARY: - self.header_footer = header_footer - - def get_request_headers(self, subscriber_count): - """Returns the request headers that should be used to pull this feed. - - Args: - subscriber_count: The number of subscribers this feed has. - - Returns: - Dictionary of request header values. - """ - headers = { - 'Cache-Control': 'no-cache no-store max-age=1', - 'Connection': 'cache-control', - 'Accept': '*/*', - } - if self.last_modified: - headers['If-Modified-Since'] = self.last_modified - if self.etag: - headers['If-None-Match'] = self.etag - if subscriber_count: - headers['User-Agent'] = ( - 'Public Hub (+http://pubsubhubbub.appspot.com; %d subscribers)' % - subscriber_count) - return headers - - -class FeedEntryRecord(db.Expando): - """Represents a feed entry that has been seen. - - The key name of this entity is a get_hash_key_name() hash of the entry_id. - """ - entry_content_hash = db.StringProperty(indexed=False) - update_time = db.DateTimeProperty(auto_now=True, indexed=False) - - @property - def id_hash(self): - """Returns the sha1 hash of the entry ID.""" - return self.key().name()[len('hash_'):] - - @classmethod - def create_key(cls, topic, entry_id): - """Creates a new Key for a FeedEntryRecord entity. - - Args: - topic: The topic URL to retrieve entries for. - entry_id: String containing the entry_id. - - Returns: - Key instance for this FeedEntryRecord. - """ - return db.Key.from_path( - FeedRecord.kind(), - FeedRecord.create_key_name(topic), - cls.kind(), - get_hash_key_name(entry_id)) - - @classmethod - def get_entries_for_topic(cls, topic, entry_id_list): - """Gets multiple FeedEntryRecord entities for a topic by their entry_ids. - - Args: - topic: The topic URL to retrieve entries for. - entry_id_list: Sequence of entry_ids to retrieve. - - Returns: - List of FeedEntryRecords that were found, if any. - """ - results = cls.get([cls.create_key(topic, entry_id) - for entry_id in entry_id_list]) - # Filter out those pesky Nones. - return [r for r in results if r] - - @classmethod - def create_entry_for_topic(cls, topic, entry_id, content_hash): - """Creates multiple FeedEntryRecords entities for a topic. - - Does not actually insert the entities into the Datastore. This is left to - the caller so they can do it as part of a larger batch put(). - - Args: - topic: The topic URL to insert entities for. - entry_id: String containing the ID of the entry. - content_hash: Sha1 hash of the entry's entire XML content. For example, - with Atom this would apply to everything from to with - the surrounding tags included. With RSS it would be everything from - to . - - Returns: - A new FeedEntryRecord that should be inserted into the Datastore. - """ - key = cls.create_key(topic, entry_id) - return cls(key=key, entry_content_hash=content_hash) - - -class EventToDeliver(db.Expando): - """Represents a publishing event to deliver to subscribers. - - This model is meant to be used together with Subscription entities. When a - feed has new published data and needs to be pushed to subscribers, one of - these entities will be inserted. The background worker should iterate - through all Subscription entities for this topic, sending them the event - payload. The update() method should be used to track the progress of the - background worker as well as any Subscription entities that failed delivery. - - The key_name for each of these entities is unique. It is up to the event - injection side of the system to de-dupe events to deliver. For example, when - a publish event comes in, that publish request should be de-duped immediately. - Later, when the feed puller comes through to grab feed diffs, it should insert - a single event to deliver, collapsing any overlapping publish events during - the delay from publish time to feed pulling time. - """ - - DELIVERY_MODES = ('normal', 'retry') - NORMAL = 'normal' - RETRY = 'retry' - - topic = db.TextProperty(required=True) - topic_hash = db.StringProperty(required=True) - last_callback = db.TextProperty(default='') # For paging Subscriptions - failed_callbacks = db.ListProperty(db.Key) # Refs to Subscription entities - delivery_mode = db.StringProperty(default=NORMAL, choices=DELIVERY_MODES, - indexed=False) - retry_attempts = db.IntegerProperty(default=0, indexed=False) - last_modified = db.DateTimeProperty(required=True, indexed=False) - totally_failed = db.BooleanProperty(default=False, indexed=False) - content_type = db.TextProperty(default='') - max_failures = db.IntegerProperty(indexed=False) - - @classmethod - def create_event_for_topic(cls, - topic, - format, - content_type, - header_footer, - entry_payloads, - now=datetime.datetime.utcnow, - set_parent=True, - max_failures=None): - """Creates an event to deliver for a topic and set of published entries. - - Args: - topic: The topic that had the event. - format: Format of the feed, 'atom', 'rss', or 'arbitrary'. - content_type: The original content type of the feed, fetched from the - server, if any. May be empty. - header_footer: The header and footer of the published feed into which - the entry list will be spliced. For arbitrary content this is the - full body of the resource. - entry_payloads: List of strings containing entry payloads (i.e., all - XML data for each entry, including surrounding tags) in order of newest - to oldest. - now: Returns the current time as a UTC datetime. Used in tests. - set_parent: Set the parent to the FeedRecord for the given topic. This is - necessary for the parse_feed flow's transaction. Default is True. Set - to False if this EventToDeliver will be written outside of the - FeedRecord transaction. - max_failures: Maximum number of failures to allow for this event. When - None (the default) it will use the MAX_DELIVERY_FAILURES constant. - - Returns: - A new EventToDeliver instance that has not been stored. - """ - if format in (ATOM, RSS): - # This is feed XML. - close_index = header_footer.rfind(' we need to traverse one - # level higher. - close_index = header_footer[:close_index].rfind('" in feed envelope' - end_tag = header_footer[close_index:] - content_type = 'application/rss+xml' - elif 'feed' in end_tag: - content_type = 'application/atom+xml' - elif 'rdf' in end_tag: - content_type = 'application/rdf+xml' - - payload_list = ['', - header_footer[:close_index]] - payload_list.extend(entry_payloads) - payload_list.append(header_footer[close_index:]) - payload = '\n'.join(payload_list) - elif format == ARBITRARY: - # This is an arbitrary payload. - payload = header_footer - - if set_parent: - parent = db.Key.from_path( - FeedRecord.kind(), FeedRecord.create_key_name(topic)) - else: - parent = None - - if isinstance(payload, unicode): - payload = payload.encode('utf-8') - - return cls( - parent=parent, - topic=topic, - topic_hash=sha1_hash(topic), - payload=db.Blob(payload), - last_modified=now(), - content_type=content_type, - max_failures=max_failures) - - def get_next_subscribers(self, chunk_size=None): - """Retrieve the next set of subscribers to attempt delivery for this event. - - Args: - chunk_size: How many subscribers to retrieve at a time while delivering - the event. Defaults to EVENT_SUBSCRIBER_CHUNK_SIZE. - - Returns: - Tuple (more_subscribers, subscription_list) where: - more_subscribers: True if there are more subscribers to deliver to - after the returned 'subscription_list' has been contacted; this value - should be passed to update() after the delivery is attempted. - subscription_list: List of Subscription entities to attempt to contact - for this event. - """ - if chunk_size is None: - chunk_size = EVENT_SUBSCRIBER_CHUNK_SIZE - - if self.delivery_mode == EventToDeliver.NORMAL: - all_subscribers = Subscription.get_subscribers( - self.topic, chunk_size + 1, starting_at_callback=self.last_callback) - if all_subscribers: - self.last_callback = all_subscribers[-1].callback - else: - self.last_callback = '' - - more_subscribers = len(all_subscribers) > chunk_size - subscription_list = all_subscribers[:chunk_size] - elif self.delivery_mode == EventToDeliver.RETRY: - next_chunk = self.failed_callbacks[:chunk_size] - more_subscribers = len(self.failed_callbacks) > len(next_chunk) - - if self.last_callback: - # If the final index is present in the next chunk, that means we've - # wrapped back around to the beginning and will need to do more - # exponential backoff. This also requires updating the last_callback - # in the update() method, since we do not know which callbacks from - # the next chunk will end up failing. - final_subscription_key = datastore_types.Key.from_path( - Subscription.__name__, - Subscription.create_key_name(self.last_callback, self.topic)) - try: - final_index = next_chunk.index(final_subscription_key) - except ValueError: - pass - else: - more_subscribers = False - next_chunk = next_chunk[:final_index] - - subscription_list = [x for x in db.get(next_chunk) if x is not None] - if subscription_list and not self.last_callback: - # This must be the first time through the current iteration where we do - # not yet know a sentinal value in the list that represents the starting - # point. - self.last_callback = subscription_list[0].callback - - # If the failed callbacks fail again, they will be added back to the - # end of the list. - self.failed_callbacks = self.failed_callbacks[len(next_chunk):] - - return more_subscribers, subscription_list - - def update(self, - more_callbacks, - more_failed_callbacks, - now=datetime.datetime.utcnow, - max_failures=MAX_DELIVERY_FAILURES, - retry_period=DELIVERY_RETRY_PERIOD): - """Updates an event with work progress or deletes it if it's done. - - Reschedules another Task to run to handle this event delivery if needed. - - Args: - more_callbacks: True if there are more callbacks to deliver, False if - there are no more subscribers to deliver for this feed. - more_failed_callbacks: Iterable of Subscription entities for this event - that failed to deliver. - max_failures: Maximum failures to allow before giving up. - retry_period: Initial period for doing exponential (base-2) backoff. - now: Returns the current time as a UTC datetime. - """ - self.last_modified = now() - - # Ensure the list of failed callbacks is in sorted order so we keep track - # of the last callback seen in alphabetical order of callback URL hashes. - more_failed_callbacks = sorted(more_failed_callbacks, - key=lambda x: x.callback_hash) - - self.failed_callbacks.extend(e.key() for e in more_failed_callbacks) - if not more_callbacks and not self.failed_callbacks: - logging.info('EventToDeliver complete: topic = %s, delivery_mode = %s', - self.topic, self.delivery_mode) - self.delete() - return - elif not more_callbacks: - self.last_callback = '' - self.retry_attempts += 1 - if self.max_failures is not None: - max_failures = self.max_failures - if self.retry_attempts > max_failures: - self.totally_failed = True - else: - retry_delay = retry_period * (2 ** (self.retry_attempts-1)) - try: - self.last_modified += datetime.timedelta(seconds=retry_delay) - except OverflowError: - pass - - if self.delivery_mode == EventToDeliver.NORMAL: - logging.debug('Normal delivery done; %d broken callbacks remain', - len(self.failed_callbacks)) - self.delivery_mode = EventToDeliver.RETRY - else: - logging.debug('End of attempt %d; topic = %s, subscribers = %d, ' - 'waiting until %s or totally_failed = %s', - self.retry_attempts, self.topic, - len(self.failed_callbacks), self.last_modified, - self.totally_failed) - - def txn(): - self.put() - if not self.totally_failed: - self.enqueue() - db.run_in_transaction(txn) - - def enqueue(self): - """Enqueues a Task that will execute this EventToDeliver.""" - RETRIES = 3 - if self.delivery_mode == EventToDeliver.RETRY: - target_queue = EVENT_RETRIES_QUEUE - elif os.environ.get('HTTP_X_APPENGINE_QUEUENAME') == POLLING_QUEUE: - target_queue = POLLING_QUEUE - else: - target_queue = EVENT_QUEUE - for i in xrange(RETRIES): - try: - taskqueue.Task( - url='/work/push_events', - eta=self.last_modified, - params={'event_key': self.key()} - ).add(target_queue, transactional=True) - except (taskqueue.Error, apiproxy_errors.Error): - logging.exception('Could not insert task to deliver ' - 'events for topic = %s', self.topic) - if i == (RETRIES - 1): - raise - else: - return - - -class KnownFeed(db.Model): - """Represents a feed that we know exists. - - This entity will be overwritten anytime someone subscribes to this feed. The - benefit is we have a single entity per known feed, allowing us to quickly - iterate through all of them. This may have issues if the subscription rate - for a single feed is over one per second. - """ - - topic = db.TextProperty(required=True) - feed_id = db.TextProperty() - update_time = db.DateTimeProperty(auto_now=True) - - @classmethod - def create(cls, topic): - """Creates a new KnownFeed. - - Args: - topic: The feed's topic URL. - - Returns: - The KnownFeed instance that hasn't been added to the Datastore. - """ - return cls(key_name=get_hash_key_name(topic), topic=topic) - - @classmethod - def record(cls, topic): - """Enqueues a task to create a new KnownFeed and initiate feed ID discovery. - - Args: - topic: The feed's topic URL. - """ - RETRIES = 3 - target_queue = MAPPINGS_QUEUE - for i in xrange(RETRIES): - try: - taskqueue.Task( - url='/work/record_feeds', - params={'topic': topic} - ).add(target_queue) - except (taskqueue.Error, apiproxy_errors.Error): - logging.exception('Could not insert task to do feed ID ' - 'discovery for topic = %s', topic) - if i == (RETRIES - 1): - raise - else: - return - - @classmethod - def create_key(cls, topic): - """Creates a key for a KnownFeed. - - Args: - topic: The feed's topic URL. - - Returns: - Key instance for this feed. - """ - return datastore_types.Key.from_path(cls.kind(), get_hash_key_name(topic)) - - @classmethod - def check_exists(cls, topics): - """Checks if the supplied topic URLs are known feeds. - - Args: - topics: Iterable of topic URLs. - - Returns: - List of topic URLs with KnownFeed entries. If none are known, this list - will be empty. The returned order is arbitrary. - """ - result = [] - for known_feed in cls.get([cls.create_key(url) for url in set(topics)]): - if known_feed is not None: - result.append(known_feed.topic) - return result - - -class KnownFeedStats(db.Model): - """Represents stats about a feed we know that exists. - - Parent is the KnownFeed entity for a given topic URL. - """ - - subscriber_count = db.IntegerProperty() - update_time = db.DateTimeProperty(auto_now=True) - - @classmethod - def create_key(cls, topic_url=None, topic_hash=None): - """Creates a key for a KnownFeedStats instance. - - Args: - topic_url: The topic URL to create the key for. - topic_hash: The hash of the topic URL to create the key for. May only - be supplied if topic_url is None. - - Returns: - db.Key of the KnownFeedStats instance. - """ - if topic_url and topic_hash: - raise TypeError('Must specify topic_url or topic_hash.') - if topic_url: - topic_hash = sha1_hash(topic_url) - - return db.Key.from_path(KnownFeed.kind(), topic_hash, - cls.kind(), 'overall') - - @classmethod - def get_or_create_all(cls, topic_list): - """Retrieves and/or creates KnownFeedStats entities for the supplied topics. - - Args: - topic_list: List of topics to retrieve. - - Returns: - The list of KnownFeedStats corresponding to the input topic list in - the same order they were supplied. - """ - key_list = [cls.create_key(t) for t in topic_list] - found_list = db.get(key_list) - results = [] - for topic, key, found in zip(topic_list, key_list, found_list): - if found: - results.append(found) - else: - results.append(cls(key=key, subscriber_count=0)) - return results - - -class PollingMarker(db.Model): - """Keeps track of the current position in the bootstrap polling process.""" - - last_start = db.DateTimeProperty() - next_start = db.DateTimeProperty(required=True) - - @classmethod - def get(cls, now=datetime.datetime.utcnow): - """Returns the current PollingMarker, creating it if it doesn't exist. - - Args: - now: Returns the current time as a UTC datetime. - """ - key_name = 'The Mark' - the_mark = db.get(datastore_types.Key.from_path(cls.kind(), key_name)) - if the_mark is None: - next_start = now() - datetime.timedelta(seconds=60) - the_mark = PollingMarker(key_name=key_name, - next_start=next_start, - current_key=None) - return the_mark - - def should_progress(self, - period=POLLING_BOOTSTRAP_PERIOD, - now=datetime.datetime.utcnow): - """Returns True if the bootstrap polling should progress. - - May modify this PollingMarker to when the next polling should start. - - Args: - period: The poll period for bootstrapping. - now: Returns the current time as a UTC datetime. - """ - now_time = now() - if self.next_start < now_time: - logging.info('Polling starting afresh for start time %s', self.next_start) - self.last_start = self.next_start - self.next_start = now_time + datetime.timedelta(seconds=period) - return True - else: - return False - - -class KnownFeedIdentity(db.Model): - """Stores a set of known URL aliases for a particular feed.""" - - feed_id = db.TextProperty(required=True) - topics = db.ListProperty(db.Text) - last_update = db.DateTimeProperty() - - @classmethod - def create_key(cls, feed_id): - """Creates a key for a KnownFeedIdentity. - - Args: - feed_id: The feed's identity. For Atom this is the //feed/id element; - for RSS it is the //rss/channel/link element. If for whatever reason - the ID is missing, then the feed URL itself should be used. - - Returns: - Key instance for this feed identity. - """ - return datastore_types.Key.from_path(cls.kind(), get_hash_key_name(feed_id)) - - @classmethod - def update(cls, feed_id, topic): - """Updates a KnownFeedIdentity to have a topic URL mapping. - - Args: - feed_id: The identity of the feed to update with the mapping. - topic: The topic URL to add to the feed's list of aliases. - - Returns: - The KnownFeedIdentity that has been created or updated. - """ - def txn(): - known_feed = db.get(cls.create_key(feed_id)) - if not known_feed: - known_feed = cls(feed_id=feed_id, key_name=get_hash_key_name(feed_id)) - if topic not in known_feed.topics: - known_feed.topics.append(db.Text(topic)) - known_feed.last_update = datetime.datetime.now() - known_feed.put() - return known_feed - try: - return db.run_in_transaction(txn) - except (db.BadRequestError, apiproxy_errors.RequestTooLargeError): - logging.exception( - 'Could not update feed_id=%r; expansion is already too large', - feed_id) - - @classmethod - def remove(cls, feed_id, topic): - """Updates a KnownFeedIdentity to no longer have a topic URL mapping. - - Args: - feed_id: The identity of the feed to update with the mapping. - topic: The topic URL to remove from the feed's list of aliases. - - Returns: - The KnownFeedIdentity that has been updated or None if the mapping - did not exist previously or has now been deleted because it has no - active mappings. - """ - def txn(): - known_feed = db.get(cls.create_key(feed_id)) - if not known_feed: - return None - try: - known_feed.topics.remove(db.Text(topic)) - except ValueError: - return None - - if not known_feed.topics: - known_feed.delete() - return None - else: - known_feed.last_update = datetime.datetime.now() - known_feed.put() - return known_feed - return db.run_in_transaction(txn) - - @classmethod - def derive_additional_topics(cls, topics): - """Derives topic URL aliases from a set of topics by using feed IDs. - - If a topic URL has a KnownFeed entry but no valid feed_id or - KnownFeedIdentity record, the input topic will be echoed in the output - dictionary directly. This properly handles the case where the feed_id has - not yet been recorded for the feed. - - Args: - topics: Iterable of topic URLs. - - Returns: - Dictionary mapping input topic URLs to their full set of aliases, - including the input topic URL. - """ - topics = set(topics) - output_dict = {} - known_feeds = KnownFeed.get([KnownFeed.create_key(t) for t in topics]) - - topics = [] - feed_ids = [] - for feed in known_feeds: - if feed is None: - # In case the KnownFeed hasn't been written yet, don't deliver an event; - # we need the KnownFeed cache to make subscription checking fast. - continue - - fix_feed_id = feed.feed_id - if fix_feed_id is not None: - fix_feed_id = fix_feed_id.strip() - - # No expansion for feeds that have no known topic -> feed_id relation, but - # record those with KnownFeed as having a mapping from topic -> topic for - # backwards compatibility with existing production data. - if fix_feed_id: - topics.append(feed.topic) - feed_ids.append(feed.feed_id) - else: - output_dict[feed.topic] = set([feed.topic]) - - known_feed_ids = cls.get([cls.create_key(f) for f in feed_ids]) - - for known_topic, identified in zip(topics, known_feed_ids): - if identified: - topic_set = output_dict.get(known_topic) - if topic_set is None: - topic_set = set([known_topic]) - output_dict[known_topic] = topic_set - # TODO(bslatkin): Test this. - if len(identified.topics) > 25: - logging.debug('Too many expansion feeds for topic %s: %s', - known_topic, identified.topics) - else: - topic_set.update(identified.topics) - - return output_dict - -################################################################################ -# Subscription handlers and workers - -def confirm_subscription(mode, topic, callback, verify_token, - secret, lease_seconds, record_topic=True): - """Confirms a subscription request and updates a Subscription instance. - - Args: - mode: The mode of subscription confirmation ('subscribe' or 'unsubscribe'). - topic: URL of the topic being subscribed to. - callback: URL of the callback handler to confirm the subscription with. - verify_token: Opaque token passed to the callback. - secret: Shared secret used for HMACs. - lease_seconds: Number of seconds the client would like the subscription - to last before expiring. If more than max_lease_seconds, will be capped - to that value. Should be an integer number. - record_topic: When True, also cause the topic's feed ID to be recorded - if this is a new subscription. - - Returns: - True if the subscription was confirmed properly, False if the subscription - request encountered an error or any other error has hit. - """ - logging.debug('Attempting to confirm %s for topic = %r, callback = %r, ' - 'verify_token = %r, secret = %r, lease_seconds = %s', - mode, topic, callback, verify_token, secret, lease_seconds) - - parsed_url = list(urlparse.urlparse(utf8encoded(callback))) - challenge = get_random_challenge() - real_lease_seconds = min(lease_seconds, MAX_LEASE_SECONDS) - params = { - 'hub.mode': mode, - 'hub.topic': utf8encoded(topic), - 'hub.challenge': challenge, - 'hub.lease_seconds': real_lease_seconds, - } - if verify_token: - params['hub.verify_token'] = utf8encoded(verify_token) - - if parsed_url[4]: - # Preserve subscriber-supplied callback parameters. - parsed_url[4] = '%s&%s' % (parsed_url[4], urllib.urlencode(params)) - else: - parsed_url[4] = urllib.urlencode(params) - - adjusted_url = urlparse.urlunparse(parsed_url) - - try: - response = urlfetch.fetch(adjusted_url, method='get', - follow_redirects=False, - deadline=MAX_FETCH_SECONDS) - except urlfetch_errors.Error: - error_traceback = traceback.format_exc() - logging.debug('Error encountered while confirming subscription ' - 'to %s for callback %s:\n%s', - topic, callback, error_traceback) - return False - - if 200 <= response.status_code < 300 and response.content == challenge: - if mode == 'subscribe': - Subscription.insert(callback, topic, verify_token, secret, - lease_seconds=real_lease_seconds) - if record_topic: - # Enqueue a task to record the feed and do discovery for it's ID. - KnownFeed.record(topic) - else: - Subscription.remove(callback, topic) - logging.info('Subscription action verified, ' - 'callback = %s, topic = %s: %s', callback, topic, mode) - return True - elif mode == 'subscribe' and response.status_code == 404: - Subscription.archive(callback, topic) - logging.info('Subscribe request returned 404 for callback = %s, ' - 'topic = %s; subscription archived', callback, topic) - return True - else: - logging.debug('Could not confirm subscription; encountered ' - 'status %d with content: %s', response.status_code, - response.content) - return False - - -class SubscribeHandler(webapp.RequestHandler): - """End-user accessible handler for Subscribe and Unsubscribe events.""" - - def get(self): - self.response.out.write(template.render('subscribe_debug.html', {})) - - @dos.limit(param='hub.callback', count=10, period=1) - def post(self): - self.response.headers['Content-Type'] = 'text/plain' - - callback = self.request.get('hub.callback', '') - topic = self.request.get('hub.topic', '') - verify_type_list = [s.lower() for s in self.request.get_all('hub.verify')] - verify_token = unicode(self.request.get('hub.verify_token', '')) - secret = unicode(self.request.get('hub.secret', '')) or None - lease_seconds = ( - self.request.get('hub.lease_seconds', '') or str(DEFAULT_LEASE_SECONDS)) - mode = self.request.get('hub.mode', '').lower() - - error_message = None - if not callback or not is_valid_url(callback): - error_message = ('Invalid parameter: hub.callback; ' - 'must be valid URI with no fragment and ' - 'optional port %s' % ','.join(VALID_PORTS)) - else: - callback = normalize_iri(callback) - - if not topic or not is_valid_url(topic): - error_message = ('Invalid parameter: hub.topic; ' - 'must be valid URI with no fragment and ' - 'optional port %s' % ','.join(VALID_PORTS)) - else: - topic = normalize_iri(topic) - - enabled_types = [vt for vt in verify_type_list if vt in ('async', 'sync')] - if not enabled_types: - error_message = 'Invalid values for hub.verify: %s' % (verify_type_list,) - else: - verify_type = enabled_types[0] - - if mode not in ('subscribe', 'unsubscribe'): - error_message = 'Invalid value for hub.mode: %s' % mode - - if lease_seconds: - try: - old_lease_seconds = lease_seconds - lease_seconds = int(old_lease_seconds) - if not old_lease_seconds == str(lease_seconds): - raise ValueError - except ValueError: - error_message = ('Invalid value for hub.lease_seconds: %s' % - old_lease_seconds) - - if error_message: - logging.debug('Bad request for mode = %s, topic = %s, ' - 'callback = %s, verify_token = %s, lease_seconds = %s: %s', - mode, topic, callback, verify_token, - lease_seconds, error_message) - self.response.out.write(error_message) - return self.response.set_status(400) - - try: - # Retrieve any existing subscription for this callback. - sub = Subscription.get_by_key_name( - Subscription.create_key_name(callback, topic)) - - # Deletions for non-existant subscriptions will be ignored. - if mode == 'unsubscribe' and not sub: - return self.response.set_status(204) - - # Enqueue a background verification task, or immediately confirm. - # We prefer synchronous confirmation. - if verify_type == 'sync': - if hooks.execute(confirm_subscription, - mode, topic, callback, verify_token, secret, lease_seconds): - return self.response.set_status(204) - else: - self.response.out.write('Error trying to confirm subscription') - return self.response.set_status(409) - else: - if mode == 'subscribe': - Subscription.request_insert(callback, topic, verify_token, secret, - lease_seconds=lease_seconds) - else: - Subscription.request_remove(callback, topic, verify_token) - logging.debug('Queued %s request for callback = %s, ' - 'topic = %s, verify_token = "%s", lease_seconds= %s', - mode, callback, topic, verify_token, lease_seconds) - return self.response.set_status(202) - - except (apiproxy_errors.Error, db.Error, - runtime.DeadlineExceededError, taskqueue.Error), e: - logging.debug('Could not verify subscription request. %s: %s', - e.__class__.__name__, e) - self.response.headers['Retry-After'] = '120' - return self.response.set_status(503) - - -class SubscriptionConfirmHandler(webapp.RequestHandler): - """Background worker for asynchronously confirming subscriptions.""" - - @work_queue_only - def post(self): - sub_key_name = self.request.get('subscription_key_name') - next_state = self.request.get('next_state') - verify_token = self.request.get('verify_token') - secret = self.request.get('secret') or None - auto_reconfirm = self.request.get('auto_reconfirm', 'False') == 'True' - sub = Subscription.get_by_key_name(sub_key_name) - if not sub: - logging.debug('No subscriptions to confirm ' - 'for subscription_key_name = %s', sub_key_name) - return - - if next_state == Subscription.STATE_TO_DELETE: - mode = 'unsubscribe' - else: - # NOTE: If next_state wasn't specified, this is probably an old task from - # the last version of this code. Handle these tasks by assuming they - # mant subscribe, which will probably cause less damage. - mode = 'subscribe' - - if not hooks.execute(confirm_subscription, - mode, sub.topic, sub.callback, - verify_token, secret, sub.lease_seconds, - record_topic=False): - # After repeated re-confirmation failures for a subscription, assume that - # the callback is dead and archive it. End-user-initiated subscription - # requests cannot possibly follow this code path, preventing attacks - # from unsubscribing callbacks without ownership. - if (not sub.confirm_failed(next_state, verify_token, - auto_reconfirm=auto_reconfirm, - secret=secret) and - auto_reconfirm and mode == 'subscribe'): - logging.info('Auto-renewal subscribe request failed the maximum ' - 'number of times for callback = %s, topic = %s; ' - 'subscription archived', sub.callback, sub.topic) - Subscription.archive(sub.callback, sub.topic) - - -class SubscriptionReconfirmHandler(webapp.RequestHandler): - """Periodic handler causes reconfirmation for almost expired subscriptions.""" - - def __init__(self, now=time.time, start_map=mapreduce.control.start_map): - """Initializer.""" - webapp.RequestHandler.__init__(self) - self.now = now - self.start_map = start_map - - @work_queue_only - def get(self): - # Use the name, such that only one of these tasks runs per calendar day. - name = 'reconfirm-%s' % time.strftime('%Y-%m-%d' , time.gmtime(self.now())) - try: - taskqueue.Task( - url='/work/reconfirm_subscriptions', - name=name - ).add(POLLING_QUEUE) - except (taskqueue.TaskAlreadyExistsError, taskqueue.TombstonedTaskError): - logging.exception('Could not enqueue FIRST reconfirmation task; ' - 'must have already run today.') - - @work_queue_only - def post(self): - self.start_map( - name='Reconfirm expiring subscriptions', - handler_spec='offline_jobs.SubscriptionReconfirmMapper.run', - reader_spec='mapreduce.input_readers.DatastoreInputReader', - mapper_parameters=dict( - processing_rate=100000, - entity_kind='main.Subscription', - threshold_timestamp=int( - self.now() + SUBSCRIPTION_CHECK_BUFFER_SECONDS)), - shard_count=SUBSCRIPTION_RECONFIRM_SHARD_COUNT, - queue_name=POLLING_QUEUE, - mapreduce_parameters=dict( - done_callback='/work/cleanup_mapper', - done_callback_queue=POLLING_QUEUE)) - - -# TODO(bslatkin): Move this to an offline job. -class SubscriptionCleanupHandler(webapp.RequestHandler): - """Background worker for cleaning up deleted Subscription instances.""" - - @work_queue_only - def get(self): - subscriptions = (Subscription.all() - .filter('subscription_state =', Subscription.STATE_TO_DELETE) - .fetch(SUBSCRIPTION_CLEANUP_CHUNK_SIZE)) - if subscriptions: - logging.info('Cleaning up %d subscriptions', len(subscriptions)) - try: - db.delete(subscriptions) - except (db.Error, apiproxy_errors.Error, runtime.DeadlineExceededError): - logging.exception('Could not clean-up Subscription instances') - - -class CleanupMapperHandler(webapp.RequestHandler): - """Cleans up all data from a Mapper job run.""" - - @work_queue_only - def post(self): - mapreduce_id = self.request.headers.get('mapreduce-id') - # TODO: Use Mapper Cleanup API once available. - db.delete(mapreduce.model.MapreduceControl.get_key_by_job_id(mapreduce_id)) - shards = mapreduce.model.ShardState.find_by_mapreduce_id(mapreduce_id) - db.delete(shards) - db.delete(mapreduce.model.MapreduceState.get_key_by_job_id(mapreduce_id)) - -################################################################################ -# Publishing handlers - -def preprocess_urls(urls): - """Preprocesses URLs doing any necessary canonicalization. - - Args: - urls: Set of URLs. - - Returns: - Iterable of URLs that have been modified. - """ - return urls - - -def derive_sources(request_handler, urls): - """Derives feed sources for a publish event. - - Args: - request_handler: webapp.RequestHandler instance for the publish event. - urls: Set of URLs that were published. - """ - return {} - - -class PublishHandlerBase(webapp.RequestHandler): - """Base-class for publish ping receiving handlers.""" - - def receive_publish(self, urls, success_code, param_name): - """Receives a publishing event for a set of topic URLs. - - Serves 400 errors on invalid input, 503 retries on insertion failures. - - Args: - urls: Iterable of URLs that have been published. - success_code: HTTP status code to return on success. - param_name: Name of the parameter that will be validated. - - Returns: - The error message, or an empty string if there are no errors. - """ - urls = hooks.execute(preprocess_urls, urls) - for url in urls: - if not is_valid_url(url): - self.response.set_status(400) - return '%s invalid: %s' % (param_name, url) - - # Normalize all URLs. This assumes our web framework has already decoded - # any POST-body encoded URLs that were passed in to the 'urls' parameter. - urls = set(normalize_iri(u) for u in urls) - - # Only insert FeedToFetch entities for feeds that are known to have - # subscribers. The rest will be ignored. - topic_map = KnownFeedIdentity.derive_additional_topics(urls) - if not topic_map: - urls = set() - else: - # Expand topic URLs by their feed ID to properly handle any aliases - # this feed may have active subscriptions for. - urls = set() - for topic, value in topic_map.iteritems(): - urls.update(value) - logging.info('Topics with known subscribers: %s', urls) - - source_dict = hooks.execute(derive_sources, self, urls) - - # Record all FeedToFetch requests here. The background Pull worker will - # double-check if there are any subscribers that need event delivery and - # will skip any unused feeds. - try: - FeedToFetch.insert(urls, source_dict) - except (taskqueue.Error, apiproxy_errors.Error, db.Error, - runtime.DeadlineExceededError, fork_join_queue.Error): - logging.exception('Failed to insert FeedToFetch records') - self.response.headers['Retry-After'] = '120' - self.response.set_status(503) - return 'Transient error; please try again later' - else: - self.response.set_status(success_code) - return '' - - -class PublishHandler(PublishHandlerBase): - """End-user accessible handler for the Publish event.""" - - def get(self): - self.response.out.write(template.render('publish_debug.html', {})) - - @dos.limit(count=100, period=1) - def post(self): - self.response.headers['Content-Type'] = 'text/plain' - - mode = self.request.get('hub.mode') - if mode.lower() != 'publish': - self.response.set_status(400) - self.response.out.write('hub.mode MUST be "publish"') - return - - urls = set(self.request.get_all('hub.url')) - if not urls: - self.response.set_status(400) - self.response.out.write('MUST supply at least one hub.url parameter') - return - - logging.debug('Publish event for %d URLs (showing first 25): %s', - len(urls), list(urls)[:25]) - error = self.receive_publish(urls, 204, 'hub.url') - if error: - self.response.out.write(error) - -################################################################################ -# Pulling - -def find_feed_updates(topic, format, feed_content, - filter_feed=feed_diff.filter): - """Determines the updated entries for a feed and returns their records. - - Args: - topic: The topic URL of the feed. - format: The string 'atom', 'rss', or 'arbitrary'. - feed_content: The content of the feed, which may include unicode characters. - For arbitrary content, this is just the content itself. - filter_feed: Used for dependency injection. - - Returns: - Tuple (header_footer, entry_list, entry_payloads) where: - header_footer: The header/footer data of the feed. - entry_list: List of FeedEntryRecord instances, if any, that represent - the changes that have occurred on the feed. These records do *not* - include the payload data for the entry. - entry_payloads: List of strings containing entry payloads (i.e., the XML - data for the Atom or ). - - Raises: - xml.sax.SAXException if there is a parse error. - feed_diff.Error if the feed could not be diffed for any other reason. - """ - if format == ARBITRARY: - return (feed_content, [], []) - - header_footer, entries_map = filter_feed(feed_content, format) - - # Find the new entries we've never seen before, and any entries that we - # knew about that have been updated. - STEP = MAX_FEED_ENTRY_RECORD_LOOKUPS - all_keys = entries_map.keys() - existing_entries = [] - for position in xrange(0, len(all_keys), STEP): - key_set = all_keys[position:position+STEP] - existing_entries.extend(FeedEntryRecord.get_entries_for_topic( - topic, key_set)) - - existing_dict = dict((e.id_hash, e.entry_content_hash) - for e in existing_entries if e) - logging.debug('Retrieved %d feed entries, %d of which have been seen before', - len(entries_map), len(existing_dict)) - - entities_to_save = [] - entry_payloads = [] - for entry_id, new_content in entries_map.iteritems(): - new_content_hash = sha1_hash(new_content) - new_entry_id_hash = sha1_hash(entry_id) - # Mark the entry as new if the sha1 hash is different. - try: - old_content_hash = existing_dict[new_entry_id_hash] - if old_content_hash == new_content_hash: - continue - except KeyError: - pass - - entry_payloads.append(new_content) - entities_to_save.append(FeedEntryRecord.create_entry_for_topic( - topic, entry_id, new_content_hash)) - - return header_footer, entities_to_save, entry_payloads - - -def pull_feed(feed_to_fetch, fetch_url, headers): - """Pulls a feed. - - Args: - feed_to_fetch: FeedToFetch instance to pull. - fetch_url: The URL to fetch. Should be the same as the topic stored on - the FeedToFetch instance, but may be different due to redirects. - headers: Dictionary of headers to use for doing the feed fetch. - - Returns: - Tuple (status_code, response_headers, content) where: - status_code: The response status code. - response_headers: Caseless dictionary of response headers. - content: The body of the response. - - Raises: - apiproxy_errors.Error if any RPC errors are encountered. urlfetch.Error if - there are any fetching API errors. - """ - response = urlfetch.fetch( - fetch_url, - headers=headers, - follow_redirects=False, - deadline=MAX_FETCH_SECONDS) - return response.status_code, response.headers, response.content - - -def pull_feed_async(feed_to_fetch, fetch_url, headers, async_proxy, callback): - """Pulls a feed asynchronously. - - The callback's prototype is: - Args: - status_code: The response status code. - response_headers: Caseless dictionary of response headers. - content: The body of the response. - exception: apiproxy_errors.Error if any RPC errors are encountered. - urlfetch.Error if there are any fetching API errors. None if there - were no errors. - - Args: - feed_to_fetch: FeedToFetch instance to pull. - fetch_url: The URL to fetch. Should be the same as the topic stored on - the FeedToFetch instance, but may be different due to redirects. - headers: Dictionary of headers to use for doing the feed fetch. - async_proxy: AsyncAPIProxy to use for fetching and waiting. - callback: Callback function to call after a response has been received. - """ - def wrapper(response, exception): - callback(getattr(response, 'status_code', None), - getattr(response, 'headers', None), - getattr(response, 'content', None), - exception) - urlfetch_async.fetch(fetch_url, - headers=headers, - follow_redirects=False, - async_proxy=async_proxy, - callback=wrapper, - deadline=MAX_FETCH_SECONDS) - - -def inform_event(event_to_deliver, alternate_topics): - """Helper hook informs the Hub of new notifications. - - This can be used to take an action on every notification processed. - - Args: - event_to_deliver: The new event to deliver, already submitted. - alternate_topics: A list of alternative Feed topics that this event - should be delievered for in addition to the 'event_to_deliver's topic. - """ - pass - - -def parse_feed(feed_record, - headers, - content, - true_on_bad_feed=True, - alternate_topics=None): - """Parses a feed's content, determines changes, enqueues notifications. - - This function will only enqueue new notifications if the feed has changed. - - Args: - feed_record: The FeedRecord object of the topic that has new content. - headers: Dictionary of response headers found during feed fetching (may - be empty). - content: The feed document possibly containing new entries. - true_on_bad_feed: When True, return True when the feed's format is - beyond hope and there's no chance of parsing it correctly. When - False the error will be propagated up to the caller with a False - response to this function. - alternate_topics: A list of alternative Feed topics that this parsed event - should be delievered for in addition to the main FeedRecord's topic. - - Returns: - True if successfully parsed the feed content; False on error. - """ - # The content-type header is extremely unreliable for determining the feed's - # content-type. Using a regex search for " MAX_NEW_FEED_ENTRY_RECORDS: - logging.warning('Found more entities than we can process for topic %r; ' - 'splitting', feed_record.topic) - entities_to_save = entities_to_save[:MAX_NEW_FEED_ENTRY_RECORDS] - entry_payloads = entry_payloads[:MAX_NEW_FEED_ENTRY_RECORDS] - parse_successful = False - else: - feed_record.update(headers, header_footer, format) - parse_successful = True - - if format != ARBITRARY and not entities_to_save: - logging.debug('No new entries found') - event_to_deliver = None - else: - logging.info( - 'Saving %d new/updated entries for content ' - 'format=%r, content_type=%r, header_footer_bytes=%d', - len(entities_to_save), format, feed_record.content_type, - len(header_footer)) - event_to_deliver = EventToDeliver.create_event_for_topic( - feed_record.topic, format, feed_record.content_type, - header_footer, entry_payloads) - entities_to_save.insert(0, event_to_deliver) - - entities_to_save.insert(0, feed_record) - - # Segment all entities into smaller groups to reduce the chance of memory - # errors or too large of requests when the entities are put in a single - # call to the Datastore API. - all_entities = [] - STEP = MAX_FEED_RECORD_SAVES - for position in xrange(0, len(entities_to_save), STEP): - next_entities = entities_to_save[position:position+STEP] - all_entities.append(next_entities) - - # Doing this put in a transaction ensures that we have written all - # FeedEntryRecords, updated the FeedRecord, and written the EventToDeliver - # at the same time. Otherwise, if any of these fails individually we could - # drop messages on the floor. If this transaction fails, the whole fetch - # will be redone and find the same entries again (thus it is idempotent). - def txn(): - while all_entities: - group = all_entities.pop(0) - try: - db.put(group) - except (db.BadRequestError, apiproxy_errors.RequestTooLargeError): - logging.exception('Could not insert %d entities for topic %r; ' - 'splitting in half', len(group), feed_record.topic) - # Insert the first half at the beginning since we need to make sure that - # the EventToDeliver gets inserted first. - all_entities.insert(0, group[len(group)/2:]) - all_entities.insert(0, group[:len(group)/2]) - raise - if event_to_deliver: - event_to_deliver.enqueue() - - try: - for i in xrange(PUT_SPLITTING_ATTEMPTS): - try: - db.run_in_transaction(txn) - break - except (db.BadRequestError, apiproxy_errors.RequestTooLargeError): - pass - else: - logging.critical('Insertion of event to delivery *still* failing due to ' - 'request size; dropping event for %s', feed_record.topic) - return true_on_bad_feed - except (db.TransactionFailedError, db.Timeout): - # Datastore failure will cause a refetch and reparse of the feed as if - # the fetch attempt failed, instead of relying on the task queue to do - # this retry for us. This ensures the queue throughputs stay consistent. - logging.exception('Could not submit transaction for topic %r', - feed_record.topic) - return False - - # Inform any hooks that there will is a new event to deliver that has - # been recorded and delivery has begun. - hooks.execute(inform_event, event_to_deliver, alternate_topics) - - return parse_successful - - -class PullFeedHandler(webapp.RequestHandler): - """Background worker for pulling feeds.""" - - def _handle_fetches(self, feed_list): - """Handles a set of FeedToFetch records that need to be fetched.""" - ready_feed_list = [] - scorer_results = FETCH_SCORER.filter([f.topic for f in feed_list]) - for to_fetch, (allow, percent) in zip(feed_list, scorer_results): - if not allow: - logging.warning('Scoring prevented fetch of %r ' - 'with failure rate %.2f%%', - to_fetch.topic, 100 * percent) - to_fetch.done() - elif not Subscription.has_subscribers(to_fetch.topic): - logging.debug('Ignoring event because there are no subscribers ' - 'for topic %s', to_fetch.topic) - to_fetch.done() - else: - ready_feed_list.append(to_fetch) - - if not ready_feed_list: - return - - topic_list = [f.topic for f in ready_feed_list] - feed_record_list = FeedRecord.get_or_create_all(topic_list) - feed_stats_list = KnownFeedStats.get_or_create_all(topic_list) - start_time = time.time() - reporter = dos.Reporter() - successful_topics = [] - failed_topics = [] - - def create_callback(feed_record, feed_stats, work, fetch_url, attempts): - return lambda *args: callback( - feed_record, feed_stats, work, fetch_url, attempts, *args) - - def callback(feed_record, feed_stats, work, fetch_url, attempts, - status_code, headers, content, exception): - should_parse = False - fetch_success = False - if exception: - if isinstance(exception, urlfetch.ResponseTooLargeError): - logging.warning('Feed response too large for topic %r at url %r; ' - 'skipping', work.topic, fetch_url) - work.done() - elif isinstance(exception, urlfetch.InvalidURLError): - logging.warning('Invalid redirection for topic %r to url %r; ' - 'skipping', work.topic, fetch_url) - work.done() - elif isinstance(exception, (apiproxy_errors.Error, urlfetch.Error)): - logging.warning('Failed to fetch topic %r at url %r. %s: %s', - work.topic, fetch_url, exception.__class__, exception) - work.fetch_failed() - else: - logging.critical('Unexpected exception fetching topic %r. %s: %s', - work.topic, exception.__class__, exception) - work.fetch_failed() - else: - if status_code == 200: - should_parse = True - elif status_code in (301, 302, 303, 307) and 'Location' in headers: - fetch_url = headers['Location'] - logging.debug('Feed publisher for topic %r returned %d ' - 'redirect to %r', work.topic, status_code, fetch_url) - if attempts >= MAX_REDIRECTS: - logging.warning('Too many redirects for topic %r', work.topic) - work.fetch_failed() - else: - # Recurse to do the refetch. - hooks.execute(pull_feed_async, - work, - fetch_url, - feed_record.get_request_headers(feed_stats.subscriber_count), - async_proxy, - create_callback(feed_record, feed_stats, work, fetch_url, - attempts + 1)) - return - elif status_code == 304: - logging.debug('Feed publisher for topic %r returned ' - '304 response (cache hit)', work.topic) - work.done() - fetch_success = True - else: - logging.debug('Received bad response for topic = %r, ' - 'status_code = %s, response_headers = %r', - work.topic, status_code, headers) - work.fetch_failed() - - # Fetch is done one way or another. - end_time = time.time() - latency = int((end_time - start_time) * 1000) - if should_parse: - if parse_feed(feed_record, headers, content): - fetch_success = True - work.done() - else: - work.fetch_failed() - - if fetch_success: - successful_topics.append(work.topic) - else: - failed_topics.append(work.topic) - report_fetch(reporter, work.topic, fetch_success, latency) - # End callback - - # Fire off a fetch for every work item and wait for all callbacks. - for work, feed_record, feed_stats in zip( - ready_feed_list, feed_record_list, feed_stats_list): - hooks.execute(pull_feed_async, - work, - work.topic, - feed_record.get_request_headers(feed_stats.subscriber_count), - async_proxy, - create_callback(feed_record, feed_stats, work, work.topic, 1)) - - try: - async_proxy.wait() - except runtime.DeadlineExceededError: - logging.error('Could not finish all fetches due to deadline.') - else: - # Only update stats if we are not dealing with a deadlined request. - FETCH_SCORER.report(successful_topics, failed_topics) - FETCH_SAMPLER.sample(reporter) - - @work_queue_only - def post(self): - topic = self.request.get('topic') - if topic: - # For compatibility with old tasks and retry tasks. - work = FeedToFetch.get_by_topic(topic) - if not work: - logging.debug('No feeds to fetch for topic = %s', topic) - return - self._handle_fetches([work]) - else: - work_list = FeedToFetch.FORK_JOIN_QUEUE.pop_request(self.request) - self._handle_fetches(work_list) - -################################################################################ -# Event delivery - -def push_event(sub, headers, payload, async_proxy, callback): - """Pushes an event to a single subscriber using an asynchronous API call. - - Args: - sub: The Subscription instance to push the event to. - headers: Request headers to use when pushing the event. - payload: The content body the request should have. - async_proxy: AsyncAPIProxy to use for registering RPCs. - callback: Python callable to execute on success or failure. This callback - has the signature func(sub, result, exception) where sub is the - Subscription instance, result is the urlfetch.Response instance, and - exception is any exception encountered, if any. - """ - urlfetch_async.fetch(sub.callback, - method='POST', - headers=headers, - payload=payload, - async_proxy=async_proxy, - callback=callback, - deadline=MAX_FETCH_SECONDS) - - -class PushEventHandler(webapp.RequestHandler): - """Background worker for pushing events to subscribers.""" - - @work_queue_only - def post(self): - work = EventToDeliver.get(self.request.get('event_key')) - if not work: - logging.debug('No events to deliver.') - return - - # Retrieve the first N + 1 subscribers; note if we have more to contact. - more_subscribers, subscription_list = work.get_next_subscribers() - logging.info('%d more subscribers to contact for: ' - 'topic = %s, delivery_mode = %s', - len(subscription_list), work.topic, work.delivery_mode) - - # Keep track of failed callbacks. Do this instead of tracking successful - # callbacks because the asynchronous API calls could be interrupted by a - # deadline error. If that happens we'll want to mark all outstanding - # callback urls as still pending (and thus failed). - all_callbacks = set(subscription_list) - failed_callbacks = all_callbacks.copy() - reporter = dos.Reporter() - start_time = time.time() - - def callback(sub, result, exception): - end_time = time.time() - latency = int((end_time - start_time) * 1000) - if exception or not (200 <= result.status_code <= 299): - logging.debug('Could not deliver to target url %s: ' - 'Exception = %r, status_code = %s', - sub.callback, exception, - getattr(result, 'status_code', 'unknown')) - report_delivery(reporter, sub.callback, False, latency) - else: - failed_callbacks.remove(sub) - report_delivery(reporter, sub.callback, True, latency) - - def create_callback(sub): - return lambda *args: callback(sub, *args) - - payload_utf8 = utf8encoded(work.payload) - scores = DELIVERY_SCORER.filter(s.callback for s in all_callbacks) - for sub, (allowed, percent) in zip(all_callbacks, scores): - if not allowed: - logging.warning( - 'Scoring prevented delivery of %s to %s with failure rate %.2f%%', - work.topic, sub.callback, 100 * percent) - # Remove it from the list of all callbacks and failured callbacks. - # When a callback domain is hurting, we do not further penalize it - # with more failures, but we leave its standing the same. So it's - # as if this callback was never even seen. At the beginning of - # the next scoring period this callback will be allowed again. - all_callbacks.remove(sub) - failed_callbacks.remove(sub) - continue - - headers = { - # In case there was no content type header. - 'Content-Type': work.content_type or 'text/xml', - # TODO(bslatkin): add a better test for verify_token here. - 'X-Hub-Signature': 'sha1=%s' % sha1_hmac( - sub.secret or sub.verify_token or '', payload_utf8), - } - hooks.execute(push_event, - sub, headers, payload_utf8, async_proxy, create_callback(sub)) - - try: - async_proxy.wait() - except runtime.DeadlineExceededError: - logging.error('Could not finish all callbacks due to deadline. ' - 'Remaining are: %r', [s.callback for s in failed_callbacks]) - else: - # Only update stats if we're not dealing with a terminating request. - DELIVERY_SCORER.report( - [s.callback for s in (all_callbacks - failed_callbacks)], - [s.callback for s in failed_callbacks]) - DELIVERY_SAMPLER.sample(reporter) - - work.update(more_subscribers, failed_callbacks) - -################################################################################ - -def take_polling_action(topic_list, poll_type): - """Takes an action on a set of topics to be polled. - - Args: - topic_list: The iterable of topic URLs to take a polling action on. - poll_type: The type of polling to do. - """ - try: - if poll_type == 'record': - for topic in topic_list: - KnownFeed.record(topic) - else: - # Force these FeedToFetch records to be written to disk so we ensure - # that we will eventually polll the feeds. - FeedToFetch.insert(topic_list, memory_only=False) - except (taskqueue.Error, apiproxy_errors.Error, - db.Error, runtime.DeadlineExceededError, - fork_join_queue.Error): - logging.exception('Could not take polling action ' - 'of type %r for topics: %s', poll_type, topic_list) - - -class PollBootstrapHandler(webapp.RequestHandler): - """Boostrap handler automatically polls feeds.""" - - @work_queue_only - def get(self): - poll_type = self.request.get('poll_type', 'bootstrap') - the_mark = PollingMarker.get() - if the_mark.should_progress(): - # Naming the task based on the current start time here allows us to - # enqueue the *next* task in the polling chain before we've enqueued - # any of the actual FeedToFetch tasks. This is great because it lets us - # queue up a ton of tasks in parallel (since the task queue is reentrant). - # - # Without the task name present, each intermittent failure in the polling - # chain would cause an *alternate* sequence of tasks to execute. This - # causes exponential explosion in the number of tasks (think of an - # NP diagram or the "multiverse" of time/space). Yikes. - name = 'poll-' + str(int(time.mktime(the_mark.last_start.utctimetuple()))) - try: - taskqueue.Task( - url='/work/poll_bootstrap', - name=name, - params=dict(sequence=name, poll_type=poll_type) - ).add(POLLING_QUEUE) - except (taskqueue.TaskAlreadyExistsError, taskqueue.TombstonedTaskError): - logging.exception('Could not enqueue FIRST polling task') - - the_mark.put() - - @work_queue_only - def post(self): - sequence = self.request.get('sequence') - current_key = self.request.get('current_key') - poll_type = self.request.get('poll_type') - logging.info('Handling polling for sequence = %s, ' - 'current_key = %r, poll_type = %r', - sequence, current_key, poll_type) - - query = KnownFeed.all() - if current_key: - query.filter('__key__ >', datastore_types.Key(current_key)) - known_feeds = query.fetch(BOOSTRAP_FEED_CHUNK_SIZE) - - if known_feeds: - current_key = str(known_feeds[-1].key()) - logging.info('Found %s more feeds to poll, ended at %s', - len(known_feeds), known_feeds[-1].topic) - try: - taskqueue.Task( - url='/work/poll_bootstrap', - name='%s-%s' % (sequence, sha1_hash(current_key)), - params=dict(sequence=sequence, - current_key=current_key, - poll_type=poll_type)).add(POLLING_QUEUE) - except (taskqueue.TaskAlreadyExistsError, taskqueue.TombstonedTaskError): - logging.exception('Continued polling task already present; ' - 'this work has already been done') - return - - # TODO(bslatkin): Do more intelligent retrying of polling actions. - hooks.execute(take_polling_action, - [k.topic for k in known_feeds], - poll_type) - - else: - logging.info('Polling cycle complete') - current_key = None - -################################################################################ -# Feed canonicalization - -class RecordFeedHandler(webapp.RequestHandler): - """Background worker for categorizing/classifying feed URLs by their ID.""" - - def __init__(self, now=datetime.datetime.now): - """Initializer. - - Args: - now: Callable that returns the current time as a datetime.datetime. - """ - webapp.RequestHandler.__init__(self) - self.now = now - - @work_queue_only - def post(self): - topic = self.request.get('topic') - logging.debug('Recording topic = %s', topic) - - known_feed_key = KnownFeed.create_key(topic) - known_feed = KnownFeed.get(known_feed_key) - if known_feed: - seconds_since_update = self.now() - known_feed.update_time - if known_feed.feed_id and (seconds_since_update < - datetime.timedelta(seconds=FEED_IDENTITY_UPDATE_PERIOD)): - logging.debug('Ignoring feed identity update for topic = %s ' - 'due to update %s ago', topic, seconds_since_update) - return - else: - known_feed = KnownFeed.create(topic) - - try: - response = urlfetch.fetch(topic) - except (apiproxy_errors.Error, urlfetch.Error), e: - logging.warning('Could not fetch topic = %s for feed ID. %s: %s', - topic, e.__class__.__name__, e) - known_feed.put() - return - - # TODO(bslatkin): Add more intelligent retrying of feed identification. - if response.status_code != 200: - logging.warning('Fetching topic = %s for feed ID returned response %s', - topic, response.status_code) - known_feed.put() - return - - order = (ATOM, RSS) - parse_failures = 0 - error_traceback = 'Could not determine feed_id' - feed_id = None - for feed_type in order: - try: - feed_id = feed_identifier.identify(response.content, feed_type) - if feed_id is not None: - break - else: - parse_failures += 1 - except Exception: - error_traceback = traceback.format_exc() - logging.debug( - 'Could not parse feed for content of %d bytes in format "%s":\n%s', - len(response.content), feed_type, error_traceback) - parse_failures += 1 - - if parse_failures == len(order) or not feed_id: - logging.warning('Could not record feed ID for topic=%r, feed_id=%r:\n%s', - topic, feed_id, error_traceback) - known_feed.put() - # Just give up, since we can't parse it. This case also covers when - # the character encoding for the document is unsupported or the document - # is of an arbitrary content type. - return - - logging.info('For topic = %s found new feed ID %r; old feed ID was %r', - topic, feed_id, known_feed.feed_id) - - if known_feed.feed_id and known_feed.feed_id != feed_id: - logging.info('Removing old feed_id relation from ' - 'topic = %r to feed_id = %r', topic, known_feed.feed_id) - KnownFeedIdentity.remove(known_feed.feed_id, topic) - - KnownFeedIdentity.update(feed_id, topic) - known_feed.feed_id = feed_id - known_feed.put() - -################################################################################ - -class HubHandler(webapp.RequestHandler): - """Handler to multiplex subscribe and publish events on the same URL.""" - - def get(self): - context = { - 'host': self.request.host, - } - self.response.out.write(template.render('welcome.html', context)) - - def post(self): - mode = self.request.get('hub.mode', '').lower() - if mode == 'publish': - handler = PublishHandler() - elif mode in ('subscribe', 'unsubscribe'): - handler = SubscribeHandler() - else: - self.response.set_status(400) - self.response.out.write('hub.mode is invalid') - return - - handler.initialize(self.request, self.response) - handler.post() - - -class TopicDetailHandler(webapp.RequestHandler): - """Handler that serves topic debugging information to end-users.""" - - @dos.limit(count=5, period=60) - def get(self): - topic_url = normalize_iri(self.request.get('hub.url')) - feed = FeedRecord.get_by_key_name(FeedRecord.create_key_name(topic_url)) - if not feed: - self.response.set_status(400) - context = { - 'topic_url': topic_url, - 'error': 'Could not find any record for topic URL: ' + topic_url, - } - else: - fetch_score = FETCH_SCORER.filter([topic_url])[0] - context = { - 'topic_url': topic_url, - 'last_successful_fetch': feed.last_updated, - 'last_content_type': feed.content_type, - 'last_etag': feed.etag, - 'last_modified': feed.last_modified, - 'last_header_footer': feed.header_footer, - 'fetch_blocked': not fetch_score[0], - 'fetch_errors': fetch_score[1] * 100, - 'fetch_url_error': FETCH_SAMPLER.get_chain( - FETCH_URL_SAMPLE_MINUTE, - FETCH_URL_SAMPLE_30_MINUTE, - FETCH_URL_SAMPLE_HOUR, - FETCH_URL_SAMPLE_DAY, - single_key=topic_url), - 'fetch_url_latency': FETCH_SAMPLER.get_chain( - FETCH_URL_SAMPLE_MINUTE_LATENCY, - FETCH_URL_SAMPLE_30_MINUTE_LATENCY, - FETCH_URL_SAMPLE_HOUR_LATENCY, - FETCH_URL_SAMPLE_DAY_LATENCY, - single_key=topic_url), - } - - if users.is_current_user_admin(): - feed_stats = db.get(KnownFeedStats.create_key(topic_url=topic_url)) - if feed_stats: - context.update({ - 'subscriber_count': feed_stats.subscriber_count, - 'feed_stats_update_time': feed_stats.update_time, - }) - - fetch = FeedToFetch.get_by_topic(topic_url) - if fetch: - context.update({ - 'next_fetch': fetch.eta, - 'fetch_attempts': fetch.fetching_failures, - 'totally_failed': fetch.totally_failed, - }) - self.response.out.write(template.render('topic_details.html', context)) - - -class SubscriptionDetailHandler(webapp.RequestHandler): - """Handler that serves details about subscriber deliveries to end-users.""" - - @dos.limit(count=5, period=60) - def get(self): - topic_url = normalize_iri(self.request.get('hub.topic')) - callback_url = normalize_iri(self.request.get('hub.callback')) - secret = normalize_iri(self.request.get('hub.secret')) - subscription = Subscription.get_by_key_name( - Subscription.create_key_name(callback_url, topic_url)) - callback_domain = dos.get_url_domain(callback_url) - - context = { - 'topic_url': topic_url, - 'callback_url': callback_url, - 'callback_domain': callback_domain, - } - - if not subscription or ( - not users.is_current_user_admin() and - subscription.secret and - subscription.secret != secret): - context.update({ - 'error': 'Could not find any subscription for ' - 'the given (callback, topic, secret) tuple' - }) - else: - failed_events = (EventToDeliver.all() - .filter('failed_callbacks =', subscription.key()) - .fetch(25)) - delivery_score = DELIVERY_SCORER.filter([callback_url])[0] - - context.update({ - 'created_time': subscription.created_time, - 'last_modified': subscription.last_modified, - 'lease_seconds': subscription.lease_seconds, - 'expiration_time': subscription.expiration_time, - 'confirm_failures': subscription.confirm_failures, - 'subscription_state': subscription.subscription_state, - 'failed_events': [ - { - 'last_modified': e.last_modified, - 'retry_attempts': e.retry_attempts, - 'totally_failed': e.totally_failed, - 'content_type': e.content_type, - 'payload_trunc': e.payload[:10000], - } - for e in failed_events], - 'delivery_blocked': not delivery_score[0], - 'delivery_errors': delivery_score[1] * 100, - 'delivery_url_error': DELIVERY_SAMPLER.get_chain( - DELIVERY_URL_SAMPLE_MINUTE, - DELIVERY_URL_SAMPLE_30_MINUTE, - DELIVERY_URL_SAMPLE_HOUR, - DELIVERY_URL_SAMPLE_DAY, - single_key=callback_url), - 'delivery_url_latency': DELIVERY_SAMPLER.get_chain( - DELIVERY_URL_SAMPLE_MINUTE_LATENCY, - DELIVERY_URL_SAMPLE_30_MINUTE_LATENCY, - DELIVERY_URL_SAMPLE_HOUR_LATENCY, - DELIVERY_URL_SAMPLE_DAY_LATENCY, - single_key=callback_url), - }) - # Only show the domain stats when the subscription had a secret. - if subscription.secret or users.is_current_user_admin(): - context.update({ - 'delivery_domain_error': DELIVERY_SAMPLER.get_chain( - DELIVERY_DOMAIN_SAMPLE_MINUTE, - DELIVERY_DOMAIN_SAMPLE_30_MINUTE, - DELIVERY_DOMAIN_SAMPLE_HOUR, - DELIVERY_DOMAIN_SAMPLE_DAY, - single_key=callback_url), - 'delivery_domain_latency': DELIVERY_SAMPLER.get_chain( - DELIVERY_DOMAIN_SAMPLE_MINUTE_LATENCY, - DELIVERY_DOMAIN_SAMPLE_30_MINUTE_LATENCY, - DELIVERY_DOMAIN_SAMPLE_HOUR_LATENCY, - DELIVERY_DOMAIN_SAMPLE_DAY_LATENCY, - single_key=callback_url), - }) - - self.response.out.write(template.render('event_details.html', context)) - - -class StatsHandler(webapp.RequestHandler): - """Handler that serves DoS statistics information.""" - - def post(self): - if self.request.get('action').lower() == 'flush': - logging.critical('Flushing memcache!') - memcache.flush_all() - self.redirect('/stats') - - def get(self): - context = { - 'fetch_url_error': FETCH_SAMPLER.get_chain( - FETCH_URL_SAMPLE_MINUTE, - FETCH_URL_SAMPLE_30_MINUTE, - FETCH_URL_SAMPLE_HOUR, - FETCH_URL_SAMPLE_DAY), - 'fetch_url_latency': FETCH_SAMPLER.get_chain( - FETCH_URL_SAMPLE_MINUTE_LATENCY, - FETCH_URL_SAMPLE_30_MINUTE_LATENCY, - FETCH_URL_SAMPLE_HOUR_LATENCY, - FETCH_URL_SAMPLE_DAY_LATENCY), - 'fetch_domain_error': FETCH_SAMPLER.get_chain( - FETCH_DOMAIN_SAMPLE_MINUTE, - FETCH_DOMAIN_SAMPLE_30_MINUTE, - FETCH_DOMAIN_SAMPLE_HOUR, - FETCH_DOMAIN_SAMPLE_DAY), - 'fetch_domain_latency': FETCH_SAMPLER.get_chain( - FETCH_DOMAIN_SAMPLE_MINUTE_LATENCY, - FETCH_DOMAIN_SAMPLE_30_MINUTE_LATENCY, - FETCH_DOMAIN_SAMPLE_HOUR_LATENCY, - FETCH_DOMAIN_SAMPLE_DAY_LATENCY), - 'delivery_url_error': DELIVERY_SAMPLER.get_chain( - DELIVERY_URL_SAMPLE_MINUTE, - DELIVERY_URL_SAMPLE_30_MINUTE, - DELIVERY_URL_SAMPLE_HOUR, - DELIVERY_URL_SAMPLE_DAY), - 'delivery_url_latency': DELIVERY_SAMPLER.get_chain( - DELIVERY_URL_SAMPLE_MINUTE_LATENCY, - DELIVERY_URL_SAMPLE_30_MINUTE_LATENCY, - DELIVERY_URL_SAMPLE_HOUR_LATENCY, - DELIVERY_URL_SAMPLE_DAY_LATENCY), - 'delivery_domain_error': DELIVERY_SAMPLER.get_chain( - DELIVERY_DOMAIN_SAMPLE_MINUTE, - DELIVERY_DOMAIN_SAMPLE_30_MINUTE, - DELIVERY_DOMAIN_SAMPLE_HOUR, - DELIVERY_DOMAIN_SAMPLE_DAY), - 'delivery_domain_latency': DELIVERY_SAMPLER.get_chain( - DELIVERY_DOMAIN_SAMPLE_MINUTE_LATENCY, - DELIVERY_DOMAIN_SAMPLE_30_MINUTE_LATENCY, - DELIVERY_DOMAIN_SAMPLE_HOUR_LATENCY, - DELIVERY_DOMAIN_SAMPLE_DAY_LATENCY), - } - all_configs = [] - all_configs.extend(FETCH_SAMPLER.configs) - all_configs.extend(DELIVERY_SAMPLER.configs) - context.update({ - 'all_configs': all_configs, - 'show_everything': True, - }) - self.response.out.write(template.render('all_stats.html', context)) - -################################################################################ -# Hook system - -class InvalidHookError(Exception): - """A module has tried to access a hook for an unknown function.""" - - -class Hook(object): - """A conditional hook that overrides or modifies Hub behavior. - - Each Hook corresponds to a single Python callable that may be overridden - by the hook system. Multiple Hooks may inspect or modify the parameters, but - only a single callable may elect to actually handle the call. The inspect() - method will be called for each hook in the order the hooks are imported - by the HookManager. The final set of parameters will be passed to the - targetted hook's __call__() method. If more than one Hook elects to execute - a hooked function, a warning logging message be issued and the *first* Hook - encountered will be executed. - """ - - def inspect(self, args, kwargs): - """Inspects a hooked function's parameters, possibly modifying them. - - Args: - args: List of positional arguments for the hook call. - kwargs: Dictionary of keyword arguments for the hook call. - - Returns: - True if this Hook should handle the call, False otherwise. - """ - return False - - def __call__(self, *args, **kwargs): - """Handles the hook call. - - Args: - *args, **kwargs: Parameters matching the original function's signature. - - Returns: - The return value expected by the original function. - """ - assert False, '__call__ method not defined for %s' % self.__class__ - - -class HookManager(object): - """Manages registering and loading Hooks from external modules. - - Hook modules will have a copy of this 'main' module's contents in their - globals dictionary and the Hooks class to be sub-classed. They will also - have the 'register' method, which the hook module should use to register any - Hook sub-classes that it defines. - - The 'register' method has the same signature as the _register method of - this class, but without the leading 'filename' argument; that value is - curried by the HookManager. - """ - - def __init__(self): - """Initializer.""" - # Maps hook functions to a list of (filename, Hook) tuples. - self._mapping = {} - - def load(self, hooks_path='hooks', globals_dict=None): - """Loads all hooks from a particular directory. - - Args: - hooks_path: Optional. Relative path to the application directory or - absolute path to load hook modules from. - globals_dict: Dictionary of global variables to use when loading the - hook module. If None, defaults to the contents of this 'main' module. - Only for use in testing! - """ - if globals_dict is None: - globals_dict = globals() - - hook_directory = os.path.join(os.getcwd(), hooks_path) - if not os.path.exists(hook_directory): - return - module_list = os.listdir(hook_directory) - for module_name in sorted(module_list): - if not module_name.endswith('.py'): - continue - module_path = os.path.join(hook_directory, module_name) - context_dict = globals_dict.copy() - context_dict.update({ - 'Hook': Hook, - 'register': lambda *a, **k: self._register(module_name, *a, **k) - }) - logging.debug('Loading hook "%s" from %s', module_name, module_path) - try: - exec open(module_path) in context_dict - except: - logging.exception('Error loading hook "%s" from %s', - module_name, module_path) - raise - - def declare(self, original): - """Declares a function as being hookable. - - Args: - original: Python callable that may be hooked. - """ - self._mapping[original] = [] - - def execute(self, original, *args, **kwargs): - """Executes a hookable method, possibly invoking a registered Hook. - - Args: - original: The original hooked callable. - args: Positional arguments to pass to the callable. - kwargs: Keyword arguments to pass to the callable. - - Returns: - Whatever value is returned by the hooked call. - """ - try: - hook_list = self._mapping[original] - except KeyError, e: - raise InvalidHookError(e) - - modifiable_args = list(args) - modifiable_kwargs = dict(kwargs) - matches = [] - for filename, hook in hook_list: - if hook.inspect(modifiable_args, modifiable_kwargs): - matches.append((filename, hook)) - - filename = __name__ - designated_hook = original - if len(matches) >= 1: - filename, designated_hook = matches[0] - - if len(matches) > 1: - logging.critical( - 'Found multiple matching hooks for %s in files: %s. ' - 'Will use the first hook encountered: %s', - original, [f for (f, hook) in matches], filename) - - return designated_hook(*args, **kwargs) - - def _register(self, filename, original, hook): - """Registers a Hook to inspect and potentially execute a hooked function. - - Args: - filename: The name of the hook module this Hook is defined in. - original: The Python callable of the original hooked function. - hook: The Hook to register for this hooked function. - - Raises: - InvalidHookError if the original hook function is not known. - """ - try: - self._mapping[original].append((filename, hook)) - except KeyError, e: - raise InvalidHookError(e) - - def override_for_test(self, original, test): - """Adds a hook function for testing. - - Args: - original: The Python callable of the original hooked function. - test: The callable to use to override the original for this hook function. - """ - class OverrideHook(Hook): - def inspect(self, args, kwargs): - return True - def __call__(self, *args, **kwargs): - return test(*args, **kwargs) - self._register(__name__, original, OverrideHook()) - - def reset_for_test(self, original): - """Clears the configured test hook for a hooked function. - - Args: - original: The Python callable of the original hooked function. - """ - self._mapping[original].pop() - -################################################################################ - -HANDLERS = [] - - -def modify_handlers(handlers): - """Modifies the set of web request handlers. - - Args: - handlers: List of (path_regex, webapp.RequestHandler) instances that are - configured for this application. - - Returns: - Modified list of handlers, with some possibly removed and others added. - """ - return handlers - - -def main(): - global HANDLERS - if not HANDLERS: - HANDLERS = hooks.execute(modify_handlers, [ - # External interfaces - (r'/', HubHandler), - (r'/publish', PublishHandler), - (r'/subscribe', SubscribeHandler), - (r'/topic-details', TopicDetailHandler), - (r'/subscription-details', SubscriptionDetailHandler), - (r'/stats', StatsHandler), - # Low-latency workers - (r'/work/subscriptions', SubscriptionConfirmHandler), - (r'/work/pull_feeds', PullFeedHandler), - (r'/work/push_events', PushEventHandler), - (r'/work/record_feeds', RecordFeedHandler), - # Periodic workers - (r'/work/poll_bootstrap', PollBootstrapHandler), - (r'/work/subscription_cleanup', SubscriptionCleanupHandler), - (r'/work/reconfirm_subscriptions', SubscriptionReconfirmHandler), - (r'/work/cleanup_mapper', CleanupMapperHandler), - ]) - application = webapp.WSGIApplication(HANDLERS, debug=DEBUG) - wsgiref.handlers.CGIHandler().run(application) - -################################################################################ -# Declare and load external hooks. - -hooks = HookManager() -hooks.declare(confirm_subscription) -hooks.declare(derive_sources) -hooks.declare(inform_event) -hooks.declare(modify_handlers) -hooks.declare(preprocess_urls) -hooks.declare(pull_feed) -hooks.declare(pull_feed_async) -hooks.declare(push_event) -hooks.declare(take_polling_action) -hooks.load() - - -if __name__ == '__main__': - main() diff --git a/hub/main_test.py b/hub/main_test.py deleted file mode 100755 index c2b7a93..0000000 --- a/hub/main_test.py +++ /dev/null @@ -1,4350 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Tests for the main module.""" - -import datetime -import logging -logging.basicConfig(format='%(levelname)-8s %(filename)s] %(message)s') -import os -import shutil -import sys -import time -import tempfile -import unittest -import urllib -import xml.sax - -import testutil -testutil.fix_path() - - -from google.appengine import runtime -from google.appengine.api import memcache -from google.appengine.ext import db -from google.appengine.ext import webapp -from google.appengine.runtime import apiproxy_errors - -import async_apiproxy -import dos -import feed_diff -import main -import urlfetch_test_stub - -import mapreduce.control -import mapreduce.model - -################################################################################ -# For convenience - -sha1_hash = main.sha1_hash -get_hash_key_name = main.get_hash_key_name - -OTHER_STRING = '/~one:two/&=' -FUNNY = '/CaSeSeNsItIvE' -FUNNY_UNICODE = u'/blah/\u30d6\u30ed\u30b0\u8846' -FUNNY_UTF8 = '/blah/\xe3\x83\x96\xe3\x83\xad\xe3\x82\xb0\xe8\xa1\x86' -FUNNY_IRI = '/blah/%E3%83%96%E3%83%AD%E3%82%B0%E8%A1%86' - -################################################################################ - -class UtilityFunctionTest(unittest.TestCase): - """Tests for utility functions.""" - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - - def testSha1Hash(self): - self.assertEquals('09f2c66851e75a7800748808ae7d855869b0c9d7', - main.sha1_hash('this is my test data')) - - def testGetHashKeyName(self): - self.assertEquals('hash_54f6638eb67ad389b66bbc3fa65f7392b0c2d270', - get_hash_key_name('and now testing a key')) - - def testSha1Hmac(self): - self.assertEquals('d95abcea4b2a8b0219da7cb04c261639a7bd8c94', - main.sha1_hmac('secrat', 'mydatahere')) - - def testIsValidUrl(self): - self.assertTrue(main.is_valid_url( - 'https://example.com:443/path/to?handler=1&b=2')) - self.assertTrue(main.is_valid_url('http://example.com:8080')) - self.assertFalse(main.is_valid_url('httpm://example.com')) - self.assertFalse(main.is_valid_url('http://example.com:9999')) - self.assertFalse(main.is_valid_url('http://example.com/blah#bad')) - - def testNormalizeIri(self): - uri_with_port = u'http://foo.com:9120/url/with/a/port' - self.assertEquals(uri_with_port, main.normalize_iri(uri_with_port)) - - uri_with_query = u'http://foo.com:9120/url?doh=this&port=1' - self.assertEquals(uri_with_query, main.normalize_iri(uri_with_query)) - - uri_with_funny = u'http://foo.com/~myuser/@url!with#nice;delimiter:chars' - self.assertEquals(uri_with_funny, main.normalize_iri(uri_with_funny)) - - not_unicode = 'http://foo.com:9120/url/with/a/port' - self.assertEquals(not_unicode, main.normalize_iri(not_unicode)) - - uri_with_port = u'http://foo.com:9120/url/with/a/port' - self.assertEquals(uri_with_port, main.normalize_iri(uri_with_port)) - - good_iri = ( - 'http://www.google.com/reader/public/atom/user' - '/07256788297315478906/label/%E3%83%96%E3%83%AD%E3%82%B0%E8%A1%86') - iri = (u'http://www.google.com/reader/public/atom/user' - u'/07256788297315478906/label/\u30d6\u30ed\u30b0\u8846') - self.assertEquals(good_iri, main.normalize_iri(iri)) - -################################################################################ - -class TestWorkQueueHandler(webapp.RequestHandler): - @main.work_queue_only - def get(self): - self.response.out.write('Pass') - - -class WorkQueueOnlyTest(testutil.HandlerTestBase): - """Tests the @work_queue_only decorator.""" - - handler_class = TestWorkQueueHandler - - def testNotLoggedIn(self): - os.environ['SERVER_SOFTWARE'] = 'Production' - self.handle('get') - self.assertEquals(302, self.response_code()) - - def testCronHeader(self): - os.environ['SERVER_SOFTWARE'] = 'Production' - os.environ['HTTP_X_APPENGINE_CRON'] = 'True' - try: - self.handle('get') - self.assertEquals('Pass', self.response_body()) - finally: - del os.environ['HTTP_X_APPENGINE_CRON'] - - def testDevelopmentEnvironment(self): - os.environ['SERVER_SOFTWARE'] = 'Development/1.0' - self.handle('get') - self.assertEquals('Pass', self.response_body()) - - def testAdminUser(self): - os.environ['SERVER_SOFTWARE'] = 'Production' - os.environ['USER_EMAIL'] = 'foo@example.com' - os.environ['USER_IS_ADMIN'] = '1' - try: - self.handle('get') - self.assertEquals('Pass', self.response_body()) - finally: - del os.environ['USER_IS_ADMIN'] - - def testNonAdminUser(self): - os.environ['SERVER_SOFTWARE'] = 'Production' - os.environ['USER_EMAIL'] = 'foo@example.com' - os.environ['USER_IS_ADMIN'] = '0' - try: - self.handle('get') - self.assertEquals(401, self.response_code()) - finally: - del os.environ['USER_IS_ADMIN'] - - def testTaskQueueHeader(self): - os.environ['SERVER_SOFTWARE'] = 'Production' - os.environ['HTTP_X_APPENGINE_TASKNAME'] = 'Foobar' - try: - self.handle('get') - self.assertEquals('Pass', self.response_body()) - finally: - del os.environ['HTTP_X_APPENGINE_TASKNAME'] - -################################################################################ - -KnownFeed = main.KnownFeed - -class KnownFeedTest(unittest.TestCase): - """Tests for the KnownFeed model class.""" - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - self.topic = 'http://example.com/my-topic' - self.topic2 = 'http://example.com/my-topic2' - self.topic3 = 'http://example.com/my-topic3' - - def testCreateAndDelete(self): - known_feed = KnownFeed.create(self.topic) - self.assertEquals(self.topic, known_feed.topic) - db.put(known_feed) - - found_feed = db.get(KnownFeed.create_key(self.topic)) - self.assertEquals(found_feed.key(), known_feed.key()) - self.assertEquals(found_feed.topic, known_feed.topic) - - db.delete(KnownFeed.create_key(self.topic)) - self.assertTrue(db.get(KnownFeed.create_key(self.topic)) is None) - - def testCheckExistsMissing(self): - self.assertEquals([], KnownFeed.check_exists([])) - self.assertEquals([], KnownFeed.check_exists([self.topic])) - self.assertEquals([], KnownFeed.check_exists( - [self.topic, self.topic2, self.topic3])) - self.assertEquals([], KnownFeed.check_exists( - [self.topic, self.topic, self.topic, self.topic2, self.topic2])) - - def testCheckExists(self): - KnownFeed.create(self.topic).put() - KnownFeed.create(self.topic2).put() - KnownFeed.create(self.topic3).put() - self.assertEquals([self.topic], KnownFeed.check_exists([self.topic])) - self.assertEquals([self.topic2], KnownFeed.check_exists([self.topic2])) - self.assertEquals([self.topic3], KnownFeed.check_exists([self.topic3])) - self.assertEquals( - sorted([self.topic, self.topic2, self.topic3]), - sorted(KnownFeed.check_exists([self.topic, self.topic2, self.topic3]))) - self.assertEquals( - sorted([self.topic, self.topic2]), - sorted(KnownFeed.check_exists( - [self.topic, self.topic, self.topic, self.topic2, self.topic2]))) - - def testCheckExistsSubset(self): - KnownFeed.create(self.topic).put() - KnownFeed.create(self.topic3).put() - self.assertEquals( - sorted([self.topic, self.topic3]), - sorted(KnownFeed.check_exists([self.topic, self.topic2, self.topic3]))) - self.assertEquals( - sorted([self.topic, self.topic3]), - sorted(KnownFeed.check_exists( - [self.topic, self.topic, self.topic, - self.topic2, self.topic2, - self.topic3, self.topic3]))) - - def testRecord(self): - """Tests the method for recording a feed's identity.""" - KnownFeed.record(self.topic) - task = testutil.get_tasks(main.MAPPINGS_QUEUE, index=0, expected_count=1) - self.assertEquals(self.topic, task['params']['topic']) - -################################################################################ - -KnownFeedIdentity = main.KnownFeedIdentity - -class KnownFeedIdentityTest(unittest.TestCase): - """Tests for the KnownFeedIdentity class.""" - - def setUp(self): - testutil.setup_for_testing() - self.feed_id = 'my;feed;id' - self.feed_id2 = 'my;feed;id;2' - self.topic = 'http://example.com/foobar1' - self.topic2 = 'http://example.com/meep2' - self.topic3 = 'http://example.com/stuff3' - self.topic4 = 'http://example.com/blah4' - self.topic5 = 'http://example.com/woot5' - self.topic6 = 'http://example.com/neehaw6' - - def testUpdate(self): - """Tests the update method.""" - feed = KnownFeedIdentity.update(self.feed_id, self.topic) - feed_key = KnownFeedIdentity.create_key(self.feed_id) - self.assertEquals(feed_key, feed.key()) - self.assertEquals(self.feed_id, feed.feed_id) - self.assertEquals([self.topic], feed.topics) - - feed = KnownFeedIdentity.update(self.feed_id, self.topic2) - self.assertEquals(self.feed_id, feed.feed_id) - self.assertEquals([self.topic, self.topic2], feed.topics) - - def testRemove(self): - """Tests the remove method.""" - # Removing a mapping from an unknown ID does nothing. - self.assertTrue(KnownFeedIdentity.remove(self.feed_id, self.topic) is None) - - KnownFeedIdentity.update(self.feed_id, self.topic) - KnownFeedIdentity.update(self.feed_id, self.topic2) - - # Removing an unknown mapping for a known ID does nothing. - self.assertTrue(KnownFeedIdentity.remove(self.feed_id, self.topic3) is None) - - # Removing from a known ID returns the updated copy. - feed = KnownFeedIdentity.remove(self.feed_id, self.topic2) - self.assertEquals([self.topic], feed.topics) - - # Removing a second time does nothing. - self.assertTrue(KnownFeedIdentity.remove(self.feed_id, self.topic2) is None) - feed = KnownFeedIdentity.get(KnownFeedIdentity.create_key(self.feed_id)) - self.assertEquals([self.topic], feed.topics) - - # Removing the last one will delete the mapping completely. - self.assertTrue(KnownFeedIdentity.remove(self.feed_id, self.topic) is None) - feed = KnownFeedIdentity.get(KnownFeedIdentity.create_key(self.feed_id)) - self.assertTrue(feed is None) - - def testDeriveAdditionalTopics(self): - """Tests the derive_additional_topics method.""" - # topic, topic2 -> feed_id - for topic in (self.topic, self.topic2): - feed = KnownFeed.create(topic) - feed.feed_id = self.feed_id - feed.put() - KnownFeedIdentity.update(self.feed_id, self.topic) - KnownFeedIdentity.update(self.feed_id, self.topic2) - - # topic3, topic4 -> feed_id2 - for topic in (self.topic3, self.topic4): - feed = KnownFeed.create(topic) - feed.feed_id = self.feed_id2 - feed.put() - KnownFeedIdentity.update(self.feed_id2, self.topic3) - KnownFeedIdentity.update(self.feed_id2, self.topic4) - - # topic5 -> KnownFeed missing; should not be expanded at all - # topic6 -> KnownFeed where feed_id = None; default to simple mapping - KnownFeed.create(self.topic6).put() - - # Put missing topics first to provoke potential ordering errors in the - # iteration order of the retrieval loop. - result = KnownFeedIdentity.derive_additional_topics([ - self.topic5, self.topic6, self.topic, - self.topic2, self.topic3, self.topic4]) - - expected = { - 'http://example.com/foobar1': - set(['http://example.com/foobar1', 'http://example.com/meep2']), - 'http://example.com/meep2': - set(['http://example.com/foobar1', 'http://example.com/meep2']), - 'http://example.com/blah4': - set(['http://example.com/blah4', 'http://example.com/stuff3']), - 'http://example.com/neehaw6': - set(['http://example.com/neehaw6']), - 'http://example.com/stuff3': - set(['http://example.com/blah4', 'http://example.com/stuff3']) - } - self.assertEquals(expected, result) - - def testDeriveAdditionalTopicsWhitespace(self): - """Tests when the feed ID contains whitespace it is handled correctly. - - This test is only required because the 'feed_identifier' module did not - properly strip whitespace in its initial version. - """ - # topic -> feed_id with whitespace - feed = KnownFeed.create(self.topic) - feed.feed_id = self.feed_id - feed.put() - KnownFeedIdentity.update(self.feed_id, self.topic) - - # topic2 -> feed_id without whitespace - feed = KnownFeed.create(self.topic2) - feed.feed_id = '\n %s \n \n' % self.feed_id - feed.put() - KnownFeedIdentity.update(self.feed_id, self.topic2) - - # topic3 -> KnownFeed where feed_id = all whitespace - feed = KnownFeed.create(self.topic3) - feed.feed_id = '\n \n \n' - feed.put() - - result = KnownFeedIdentity.derive_additional_topics([ - self.topic, self.topic2, self.topic3]) - - expected = { - 'http://example.com/foobar1': - set(['http://example.com/foobar1', 'http://example.com/meep2']), - 'http://example.com/stuff3': - set(['http://example.com/stuff3']), - } - self.assertEquals(expected, result) - - def testKnownFeedIdentityTooLarge(self): - """Tests when the fan-out expansion of the KnownFeedIdentity is too big.""" - feed = KnownFeedIdentity.update(self.feed_id, self.topic) - KnownFeedIdentity.update( - self.feed_id, - 'http://super-extra-long-topic/' + ('a' * 10000000)) - # Doesn't explode and the update time stays the same. - new_feed = db.get(feed.key()) - self.assertEquals(feed.last_update, new_feed.last_update) - -################################################################################ - -Subscription = main.Subscription - - -class SubscriptionTest(unittest.TestCase): - """Tests for the Subscription model class.""" - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - self.callback = 'http://example.com/my-callback-url' - self.callback2 = 'http://example.com/second-callback-url' - self.callback3 = 'http://example.com/third-callback-url' - self.topic = 'http://example.com/my-topic-url' - self.topic2 = 'http://example.com/second-topic-url' - self.token = 'token' - self.secret = 'my secrat' - self.callback_key_map = dict( - (Subscription.create_key_name(cb, self.topic), cb) - for cb in (self.callback, self.callback2, self.callback3)) - - def get_subscription(self): - """Returns the subscription for the test callback and topic.""" - return Subscription.get_by_key_name( - Subscription.create_key_name(self.callback, self.topic)) - - def verify_tasks(self, next_state, verify_token, secret, **kwargs): - """Verifies the required tasks have been submitted. - - Args: - next_state: The next state the Subscription should have. - verify_token: The token that should be used to confirm the - subscription action. - **kwargs: Passed to testutil.get_tasks(). - """ - task = testutil.get_tasks(main.SUBSCRIPTION_QUEUE, **kwargs) - self.assertEquals(next_state, task['params']['next_state']) - self.assertEquals(verify_token, task['params']['verify_token']) - self.assertEquals(secret, task['params']['secret']) - - def testRequestInsert_defaults(self): - now_datetime = datetime.datetime.now() - now = lambda: now_datetime - lease_seconds = 1234 - - self.assertTrue(Subscription.request_insert( - self.callback, self.topic, self.token, - self.secret, lease_seconds=lease_seconds, now=now)) - self.verify_tasks(Subscription.STATE_VERIFIED, self.token, self.secret, - expected_count=1, index=0) - self.assertFalse(Subscription.request_insert( - self.callback, self.topic, self.token, - self.secret, lease_seconds=lease_seconds, now=now)) - self.verify_tasks(Subscription.STATE_VERIFIED, self.token, self.secret, - expected_count=2, index=1) - - sub = self.get_subscription() - self.assertEquals(Subscription.STATE_NOT_VERIFIED, sub.subscription_state) - self.assertEquals(self.callback, sub.callback) - self.assertEquals(sha1_hash(self.callback), sub.callback_hash) - self.assertEquals(self.topic, sub.topic) - self.assertEquals(sha1_hash(self.topic), sub.topic_hash) - self.assertEquals(self.token, sub.verify_token) - self.assertEquals(self.secret, sub.secret) - self.assertEquals(0, sub.confirm_failures) - self.assertEquals(now_datetime + datetime.timedelta(seconds=lease_seconds), - sub.expiration_time) - self.assertEquals(lease_seconds, sub.lease_seconds) - - def testInsert_defaults(self): - now_datetime = datetime.datetime.now() - now = lambda: now_datetime - lease_seconds = 1234 - - self.assertTrue(Subscription.insert( - self.callback, self.topic, self.token, self.secret, - lease_seconds=lease_seconds, now=now)) - self.assertFalse(Subscription.insert( - self.callback, self.topic, self.token, self.secret, - lease_seconds=lease_seconds, now=now)) - testutil.get_tasks(main.SUBSCRIPTION_QUEUE, expected_count=0) - - sub = self.get_subscription() - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.assertEquals(self.callback, sub.callback) - self.assertEquals(sha1_hash(self.callback), sub.callback_hash) - self.assertEquals(self.topic, sub.topic) - self.assertEquals(sha1_hash(self.topic), sub.topic_hash) - self.assertEquals(self.token, sub.verify_token) - self.assertEquals(self.secret, sub.secret) - self.assertEquals(0, sub.confirm_failures) - self.assertEquals(now_datetime + datetime.timedelta(seconds=lease_seconds), - sub.expiration_time) - self.assertEquals(lease_seconds, sub.lease_seconds) - - def testInsertOverride(self): - """Tests that insert will override the existing Subscription fields.""" - self.assertTrue(Subscription.request_insert( - self.callback, self.topic, self.token, self.secret)) - self.assertEquals(Subscription.STATE_NOT_VERIFIED, - self.get_subscription().subscription_state) - - second_token = 'second token' - second_secret = 'second secret' - sub = self.get_subscription() - sub.confirm_failures = 123 - sub.put() - self.assertFalse(Subscription.insert( - self.callback, self.topic, second_token, second_secret)) - - sub = self.get_subscription() - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.assertEquals(0, sub.confirm_failures) - self.assertEquals(second_token, sub.verify_token) - self.assertEquals(second_secret, sub.secret) - - self.verify_tasks(Subscription.STATE_VERIFIED, self.token, self.secret, - expected_count=1, index=0) - - def testInsert_expiration(self): - """Tests that the expiration time is updated on repeated insert() calls.""" - self.assertTrue(Subscription.insert( - self.callback, self.topic, self.token, self.secret)) - sub = Subscription.all().get() - expiration1 = sub.expiration_time - time.sleep(0.5) - self.assertFalse(Subscription.insert( - self.callback, self.topic, self.token, self.secret)) - sub = db.get(sub.key()) - expiration2 = sub.expiration_time - self.assertTrue(expiration2 > expiration1) - - def testRemove(self): - self.assertFalse(Subscription.remove(self.callback, self.topic)) - self.assertTrue(Subscription.request_insert( - self.callback, self.topic, self.token, self.secret)) - self.assertTrue(Subscription.remove(self.callback, self.topic)) - self.assertFalse(Subscription.remove(self.callback, self.topic)) - # Only task should be the initial insertion request. - self.verify_tasks(Subscription.STATE_VERIFIED, self.token, self.secret, - expected_count=1, index=0) - - def testRequestRemove(self): - """Tests the request remove method.""" - self.assertFalse(Subscription.request_remove( - self.callback, self.topic, self.token)) - # No tasks should be enqueued and this request should do nothing because - # no subscription currently exists. - testutil.get_tasks(main.SUBSCRIPTION_QUEUE, expected_count=0) - - self.assertTrue(Subscription.request_insert( - self.callback, self.topic, self.token, self.secret)) - second_token = 'this is the second token' - self.assertTrue(Subscription.request_remove( - self.callback, self.topic, second_token)) - - sub = self.get_subscription() - self.assertEquals(self.token, sub.verify_token) - self.assertEquals(Subscription.STATE_NOT_VERIFIED, sub.subscription_state) - - self.verify_tasks(Subscription.STATE_VERIFIED, self.token, self.secret, - expected_count=2, index=0) - self.verify_tasks(Subscription.STATE_TO_DELETE, second_token, '', - expected_count=2, index=1) - - def testRequestInsertOverride(self): - """Tests that requesting insertion does not override the verify_token.""" - self.assertTrue(Subscription.insert( - self.callback, self.topic, self.token, self.secret)) - second_token = 'this is the second token' - second_secret = 'another secret here' - self.assertFalse(Subscription.request_insert( - self.callback, self.topic, second_token, second_secret)) - - sub = self.get_subscription() - self.assertEquals(self.token, sub.verify_token) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - - self.verify_tasks(Subscription.STATE_VERIFIED, second_token, second_secret, - expected_count=1, index=0) - - def testHasSubscribers_unverified(self): - """Tests that unverified subscribers do not make the subscription active.""" - self.assertFalse(Subscription.has_subscribers(self.topic)) - self.assertTrue(Subscription.request_insert( - self.callback, self.topic, self.token, self.secret)) - self.assertFalse(Subscription.has_subscribers(self.topic)) - - def testHasSubscribers_verified(self): - self.assertTrue(Subscription.insert( - self.callback, self.topic, self.token, self.secret)) - self.assertTrue(Subscription.has_subscribers(self.topic)) - self.assertTrue(Subscription.remove(self.callback, self.topic)) - self.assertFalse(Subscription.has_subscribers(self.topic)) - - def testGetSubscribers_unverified(self): - """Tests that unverified subscribers will not be retrieved.""" - self.assertEquals([], Subscription.get_subscribers(self.topic, 10)) - self.assertTrue(Subscription.request_insert( - self.callback, self.topic, self.token, self.secret)) - self.assertTrue(Subscription.request_insert( - self.callback2, self.topic, self.token, self.secret)) - self.assertTrue(Subscription.request_insert( - self.callback3, self.topic, self.token, self.secret)) - self.assertEquals([], Subscription.get_subscribers(self.topic, 10)) - - def testGetSubscribers_verified(self): - self.assertEquals([], Subscription.get_subscribers(self.topic, 10)) - self.assertTrue(Subscription.insert( - self.callback, self.topic, self.token, self.secret)) - self.assertTrue(Subscription.insert( - self.callback2, self.topic, self.token, self.secret)) - self.assertTrue(Subscription.insert( - self.callback3, self.topic, self.token, self.secret)) - sub_list = Subscription.get_subscribers(self.topic, 10) - found_keys = set(s.key().name() for s in sub_list) - self.assertEquals(set(self.callback_key_map.keys()), found_keys) - - def testGetSubscribers_count(self): - self.assertTrue(Subscription.insert( - self.callback, self.topic, self.token, self.secret)) - self.assertTrue(Subscription.insert( - self.callback2, self.topic, self.token, self.secret)) - self.assertTrue(Subscription.insert( - self.callback3, self.topic, self.token, self.secret)) - sub_list = Subscription.get_subscribers(self.topic, 1) - self.assertEquals(1, len(sub_list)) - - def testGetSubscribers_withOffset(self): - """Tests the behavior of the starting_at_callback offset parameter.""" - # In the order the query will sort them. - all_hashes = [ - u'87a74994e48399251782eb401e9a61bd1d55aeee', - u'01518f29da9db10888a92e9f0211ac0c98ec7ecb', - u'f745d00a9806a5cdd39f16cd9eff80e8f064cfee', - ] - all_keys = ['hash_' + h for h in all_hashes] - all_callbacks = [self.callback_key_map[k] for k in all_keys] - - self.assertTrue(Subscription.insert( - self.callback, self.topic, self.token, self.secret)) - self.assertTrue(Subscription.insert( - self.callback2, self.topic, self.token, self.secret)) - self.assertTrue(Subscription.insert( - self.callback3, self.topic, self.token, self.secret)) - - def key_list(starting_at_callback): - sub_list = Subscription.get_subscribers( - self.topic, 10, starting_at_callback=starting_at_callback) - return [s.key().name() for s in sub_list] - - self.assertEquals(all_keys, key_list(None)) - self.assertEquals(all_keys, key_list(all_callbacks[0])) - self.assertEquals(all_keys[1:], key_list(all_callbacks[1])) - self.assertEquals(all_keys[2:], key_list(all_callbacks[2])) - - def testGetSubscribers_multipleTopics(self): - """Tests that separate topics do not overlap in subscriber queries.""" - self.assertEquals([], Subscription.get_subscribers(self.topic2, 10)) - self.assertTrue(Subscription.insert( - self.callback, self.topic, self.token, self.secret)) - self.assertTrue(Subscription.insert( - self.callback2, self.topic, self.token, self.secret)) - self.assertTrue(Subscription.insert( - self.callback3, self.topic, self.token, self.secret)) - self.assertEquals([], Subscription.get_subscribers(self.topic2, 10)) - - self.assertTrue(Subscription.insert( - self.callback2, self.topic2, self.token, self.secret)) - self.assertTrue(Subscription.insert( - self.callback3, self.topic2, self.token, self.secret)) - sub_list = Subscription.get_subscribers(self.topic2, 10) - found_keys = set(s.key().name() for s in sub_list) - self.assertEquals( - set(Subscription.create_key_name(cb, self.topic2) - for cb in (self.callback2, self.callback3)), - found_keys) - self.assertEquals(3, len(Subscription.get_subscribers(self.topic, 10))) - - def testConfirmFailed(self): - """Tests retry delay periods when a subscription confirmation fails.""" - start = datetime.datetime.utcnow() - def now(): - return start - - sub_key = Subscription.create_key_name(self.callback, self.topic) - self.assertTrue(Subscription.request_insert( - self.callback, self.topic, self.token, self.secret)) - sub_key = Subscription.create_key_name(self.callback, self.topic) - sub = Subscription.get_by_key_name(sub_key) - self.assertEquals(0, sub.confirm_failures) - - for i, delay in enumerate((5, 10, 20, 40, 80)): - self.assertTrue( - sub.confirm_failed(Subscription.STATE_VERIFIED, self.token, False, - max_failures=5, retry_period=5, now=now)) - self.assertEquals(sub.eta, start + datetime.timedelta(seconds=delay)) - self.assertEquals(i+1, sub.confirm_failures) - - # It will give up on the last try. - self.assertFalse( - sub.confirm_failed(Subscription.STATE_VERIFIED, self.token, False, - max_failures=5, retry_period=5)) - sub = Subscription.get_by_key_name(sub_key) - self.assertEquals(Subscription.STATE_NOT_VERIFIED, sub.subscription_state) - testutil.get_tasks(main.SUBSCRIPTION_QUEUE, index=0, expected_count=6) - - def testQueueSelected(self): - """Tests that auto_reconfirm will put the task on the polling queue.""" - self.assertTrue(Subscription.request_insert( - self.callback, self.topic, self.token, self.secret, - auto_reconfirm=True)) - testutil.get_tasks(main.SUBSCRIPTION_QUEUE, expected_count=0) - testutil.get_tasks(main.POLLING_QUEUE, expected_count=1) - - self.assertFalse(Subscription.request_insert( - self.callback, self.topic, self.token, self.secret, - auto_reconfirm=False)) - testutil.get_tasks(main.SUBSCRIPTION_QUEUE, expected_count=1) - testutil.get_tasks(main.POLLING_QUEUE, expected_count=1) - - def testArchiveExists(self): - """Tests the archive method when the subscription exists.""" - Subscription.insert(self.callback, self.topic, self.token, self.secret) - sub_key = Subscription.create_key_name(self.callback, self.topic) - sub = Subscription.get_by_key_name(sub_key) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - Subscription.archive(self.callback, self.topic) - sub = Subscription.get_by_key_name(sub_key) - self.assertEquals(Subscription.STATE_TO_DELETE, sub.subscription_state) - - def testArchiveMissing(self): - """Tests the archive method when the subscription does not exist.""" - sub_key = Subscription.create_key_name(self.callback, self.topic) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - Subscription.archive(self.callback, self.topic) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - -################################################################################ - -FeedToFetch = main.FeedToFetch - -class FeedToFetchTest(unittest.TestCase): - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - self.topic = 'http://example.com/topic-one' - self.topic2 = 'http://example.com/topic-two' - self.topic3 = 'http://example.com/topic-three' - - def testInsertAndGet(self): - """Tests inserting and getting work.""" - all_topics = [self.topic, self.topic2, self.topic3] - found_feeds = FeedToFetch.insert(all_topics) - task = testutil.get_tasks(main.FEED_QUEUE, index=0, expected_count=1) - self.assertTrue(task['name'].endswith('%d-0' % found_feeds[0].work_index)) - - for topic, feed_to_fetch in zip(all_topics, found_feeds): - self.assertEquals(topic, feed_to_fetch.topic) - self.assertEquals([], feed_to_fetch.source_keys) - self.assertEquals([], feed_to_fetch.source_values) - self.assertEquals(found_feeds[0].work_index, feed_to_fetch.work_index) - - def testEmpty(self): - """Tests when the list of urls is empty.""" - FeedToFetch.insert([]) - self.assertEquals([], testutil.get_tasks(main.FEED_QUEUE)) - - def testDuplicates(self): - """Tests duplicate urls.""" - all_topics = [self.topic, self.topic, self.topic2, self.topic2] - found_feeds = FeedToFetch.insert(all_topics) - found_topics = set(t.topic for t in found_feeds) - self.assertEquals(set(all_topics), found_topics) - task = testutil.get_tasks(main.FEED_QUEUE, index=0, expected_count=1) - self.assertTrue(task['name'].endswith('%d-0' % found_feeds[0].work_index)) - - def testDone(self): - """Tests marking the feed as completed.""" - (feed,) = FeedToFetch.insert([self.topic]) - self.assertFalse(feed.done()) - self.assertTrue(FeedToFetch.get_by_topic(self.topic) is None) - - def testDoneAfterFailure(self): - """Tests done() after a fetch_failed() writes the FeedToFetch to disk.""" - (feed,) = FeedToFetch.insert([self.topic]) - feed.fetch_failed() - self.assertTrue(feed.done()) - self.assertTrue(FeedToFetch.get_by_topic(self.topic) is None) - - def testDoneConflict(self): - """Tests when another entity was written over the top of this one.""" - (feed1,) = FeedToFetch.insert([self.topic]) - feed1.put() - (feed2,) = FeedToFetch.insert([self.topic]) - feed2.put() - - self.assertFalse(feed1.done()) - self.assertTrue(FeedToFetch.get_by_topic(self.topic) is not None) - - def testFetchFailed(self): - """Tests when the fetch fails and should be retried.""" - start = datetime.datetime.utcnow() - now = lambda: start - - (feed,) = FeedToFetch.insert([self.topic]) - etas = [] - for i, delay in enumerate((5, 10, 20, 40, 80)): - feed = FeedToFetch.get_by_topic(self.topic) or feed - feed.fetch_failed(max_failures=5, retry_period=5, now=now) - expected_eta = start + datetime.timedelta(seconds=delay) - self.assertEquals(expected_eta, feed.eta) - etas.append(testutil.task_eta(feed.eta)) - self.assertEquals(i+1, feed.fetching_failures) - self.assertEquals(False, feed.totally_failed) - - feed.fetch_failed(max_failures=5, retry_period=5, now=now) - self.assertEquals(True, feed.totally_failed) - - tasks = testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - tasks.extend(testutil.get_tasks(main.FEED_RETRIES_QUEUE, expected_count=5)) - found_etas = [t['eta'] for t in tasks[1:]] # First task is from insert() - self.assertEquals(etas, found_etas) - - def testQueuePreserved(self): - """Tests the request's polling queue is preserved for new FeedToFetch.""" - FeedToFetch.insert([self.topic]) - testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - - os.environ['HTTP_X_APPENGINE_QUEUENAME'] = main.POLLING_QUEUE - try: - (feed,) = FeedToFetch.insert([self.topic]) - testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - testutil.get_tasks(main.POLLING_QUEUE, expected_count=1) - finally: - del os.environ['HTTP_X_APPENGINE_QUEUENAME'] - - def testSources(self): - """Tests when sources are supplied.""" - source_dict = {'foo': 'bar', 'meepa': 'stuff'} - all_topics = [self.topic, self.topic2, self.topic3] - feed_list = FeedToFetch.insert(all_topics, source_dict=source_dict) - for feed_to_fetch in feed_list: - found_source_dict = dict(zip(feed_to_fetch.source_keys, - feed_to_fetch.source_values)) - self.assertEquals(source_dict, found_source_dict) - -################################################################################ - -FeedEntryRecord = main.FeedEntryRecord -EventToDeliver = main.EventToDeliver - - -class EventToDeliverTest(unittest.TestCase): - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - self.topic = 'http://example.com/my-topic' - # Order out of the datastore will be done by callback hash, not alphabetical - self.callback = 'http://example.com/my-callback' - self.callback2 = 'http://example.com/second-callback' - self.callback3 = 'http://example.com/third-callback-123' - self.callback4 = 'http://example.com/fourth-callback-1205' - self.header_footer = '\nblah\n' - self.token = 'verify token' - self.secret = 'some secret' - self.test_payloads = [ - 'article1', - 'article2', - 'article3', - ] - - def insert_subscriptions(self): - """Inserts Subscription instances and an EventToDeliver for testing. - - Returns: - Tuple (event, work_key, sub_list, sub_keys) where: - event: The EventToDeliver that was inserted. - work_key: Key for the 'event' - sub_list: List of Subscription instances that were created in order - of their callback hashes. - sub_keys: Key instances corresponding to the entries in 'sub_list'. - """ - event = EventToDeliver.create_event_for_topic( - self.topic, main.ATOM, 'application/atom+xml', - self.header_footer, self.test_payloads) - event.put() - work_key = event.key() - - Subscription.insert( - self.callback, self.topic, self.token, self.secret) - Subscription.insert( - self.callback2, self.topic, self.token, self.secret) - Subscription.insert( - self.callback3, self.topic, self.token, self.secret) - Subscription.insert( - self.callback4, self.topic, self.token, self.secret) - sub_list = Subscription.get_subscribers(self.topic, 10) - sub_keys = [s.key() for s in sub_list] - self.assertEquals(4, len(sub_list)) - - return (event, work_key, sub_list, sub_keys) - - def testCreateEventForTopic(self): - """Tests that the payload of an event is properly formed.""" - event = EventToDeliver.create_event_for_topic( - self.topic, main.ATOM, 'application/atom+xml', - self.header_footer, self.test_payloads) - expected_data = \ -u""" - -blah - -article1 -article2 -article3 -""" - self.assertEquals(expected_data, event.payload) - self.assertEquals('application/atom+xml', event.content_type) - - def testCreateEventForTopic_Rss(self): - """Tests that the RSS payload is properly formed.""" - self.test_payloads = [ - 'article1', - 'article2', - 'article3', - ] - self.header_footer = ( - '\n\nblah\n\n') - event = EventToDeliver.create_event_for_topic( - self.topic, main.RSS, 'application/rss+xml', - self.header_footer, self.test_payloads) - expected_data = \ -u""" - - -blah - -article1 -article2 -article3 - -""" - self.assertEquals(expected_data, event.payload) - self.assertEquals('application/rss+xml', event.content_type) - - def testCreateEventForTopic_Abitrary(self): - """Tests that an arbitrary payload is properly formed.""" - self.test_payloads = [] - self.header_footer = 'this is my data here' - event = EventToDeliver.create_event_for_topic( - self.topic, main.ARBITRARY, 'my crazy content type', - self.header_footer, self.test_payloads) - expected_data = 'this is my data here' - self.assertEquals(expected_data, event.payload) - self.assertEquals('my crazy content type', event.content_type) - - def testCreateEvent_badHeaderFooter(self): - """Tests when the header/footer data in an event is invalid.""" - self.assertRaises(AssertionError, EventToDeliver.create_event_for_topic, - self.topic, main.ATOM, 'content type unused', - 'has no end tag', self.test_payloads) - - def testNormal_noFailures(self): - """Tests that event delivery with no failures will delete the event.""" - event, work_key, sub_list, sub_keys = self.insert_subscriptions() - more, subs = event.get_next_subscribers() - event.update(more, []) - event = EventToDeliver.get(work_key) - self.assertTrue(event is None) - - def testUpdate_failWithNoSubscribersLeft(self): - """Tests that failures are written correctly by EventToDeliver.update. - - This tests the common case of completing the failed callbacks list extending - when there are new Subscriptions that have been found in the latest work - queue query. - """ - event, work_key, sub_list, sub_keys = self.insert_subscriptions() - - # Assert that the callback offset is updated and any failed callbacks - # are recorded. - more, subs = event.get_next_subscribers(chunk_size=1) - event.update(more, [sub_list[0]]) - event = EventToDeliver.get(event.key()) - self.assertEquals(EventToDeliver.NORMAL, event.delivery_mode) - self.assertEquals([sub_list[0].key()], event.failed_callbacks) - self.assertEquals(self.callback2, event.last_callback) - - more, subs = event.get_next_subscribers(chunk_size=3) - event.update(more, sub_list[1:]) - event = EventToDeliver.get(event.key()) - self.assertTrue(event is not None) - self.assertEquals(EventToDeliver.RETRY, event.delivery_mode) - self.assertEquals('', event.last_callback) - - self.assertEquals([s.key() for s in sub_list], event.failed_callbacks) - tasks = testutil.get_tasks(main.EVENT_QUEUE, expected_count=1) - tasks.extend(testutil.get_tasks(main.EVENT_RETRIES_QUEUE, expected_count=1)) - self.assertEquals([str(work_key)] * 2, - [t['params']['event_key'] for t in tasks]) - - def testUpdate_actuallyNoMoreCallbacks(self): - """Tests when the normal update delivery has no Subscriptions left. - - This tests the case where update is called with no Subscribers in the - list of Subscriptions. This can happen if a Subscription is deleted - between when an update happens and when the work queue is invoked again. - """ - event, work_key, sub_list, sub_keys = self.insert_subscriptions() - - more, subs = event.get_next_subscribers(chunk_size=3) - event.update(more, subs) - event = EventToDeliver.get(event.key()) - self.assertEquals(self.callback4, event.last_callback) - self.assertEquals(EventToDeliver.NORMAL, event.delivery_mode) - - # This final call to update will transition to retry properly. - Subscription.remove(self.callback4, self.topic) - more, subs = event.get_next_subscribers(chunk_size=1) - event.update(more, []) - event = EventToDeliver.get(event.key()) - self.assertEquals([], subs) - self.assertTrue(event is not None) - self.assertEquals(EventToDeliver.RETRY, event.delivery_mode) - - tasks = testutil.get_tasks(main.EVENT_QUEUE, expected_count=1) - tasks.extend(testutil.get_tasks(main.EVENT_RETRIES_QUEUE, expected_count=1)) - self.assertEquals([str(work_key)] * 2, - [t['params']['event_key'] for t in tasks]) - - def testGetNextSubscribers_retriesFinallySuccessful(self): - """Tests retries until all subscribers are successful.""" - event, work_key, sub_list, sub_keys = self.insert_subscriptions() - - # Simulate that callback 2 is successful and the rest fail. - more, subs = event.get_next_subscribers(chunk_size=2) - event.update(more, sub_list[:1]) - event = EventToDeliver.get(event.key()) - self.assertTrue(more) - self.assertEquals(self.callback3, event.last_callback) - self.assertEquals(EventToDeliver.NORMAL, event.delivery_mode) - - more, subs = event.get_next_subscribers(chunk_size=2) - event.update(more, sub_list[2:]) - event = EventToDeliver.get(event.key()) - self.assertEquals('', event.last_callback) - self.assertFalse(more) - self.assertEquals(EventToDeliver.RETRY, event.delivery_mode) - - # Now getting the next subscribers will returned the failed ones. - more, subs = event.get_next_subscribers(chunk_size=2) - expected = sub_keys[:1] + sub_keys[2:3] - self.assertEquals(expected, [s.key() for s in subs]) - event.update(more, subs) - event = EventToDeliver.get(event.key()) - self.assertTrue(more) - self.assertEquals(self.callback, event.last_callback) - self.assertEquals(EventToDeliver.RETRY, event.delivery_mode) - - # This will get the last of the failed subscribers but *not* include the - # sentinel value of event.last_callback, since that marks the end of this - # attempt. - more, subs = event.get_next_subscribers(chunk_size=2) - expected = sub_keys[3:] - self.assertEquals(expected, [s.key() for s in subs]) - event.update(more, subs) - event = EventToDeliver.get(event.key()) - self.assertFalse(more) - self.assertEquals('', event.last_callback) - self.assertEquals(EventToDeliver.RETRY, event.delivery_mode) - self.assertEquals(sub_keys[:1] + sub_keys[2:], event.failed_callbacks) - - # Now simulate all retries being successful one chunk at a time. - more, subs = event.get_next_subscribers(chunk_size=2) - expected = sub_keys[:1] + sub_keys[2:3] - self.assertEquals(expected, [s.key() for s in subs]) - event.update(more, []) - event = EventToDeliver.get(event.key()) - self.assertTrue(more) - self.assertEquals(self.callback, event.last_callback) - self.assertEquals(EventToDeliver.RETRY, event.delivery_mode) - self.assertEquals(sub_keys[3:], event.failed_callbacks) - - more, subs = event.get_next_subscribers(chunk_size=2) - expected = sub_keys[3:] - self.assertEquals(expected, [s.key() for s in subs]) - event.update(more, []) - self.assertFalse(more) - - tasks = testutil.get_tasks(main.EVENT_QUEUE, expected_count=1) - tasks.extend(testutil.get_tasks(main.EVENT_RETRIES_QUEUE, expected_count=4)) - self.assertEquals([str(work_key)] * 5, - [t['params']['event_key'] for t in tasks]) - - def testGetNextSubscribers_failedFewerThanChunkSize(self): - """Tests when there are fewer failed callbacks than the chunk size. - - Ensures that we step through retry attempts when there is only a single - chunk to go through on each retry iteration. - """ - event, work_key, sub_list, sub_keys = self.insert_subscriptions() - - # Simulate that callback 2 is successful and the rest fail. - more, subs = event.get_next_subscribers(chunk_size=2) - event.update(more, sub_list[:1]) - event = EventToDeliver.get(event.key()) - self.assertTrue(more) - self.assertEquals(self.callback3, event.last_callback) - self.assertEquals(EventToDeliver.NORMAL, event.delivery_mode) - - more, subs = event.get_next_subscribers(chunk_size=2) - event.update(more, sub_list[2:]) - event = EventToDeliver.get(event.key()) - self.assertEquals('', event.last_callback) - self.assertFalse(more) - self.assertEquals(EventToDeliver.RETRY, event.delivery_mode) - self.assertEquals(1, event.retry_attempts) - - # Now attempt a retry with a chunk size equal to the number of callbacks. - more, subs = event.get_next_subscribers(chunk_size=3) - event.update(more, subs) - event = EventToDeliver.get(event.key()) - self.assertFalse(more) - self.assertEquals(EventToDeliver.RETRY, event.delivery_mode) - self.assertEquals(2, event.retry_attempts) - - tasks = testutil.get_tasks(main.EVENT_QUEUE, expected_count=1) - tasks.extend(testutil.get_tasks(main.EVENT_RETRIES_QUEUE, expected_count=2)) - self.assertEquals([str(work_key)] * 3, - [t['params']['event_key'] for t in tasks]) - - def testGetNextSubscribers_giveUp(self): - """Tests retry delay amounts until we finally give up on event delivery. - - Verifies retry delay logic works properly. - """ - event, work_key, sub_list, sub_keys = self.insert_subscriptions() - - start = datetime.datetime.utcnow() - now = lambda: start - - etas = [] - for i, delay in enumerate((5, 10, 20, 40, 80, 160, 320, 640)): - more, subs = event.get_next_subscribers(chunk_size=4) - event.update(more, subs, retry_period=5, now=now, max_failures=8) - event = EventToDeliver.get(event.key()) - self.assertEquals(i+1, event.retry_attempts) - expected_eta = start + datetime.timedelta(seconds=delay) - self.assertEquals(expected_eta, event.last_modified) - etas.append(testutil.task_eta(event.last_modified)) - self.assertFalse(event.totally_failed) - - more, subs = event.get_next_subscribers(chunk_size=4) - event.update(more, subs) - event = EventToDeliver.get(event.key()) - self.assertTrue(event.totally_failed) - - tasks = testutil.get_tasks(main.EVENT_RETRIES_QUEUE, expected_count=8) - found_etas = [t['eta'] for t in tasks] - self.assertEquals(etas, found_etas) - - def testQueuePreserved(self): - """Tests that enqueueing an EventToDeliver preserves the polling queue.""" - event, work_key, sub_list, sub_keys = self.insert_subscriptions() - def txn(): - event.enqueue() - db.run_in_transaction(txn) - - testutil.get_tasks(main.EVENT_QUEUE, expected_count=1) - os.environ['HTTP_X_APPENGINE_QUEUENAME'] = main.POLLING_QUEUE - try: - db.run_in_transaction(txn) - finally: - del os.environ['HTTP_X_APPENGINE_QUEUENAME'] - - testutil.get_tasks(main.EVENT_QUEUE, expected_count=1) - testutil.get_tasks(main.POLLING_QUEUE, expected_count=1) - - def testMaxFailuresOverride(self): - """Tests the max_failures override value.""" - event = EventToDeliver.create_event_for_topic( - self.topic, main.ATOM, 'application/atom+xml', - self.header_footer, self.test_payloads) - self.assertEquals(None, event.max_failures) - - event = EventToDeliver.create_event_for_topic( - self.topic, main.ATOM, 'application/atom+xml', - self.header_footer, self.test_payloads, - max_failures=1) - self.assertEquals(1, event.max_failures) - - Subscription.insert( - self.callback, self.topic, self.token, self.secret) - subscription_list = list(Subscription.all()) - - event.put() - event.update(False, subscription_list) - event2 = db.get(event.key()) - self.assertFalse(event2.totally_failed) - - event2.update(False, []) - event3 = db.get(event.key()) - self.assertTrue(event3.totally_failed) - -################################################################################ - -class PublishHandlerTest(testutil.HandlerTestBase): - - handler_class = main.PublishHandler - - def setUp(self): - testutil.HandlerTestBase.setUp(self) - self.topic = 'http://example.com/first-url' - self.topic2 = 'http://example.com/second-url' - self.topic3 = 'http://example.com/third-url' - - def get_feeds_to_fetch(self): - """Gets the enqueued FeedToFetch records.""" - return FeedToFetch.FORK_JOIN_QUEUE.pop( - testutil.get_tasks(main.FEED_QUEUE, index=0, expected_count=1)['name']) - - def testDebugFormRenders(self): - self.handle('get') - self.assertTrue('' in self.response_body()) - - def testBadMode(self): - self.handle('post', - ('hub.mode', 'invalid'), - ('hub.url', 'http://example.com')) - self.assertEquals(400, self.response_code()) - self.assertTrue('hub.mode' in self.response_body()) - - def testNoUrls(self): - self.handle('post', ('hub.mode', 'publish')) - self.assertEquals(400, self.response_code()) - self.assertTrue('hub.url' in self.response_body()) - - def testBadUrls(self): - self.handle('post', - ('hub.mode', 'PuBLisH'), - ('hub.url', 'http://example.com/bad_url#fragment')) - self.assertEquals(400, self.response_code()) - self.assertTrue('hub.url invalid' in self.response_body()) - - def testInsertion(self): - db.put([KnownFeed.create(self.topic), - KnownFeed.create(self.topic2), - KnownFeed.create(self.topic3)]) - self.handle('post', - ('hub.mode', 'PuBLisH'), - ('hub.url', self.topic), - ('hub.url', self.topic2), - ('hub.url', self.topic3)) - self.assertEquals(204, self.response_code()) - expected_topics = set([self.topic, self.topic2, self.topic3]) - feed_list = self.get_feeds_to_fetch() - inserted_topics = set(f.topic for f in feed_list) - self.assertEquals(expected_topics, inserted_topics) - - def testIgnoreUnknownFeed(self): - self.handle('post', - ('hub.mode', 'PuBLisH'), - ('hub.url', self.topic), - ('hub.url', self.topic2), - ('hub.url', self.topic3)) - self.assertEquals(204, self.response_code()) - testutil.get_tasks(main.FEED_QUEUE, expected_count=0) - - def testDuplicateUrls(self): - db.put([KnownFeed.create(self.topic), - KnownFeed.create(self.topic2)]) - self.handle('post', - ('hub.mode', 'PuBLisH'), - ('hub.url', self.topic), - ('hub.url', self.topic), - ('hub.url', self.topic), - ('hub.url', self.topic), - ('hub.url', self.topic), - ('hub.url', self.topic), - ('hub.url', self.topic), - ('hub.url', self.topic2), - ('hub.url', self.topic2), - ('hub.url', self.topic2), - ('hub.url', self.topic2), - ('hub.url', self.topic2), - ('hub.url', self.topic2), - ('hub.url', self.topic2)) - self.assertEquals(204, self.response_code()) - expected_topics = set([self.topic, self.topic2]) - inserted_topics = set(f.topic for f in self.get_feeds_to_fetch()) - self.assertEquals(expected_topics, inserted_topics) - - def testInsertFailure(self): - """Tests when a publish event fails insertion.""" - old_insert = FeedToFetch.insert - try: - for exception in (db.Error(), apiproxy_errors.Error(), - runtime.DeadlineExceededError()): - @classmethod - def new_insert(cls, *args): - raise exception - FeedToFetch.insert = new_insert - self.handle('post', - ('hub.mode', 'PuBLisH'), - ('hub.url', 'http://example.com/first-url'), - ('hub.url', 'http://example.com/second-url'), - ('hub.url', 'http://example.com/third-url')) - self.assertEquals(503, self.response_code()) - finally: - FeedToFetch.insert = old_insert - - def testCaseSensitive(self): - """Tests that cases for topics URLs are preserved.""" - self.topic += FUNNY - self.topic2 += FUNNY - self.topic3 += FUNNY - db.put([KnownFeed.create(self.topic), - KnownFeed.create(self.topic2), - KnownFeed.create(self.topic3)]) - self.handle('post', - ('hub.mode', 'PuBLisH'), - ('hub.url', self.topic), - ('hub.url', self.topic2), - ('hub.url', self.topic3)) - self.assertEquals(204, self.response_code()) - expected_topics = set([self.topic, self.topic2, self.topic3]) - inserted_topics = set(f.topic for f in self.get_feeds_to_fetch()) - self.assertEquals(expected_topics, inserted_topics) - - def testNormalization(self): - """Tests that URLs are properly normalized.""" - self.topic += OTHER_STRING - self.topic2 += OTHER_STRING - self.topic3 += OTHER_STRING - normalized = [ - main.normalize_iri(t) - for t in [self.topic, self.topic2, self.topic3]] - db.put([KnownFeed.create(t) for t in normalized]) - self.handle('post', - ('hub.mode', 'PuBLisH'), - ('hub.url', self.topic), - ('hub.url', self.topic2), - ('hub.url', self.topic3)) - self.assertEquals(204, self.response_code()) - inserted_topics = set(f.topic for f in self.get_feeds_to_fetch()) - self.assertEquals(set(normalized), inserted_topics) - - def testIri(self): - """Tests publishing with an IRI with international characters.""" - topic = main.normalize_iri(self.topic + FUNNY_UNICODE) - topic2 = main.normalize_iri(self.topic2 + FUNNY_UNICODE) - topic3 = main.normalize_iri(self.topic3 + FUNNY_UNICODE) - normalized = [topic, topic2, topic3] - db.put([KnownFeed.create(t) for t in normalized]) - self.handle('post', - ('hub.mode', 'PuBLisH'), - ('hub.url', self.topic + FUNNY_UTF8), - ('hub.url', self.topic2 + FUNNY_UTF8), - ('hub.url', self.topic3 + FUNNY_UTF8)) - self.assertEquals(204, self.response_code()) - inserted_topics = set(f.topic for f in self.get_feeds_to_fetch()) - self.assertEquals(set(normalized), inserted_topics) - - def testUnicode(self): - """Tests publishing with a URL that has unicode characters.""" - topic = main.normalize_iri(self.topic + FUNNY_UNICODE) - topic2 = main.normalize_iri(self.topic2 + FUNNY_UNICODE) - topic3 = main.normalize_iri(self.topic3 + FUNNY_UNICODE) - normalized = [topic, topic2, topic3] - db.put([KnownFeed.create(t) for t in normalized]) - - payload = ( - 'hub.mode=publish' - '&hub.url=' + urllib.quote(self.topic) + FUNNY_UTF8 + - '&hub.url=' + urllib.quote(self.topic2) + FUNNY_UTF8 + - '&hub.url=' + urllib.quote(self.topic3) + FUNNY_UTF8) - self.handle_body('post', payload) - self.assertEquals(204, self.response_code()) - inserted_topics = set(f.topic for f in self.get_feeds_to_fetch()) - self.assertEquals(set(normalized), inserted_topics) - - def testSources(self): - """Tests that derived sources are properly set on FeedToFetch instances.""" - db.put([KnownFeed.create(self.topic), - KnownFeed.create(self.topic2), - KnownFeed.create(self.topic3)]) - source_dict = {'one': 'two', 'three': 'four'} - topics = [self.topic, self.topic2, self.topic3] - def derive_sources(handler, urls): - self.assertEquals(set(topics), set(urls)) - self.assertEquals('testvalue', handler.request.get('the-real-thing')) - return source_dict - - main.hooks.override_for_test(main.derive_sources, derive_sources) - try: - self.handle('post', - ('hub.mode', 'PuBLisH'), - ('hub.url', self.topic), - ('hub.url', self.topic2), - ('hub.url', self.topic3), - ('the-real-thing', 'testvalue')) - self.assertEquals(204, self.response_code()) - for feed_to_fetch in self.get_feeds_to_fetch(): - found_source_dict = dict(zip(feed_to_fetch.source_keys, - feed_to_fetch.source_values)) - self.assertEquals(source_dict, found_source_dict) - finally: - main.hooks.reset_for_test(main.derive_sources) - - -class PublishHandlerThroughHubUrlTest(PublishHandlerTest): - - handler_class = main.HubHandler - -################################################################################ - -class FindFeedUpdatesTest(unittest.TestCase): - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - self.topic = 'http://example.com/my-topic-here' - self.header_footer = 'this is my test header footer' - self.entries_map = { - 'id1': 'content1', - 'id2': 'content2', - 'id3': 'content3', - } - self.content = 'the expected response data' - def my_filter(content, ignored_format): - self.assertEquals(self.content, content) - return self.header_footer, self.entries_map - self.my_filter = my_filter - - def run_test(self): - """Runs a test.""" - header_footer, entry_list, entry_payloads = main.find_feed_updates( - self.topic, main.ATOM, self.content, filter_feed=self.my_filter) - self.assertEquals(self.header_footer, header_footer) - return entry_list, entry_payloads - - @staticmethod - def get_entry(entry_id, entry_list): - """Finds the entry with the given ID in the list of entries.""" - return [e for e in entry_list if e.id_hash == sha1_hash(entry_id)][0] - - def testAllNewContent(self): - """Tests when al pulled feed content is new.""" - entry_list, entry_payloads = self.run_test() - entry_id_hash_set = set(f.id_hash for f in entry_list) - self.assertEquals(set(sha1_hash(k) for k in self.entries_map.keys()), - entry_id_hash_set) - self.assertEquals(self.entries_map.values(), entry_payloads) - - def testSomeExistingEntries(self): - """Tests when some entries are already known.""" - FeedEntryRecord.create_entry_for_topic( - self.topic, 'id1', sha1_hash('content1')).put() - FeedEntryRecord.create_entry_for_topic( - self.topic, 'id2', sha1_hash('content2')).put() - - entry_list, entry_payloads = self.run_test() - entry_id_hash_set = set(f.id_hash for f in entry_list) - self.assertEquals(set(sha1_hash(k) for k in ['id3']), entry_id_hash_set) - self.assertEquals(['content3'], entry_payloads) - - def testPulledEntryNewer(self): - """Tests when an entry is already known but has been updated recently.""" - FeedEntryRecord.create_entry_for_topic( - self.topic, 'id1', sha1_hash('content1')).put() - FeedEntryRecord.create_entry_for_topic( - self.topic, 'id2', sha1_hash('content2')).put() - self.entries_map['id1'] = 'newcontent1' - - entry_list, entry_payloads = self.run_test() - entry_id_hash_set = set(f.id_hash for f in entry_list) - self.assertEquals(set(sha1_hash(k) for k in ['id1', 'id3']), - entry_id_hash_set) - - # Verify the old entry would be overwritten. - entry1 = self.get_entry('id1', entry_list) - self.assertEquals(sha1_hash('newcontent1'), entry1.entry_content_hash) - self.assertEquals(['content3', 'newcontent1'], entry_payloads) - - def testUnicodeContent(self): - """Tests when the content contains unicode characters.""" - self.entries_map['id2'] = u'\u2019 asdf' - entry_list, entry_payloads = self.run_test() - entry_id_hash_set = set(f.id_hash for f in entry_list) - self.assertEquals(set(sha1_hash(k) for k in self.entries_map.keys()), - entry_id_hash_set) - - def testMultipleParallelBatches(self): - """Tests that retrieving FeedEntryRecords is done in multiple batches.""" - old_get_feed_record = main.FeedEntryRecord.get_entries_for_topic - calls = [0] - @staticmethod - def fake_get_record(*args, **kwargs): - calls[0] += 1 - return old_get_feed_record(*args, **kwargs) - - old_lookups = main.MAX_FEED_ENTRY_RECORD_LOOKUPS - main.FeedEntryRecord.get_entries_for_topic = fake_get_record - main.MAX_FEED_ENTRY_RECORD_LOOKUPS = 1 - try: - entry_list, entry_payloads = self.run_test() - entry_id_hash_set = set(f.id_hash for f in entry_list) - self.assertEquals(set(sha1_hash(k) for k in self.entries_map.keys()), - entry_id_hash_set) - self.assertEquals(self.entries_map.values(), entry_payloads) - self.assertEquals(3, calls[0]) - finally: - main.MAX_FEED_ENTRY_RECORD_LOOKUPS = old_lookups - main.FeedEntryRecord.get_entries_for_topic = old_get_feed_record - -################################################################################ - -FeedRecord = main.FeedRecord -KnownFeedStats = main.KnownFeedStats - -class PullFeedHandlerTest(testutil.HandlerTestBase): - - handler_class = main.PullFeedHandler - - def setUp(self): - """Sets up the test harness.""" - testutil.HandlerTestBase.setUp(self) - - self.topic = 'http://example.com/my-topic-here' - self.header_footer = 'this is my test header footer' - self.all_ids = ['1', '2', '3'] - self.entry_payloads = [ - 'content%s' % entry_id for entry_id in self.all_ids - ] - self.entry_list = [ - FeedEntryRecord.create_entry_for_topic( - self.topic, entry_id, 'content%s' % entry_id) - for entry_id in self.all_ids - ] - self.expected_response = 'the expected response data' - self.etag = 'something unique' - self.last_modified = 'some time' - self.headers = { - 'ETag': self.etag, - 'Last-Modified': self.last_modified, - 'Content-Type': 'application/atom+xml', - } - self.expected_exceptions = [] - - def my_find_updates(ignored_topic, ignored_format, content): - self.assertEquals(self.expected_response, content) - if self.expected_exceptions: - raise self.expected_exceptions.pop(0) - return self.header_footer, self.entry_list, self.entry_payloads - - self.old_find_feed_updates = main.find_feed_updates - main.find_feed_updates = my_find_updates - - self.callback = 'http://example.com/my-subscriber' - self.assertTrue(Subscription.insert( - self.callback, self.topic, 'token', 'secret')) - - def tearDown(self): - """Tears down the test harness.""" - main.find_feed_updates = self.old_find_feed_updates - urlfetch_test_stub.instance.verify_and_reset() - - def run_fetch_task(self, index=0): - """Runs the currently enqueued fetch task.""" - task = testutil.get_tasks(main.FEED_QUEUE, index=index) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = task['name'] - try: - self.handle('post') - finally: - del os.environ['HTTP_X_APPENGINE_TASKNAME'] - - def testNoWork(self): - self.handle('post', ('topic', self.topic)) - - def testNewEntries_Atom(self): - """Tests when new entries are found.""" - FeedToFetch.insert([self.topic]) - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, - response_headers=self.headers) - self.run_fetch_task() - - # Verify that all feed entry records have been written along with the - # EventToDeliver and FeedRecord. - feed_entries = FeedEntryRecord.get_entries_for_topic( - self.topic, self.all_ids) - self.assertEquals( - [sha1_hash(k) for k in self.all_ids], - [e.id_hash for e in feed_entries]) - - work = EventToDeliver.all().get() - event_key = work.key() - self.assertEquals(self.topic, work.topic) - self.assertTrue('content1\ncontent2\ncontent3' in work.payload) - work.delete() - - record = FeedRecord.get_or_create(self.topic) - self.assertEquals(self.header_footer, record.header_footer) - self.assertEquals(self.etag, record.etag) - self.assertEquals(self.last_modified, record.last_modified) - self.assertEquals('application/atom+xml', record.content_type) - - task = testutil.get_tasks(main.EVENT_QUEUE, index=0, expected_count=1) - self.assertEquals(str(event_key), task['params']['event_key']) - - self.assertEquals([(1, 0)], main.FETCH_SCORER.get_scores([self.topic])) - - def testRssFailBack(self): - """Tests when parsing as Atom fails and it uses RSS instead.""" - self.expected_exceptions.append(feed_diff.Error('whoops')) - self.header_footer = 'this is my test' - self.headers['Content-Type'] = 'application/xml' - - FeedToFetch.insert([self.topic]) - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, - response_headers=self.headers) - self.run_fetch_task() - - feed_entries = FeedEntryRecord.get_entries_for_topic( - self.topic, self.all_ids) - self.assertEquals( - [sha1_hash(k) for k in self.all_ids], - [e.id_hash for e in feed_entries]) - - work = EventToDeliver.all().get() - event_key = work.key() - self.assertEquals(self.topic, work.topic) - self.assertTrue('content1\ncontent2\ncontent3' in work.payload) - work.delete() - - record = FeedRecord.get_or_create(self.topic) - self.assertEquals('application/xml', record.content_type) - - task = testutil.get_tasks(main.EVENT_QUEUE, index=0, expected_count=1) - self.assertEquals(str(event_key), task['params']['event_key']) - - self.assertEquals([(1, 0)], main.FETCH_SCORER.get_scores([self.topic])) - - def testAtomFailBack(self): - """Tests when parsing as RSS fails and it uses Atom instead.""" - self.expected_exceptions.append(feed_diff.Error('whoops')) - self.headers.clear() - self.headers['Content-Type'] = 'application/rss+xml' - info = FeedRecord.get_or_create(self.topic) - info.update(self.headers) - info.put() - - FeedToFetch.insert([self.topic]) - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, - response_headers=self.headers) - self.run_fetch_task() - - feed_entries = FeedEntryRecord.get_entries_for_topic( - self.topic, self.all_ids) - self.assertEquals( - [sha1_hash(k) for k in self.all_ids], - [e.id_hash for e in feed_entries]) - - work = EventToDeliver.all().get() - event_key = work.key() - self.assertEquals(self.topic, work.topic) - self.assertTrue('content1\ncontent2\ncontent3' in work.payload) - work.delete() - - record = FeedRecord.get_or_create(self.topic) - self.assertEquals('application/rss+xml', record.content_type) - - task = testutil.get_tasks(main.EVENT_QUEUE, index=0, expected_count=1) - self.assertEquals(str(event_key), task['params']['event_key']) - - self.assertEquals([(1, 0)], main.FETCH_SCORER.get_scores([self.topic])) - - def testArbitraryContent(self): - """Tests when the feed cannot be parsed as Atom or RSS.""" - self.entry_list = [] - self.entry_payloads = [] - self.header_footer = 'this is all of the content' - self.expected_exceptions.append(feed_diff.Error('whoops')) - self.expected_exceptions.append(feed_diff.Error('whoops')) - FeedToFetch.insert([self.topic]) - self.headers['content-type'] = 'My Crazy Content Type' - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, - response_headers=self.headers) - self.run_fetch_task() - - feed = FeedToFetch.get_by_key_name(get_hash_key_name(self.topic)) - self.assertTrue(feed is None) - self.assertEquals(0, len(list(FeedEntryRecord.all()))) - - work = EventToDeliver.all().get() - event_key = work.key() - self.assertEquals(self.topic, work.topic) - self.assertEquals('this is all of the content', work.payload) - work.delete() - - record = FeedRecord.get_or_create(self.topic) - # header_footer not saved for arbitrary data - self.assertEquals(None, record.header_footer) - self.assertEquals(self.etag, record.etag) - self.assertEquals(self.last_modified, record.last_modified) - self.assertEquals('my crazy content type', record.content_type) - - task = testutil.get_tasks(main.EVENT_QUEUE, index=0, expected_count=1) - self.assertEquals(str(event_key), task['params']['event_key']) - - self.assertEquals([(1, 0)], main.FETCH_SCORER.get_scores([self.topic])) - - testutil.get_tasks(main.FEED_RETRIES_QUEUE, expected_count=0) - - self.assertEquals([(1, 0)], main.FETCH_SCORER.get_scores([self.topic])) - - def testCacheHit(self): - """Tests when the fetched feed matches the last cached version of it.""" - info = FeedRecord.get_or_create(self.topic) - info.update(self.headers) - info.put() - - request_headers = { - 'If-None-Match': self.etag, - 'If-Modified-Since': self.last_modified, - } - - FeedToFetch.insert([self.topic]) - urlfetch_test_stub.instance.expect( - 'get', self.topic, 304, '', - request_headers=request_headers, - response_headers=self.headers) - self.run_fetch_task() - self.assertTrue(EventToDeliver.all().get() is None) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - - self.assertEquals([(1, 0)], main.FETCH_SCORER.get_scores([self.topic])) - - def testStatsUserAgent(self): - """Tests that the user agent string includes feed stats.""" - info = FeedRecord.get_or_create(self.topic) - info.update(self.headers) - info.put() - - KnownFeedStats( - key=KnownFeedStats.create_key(self.topic), - subscriber_count=123).put() - - request_headers = { - 'User-Agent': - 'Public Hub (+http://pubsubhubbub.appspot.com; 123 subscribers)', - } - - FeedToFetch.insert([self.topic]) - self.entry_list = [] - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, - request_headers=request_headers, - response_headers=self.headers) - self.run_fetch_task() - self.assertTrue(EventToDeliver.all().get() is None) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - - record = FeedRecord.get_or_create(self.topic) - self.assertEquals(self.header_footer, record.header_footer) - self.assertEquals(self.etag, record.etag) - self.assertEquals(self.last_modified, record.last_modified) - self.assertEquals('application/atom+xml', record.content_type) - - self.assertEquals([(1, 0)], main.FETCH_SCORER.get_scores([self.topic])) - - def testNoNewEntries(self): - """Tests when there are no new entries.""" - FeedToFetch.insert([self.topic]) - self.entry_list = [] - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, - response_headers=self.headers) - self.run_fetch_task() - self.assertTrue(EventToDeliver.all().get() is None) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - - record = FeedRecord.get_or_create(self.topic) - self.assertEquals(self.header_footer, record.header_footer) - self.assertEquals(self.etag, record.etag) - self.assertEquals(self.last_modified, record.last_modified) - self.assertEquals('application/atom+xml', record.content_type) - - self.assertEquals([(1, 0)], main.FETCH_SCORER.get_scores([self.topic])) - - def testPullError(self): - """Tests when URLFetch raises an exception.""" - FeedToFetch.insert([self.topic]) - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, urlfetch_error=True) - self.run_fetch_task() - feed = FeedToFetch.get_by_key_name(get_hash_key_name(self.topic)) - self.assertEquals(1, feed.fetching_failures) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - task = testutil.get_tasks(main.FEED_RETRIES_QUEUE, - index=0, expected_count=1) - self.assertEquals(self.topic, task['params']['topic']) - self.assertEquals([(0, 1)], main.FETCH_SCORER.get_scores([self.topic])) - - def testPullRetry(self): - """Tests that the task enqueued after a failure will run properly.""" - FeedToFetch.insert([self.topic]) - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, urlfetch_error=True) - self.run_fetch_task() - - # Verify the failed feed was written to the Datastore. - feed = FeedToFetch.get_by_key_name(get_hash_key_name(self.topic)) - self.assertEquals(1, feed.fetching_failures) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - testutil.get_tasks(main.FEED_RETRIES_QUEUE, expected_count=1) - task = testutil.get_tasks(main.FEED_RETRIES_QUEUE, - index=0, expected_count=1) - self.assertEquals(self.topic, task['params']['topic']) - self.assertEquals([(0, 1)], main.FETCH_SCORER.get_scores([self.topic])) - - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, urlfetch_error=True) - self.handle('post', *task['params'].items()) - feed = FeedToFetch.get_by_key_name(get_hash_key_name(self.topic)) - self.assertEquals(2, feed.fetching_failures) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - testutil.get_tasks(main.FEED_RETRIES_QUEUE, expected_count=2) - - def testPullBadStatusCode(self): - """Tests when the response status is bad.""" - FeedToFetch.insert([self.topic]) - urlfetch_test_stub.instance.expect( - 'get', self.topic, 500, self.expected_response) - self.run_fetch_task() - feed = FeedToFetch.get_by_key_name(get_hash_key_name(self.topic)) - self.assertEquals(1, feed.fetching_failures) - - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - task = testutil.get_tasks(main.FEED_RETRIES_QUEUE, - index=0, expected_count=1) - self.assertEquals(self.topic, task['params']['topic']) - self.assertEquals([(0, 1)], main.FETCH_SCORER.get_scores([self.topic])) - - def testApiProxyError(self): - """Tests when the APIProxy raises an error.""" - FeedToFetch.insert([self.topic]) - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, apiproxy_error=True) - self.run_fetch_task() - feed = FeedToFetch.get_by_key_name(get_hash_key_name(self.topic)) - self.assertEquals(1, feed.fetching_failures) - - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - task = testutil.get_tasks(main.FEED_RETRIES_QUEUE, - index=0, expected_count=1) - self.assertEquals(self.topic, task['params']['topic']) - self.assertEquals([(0, 1)], main.FETCH_SCORER.get_scores([self.topic])) - - def testNoSubscribers(self): - """Tests that when a feed has no subscribers we do not pull it.""" - self.assertTrue(Subscription.remove(self.callback, self.topic)) - db.put(KnownFeed.create(self.topic)) - self.assertTrue(db.get(KnownFeed.create_key(self.topic)) is not None) - self.entry_list = [] - FeedToFetch.insert([self.topic]) - self.run_fetch_task() - - # Verify that *no* feed entry records have been written. - self.assertEquals([], FeedEntryRecord.get_entries_for_topic( - self.topic, self.all_ids)) - - # And there is no EventToDeliver or tasks. - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - tasks = testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - - # And no scoring. - self.assertEquals([(0, 0)], main.FETCH_SCORER.get_scores([self.topic])) - - def testRedirects(self): - """Tests when redirects are encountered.""" - info = FeedRecord.get_or_create(self.topic) - info.update(self.headers) - info.put() - FeedToFetch.insert([self.topic]) - - real_topic = 'http://example.com/real-topic-location' - self.headers['Location'] = real_topic - urlfetch_test_stub.instance.expect( - 'get', self.topic, 302, '', - response_headers=self.headers.copy()) - - del self.headers['Location'] - urlfetch_test_stub.instance.expect( - 'get', real_topic, 200, self.expected_response, - response_headers=self.headers) - - self.run_fetch_task() - self.assertTrue(EventToDeliver.all().get() is not None) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=1) - - self.assertEquals([(1, 0)], main.FETCH_SCORER.get_scores([self.topic])) - - def testTooManyRedirects(self): - """Tests when too many redirects are encountered.""" - info = FeedRecord.get_or_create(self.topic) - info.update(self.headers) - info.put() - FeedToFetch.insert([self.topic]) - - last_topic = self.topic - real_topic = 'http://example.com/real-topic-location' - for i in xrange(main.MAX_REDIRECTS): - next_topic = real_topic + str(i) - self.headers['Location'] = next_topic - urlfetch_test_stub.instance.expect( - 'get', last_topic, 302, '', - response_headers=self.headers.copy()) - last_topic = next_topic - - self.run_fetch_task() - self.assertTrue(EventToDeliver.all().get() is None) - - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - task = testutil.get_tasks(main.FEED_RETRIES_QUEUE, - index=0, expected_count=1) - self.assertEquals(self.topic, task['params']['topic']) - - self.assertEquals([(0, 1)], main.FETCH_SCORER.get_scores([self.topic])) - - def testRedirectToBadUrl(self): - """Tests when the redirect URL is bad.""" - info = FeedRecord.get_or_create(self.topic) - info.update(self.headers) - info.put() - FeedToFetch.insert([self.topic]) - - real_topic = '/not/a/valid-redirect-location' - self.headers['Location'] = real_topic - urlfetch_test_stub.instance.expect( - 'get', self.topic, 302, '', - response_headers=self.headers.copy()) - - self.run_fetch_task() - self.assertTrue(EventToDeliver.all().get() is None) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - - self.assertEquals([(0, 1)], main.FETCH_SCORER.get_scores([self.topic])) - - def testPutSplitting(self): - """Tests that put() calls for feed records are split when too large.""" - # Make the content way too big. - content_template = ('content' * 100 + '%s') - self.all_ids = [str(i) for i in xrange(1000)] - self.entry_payloads = [ - (content_template % entry_id) for entry_id in self.all_ids - ] - self.entry_list = [ - FeedEntryRecord.create_entry_for_topic( - self.topic, entry_id, 'content%s' % entry_id) - for entry_id in self.all_ids - ] - - FeedToFetch.insert([self.topic]) - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, - response_headers=self.headers) - - old_max_new = main.MAX_NEW_FEED_ENTRY_RECORDS - main.MAX_NEW_FEED_ENTRY_RECORDS = len(self.all_ids) + 1 - try: - self.run_fetch_task() - finally: - main.MAX_NEW_FEED_ENTRY_RECORDS = old_max_new - - # Verify that all feed entry records have been written along with the - # EventToDeliver and FeedRecord. - feed_entries = list(FeedEntryRecord.all()) - self.assertEquals( - set(sha1_hash(k) for k in self.all_ids), - set(e.id_hash for e in feed_entries)) - - work = EventToDeliver.all().get() - event_key = work.key() - self.assertEquals(self.topic, work.topic) - self.assertTrue('\n'.join(self.entry_payloads) in work.payload) - work.delete() - - record = FeedRecord.get_or_create(self.topic) - self.assertEquals(self.header_footer, record.header_footer) - self.assertEquals(self.etag, record.etag) - self.assertEquals(self.last_modified, record.last_modified) - self.assertEquals('application/atom+xml', record.content_type) - - task = testutil.get_tasks(main.EVENT_QUEUE, index=0, expected_count=1) - self.assertEquals(str(event_key), task['params']['event_key']) - testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - testutil.get_tasks(main.FEED_RETRIES_QUEUE, expected_count=0) - self.assertEquals([(1, 0)], main.FETCH_SCORER.get_scores([self.topic])) - - def testPutSplittingFails(self): - """Tests when splitting put() calls still doesn't help and we give up.""" - # Make the content way too big. - content_template = ('content' * 150 + '%s') - self.all_ids = [str(i) for i in xrange(1000)] - self.entry_payloads = [ - (content_template % entry_id) for entry_id in self.all_ids - ] - self.entry_list = [ - FeedEntryRecord.create_entry_for_topic( - self.topic, entry_id, 'content%s' % entry_id) - for entry_id in self.all_ids - ] - - FeedToFetch.insert([self.topic]) - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, - response_headers=self.headers) - - old_splitting_attempts = main.PUT_SPLITTING_ATTEMPTS - old_max_saves = main.MAX_FEED_RECORD_SAVES - old_max_new = main.MAX_NEW_FEED_ENTRY_RECORDS - main.PUT_SPLITTING_ATTEMPTS = 1 - main.MAX_FEED_RECORD_SAVES = len(self.entry_list) + 1 - main.MAX_NEW_FEED_ENTRY_RECORDS = main.MAX_FEED_RECORD_SAVES - try: - self.run_fetch_task() - finally: - main.PUT_SPLITTING_ATTEMPTS = old_splitting_attempts - main.MAX_FEED_RECORD_SAVES = old_max_saves - main.MAX_NEW_FEED_ENTRY_RECORDS = old_max_new - - # Verify that *NO* FeedEntryRecords or EventToDeliver has been written, - # the FeedRecord wasn't updated, and no tasks were enqueued. - self.assertEquals([], list(FeedEntryRecord.all())) - self.assertEquals(None, EventToDeliver.all().get()) - - record = FeedRecord.all().get() - self.assertEquals(None, record) - - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - - # Put splitting failure does not count against the feed. - self.assertEquals([(1, 0)], main.FETCH_SCORER.get_scores([self.topic])) - - def testFeedTooLarge(self): - """Tests when the pulled feed's content size is too large.""" - FeedToFetch.insert([self.topic]) - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, '', - response_headers=self.headers, - urlfetch_size_error=True) - self.run_fetch_task() - self.assertEquals([], list(FeedEntryRecord.all())) - self.assertEquals(None, EventToDeliver.all().get()) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - - self.assertEquals([(0, 1)], main.FETCH_SCORER.get_scores([self.topic])) - - def testTooManyNewEntries(self): - """Tests when there are more new entries than we can handle at once.""" - self.all_ids = [str(i) for i in xrange(1000)] - self.entry_payloads = [ - 'content%s' % entry_id for entry_id in self.all_ids - ] - self.entry_list = [ - FeedEntryRecord.create_entry_for_topic( - self.topic, entry_id, 'content%s' % entry_id) - for entry_id in self.all_ids - ] - - FeedToFetch.insert([self.topic]) - urlfetch_test_stub.instance.expect( - 'get', self.topic, 200, self.expected_response, - response_headers=self.headers) - - self.run_fetch_task() - - # Verify that a subset of the entry records are present and the payload - # only has the first N entries. - feed_entries = FeedEntryRecord.get_entries_for_topic( - self.topic, self.all_ids) - expected_records = main.MAX_NEW_FEED_ENTRY_RECORDS - self.assertEquals( - [sha1_hash(k) for k in self.all_ids[:expected_records]], - [e.id_hash for e in feed_entries]) - - work = EventToDeliver.all().get() - event_key = work.key() - self.assertEquals(self.topic, work.topic) - expected_content = '\n'.join(self.entry_payloads[:expected_records]) - self.assertTrue(expected_content in work.payload) - self.assertFalse('content%d' % expected_records in work.payload) - work.delete() - - record = FeedRecord.all().get() - self.assertNotEquals(self.etag, record.etag) - - task = testutil.get_tasks(main.EVENT_QUEUE, index=0, expected_count=1) - self.assertEquals(str(event_key), task['params']['event_key']) - testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - task = testutil.get_tasks(main.FEED_RETRIES_QUEUE, - index=0, expected_count=1) - self.assertEquals(self.topic, task['params']['topic']) - self.assertEquals([(0, 1)], main.FETCH_SCORER.get_scores([self.topic])) - - def testNotAllowed(self): - """Tests when the URL fetch is blocked due to URL scoring.""" - dos.DISABLE_FOR_TESTING = False - try: - main.FETCH_SCORER.blackhole([self.topic]) - start_scores = main.FETCH_SCORER.get_scores([self.topic]) - - info = FeedRecord.get_or_create(self.topic) - info.update(self.headers) - info.put() - FeedToFetch.insert([self.topic]) - self.run_fetch_task() - - # Verify that *no* feed entry records have been written. - self.assertEquals([], FeedEntryRecord.get_entries_for_topic( - self.topic, self.all_ids)) - - # And there is no EventToDeliver or tasks. - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - tasks = testutil.get_tasks(main.FEED_QUEUE, expected_count=1) - - self.assertEquals( - start_scores, - main.FETCH_SCORER.get_scores([self.topic])) - finally: - dos.DISABLE_FOR_TESTING = True - - -class PullFeedHandlerTestWithParsing(testutil.HandlerTestBase): - - handler_class = main.PullFeedHandler - - def run_fetch_task(self, index=0): - """Runs the currently enqueued fetch task.""" - task = testutil.get_tasks(main.FEED_QUEUE, index=index) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = task['name'] - try: - self.handle('post') - finally: - del os.environ['HTTP_X_APPENGINE_TASKNAME'] - - def testPullBadContent(self): - """Tests when the content doesn't parse correctly.""" - topic = 'http://example.com/my-topic' - callback = 'http://example.com/my-subscriber' - self.assertTrue(Subscription.insert(callback, topic, 'token', 'secret')) - FeedToFetch.insert([topic]) - urlfetch_test_stub.instance.expect( - 'get', topic, 200, 'this does not parse') - self.run_fetch_task() - # No retry task should be written. - feed = FeedToFetch.get_by_key_name(get_hash_key_name(topic)) - self.assertTrue(feed is None) - - def testPullBadFeed(self): - """Tests when the content parses, but is not a good Atom document.""" - data = ('\n' - 'wooh') - topic = 'http://example.com/my-topic' - callback = 'http://example.com/my-subscriber' - self.assertTrue(Subscription.insert(callback, topic, 'token', 'secret')) - FeedToFetch.insert([topic]) - urlfetch_test_stub.instance.expect('get', topic, 200, data) - self.run_fetch_task() - # No retry task should be written. - feed = FeedToFetch.get_by_key_name(get_hash_key_name(topic)) - self.assertTrue(feed is None) - - def testPullBadEncoding(self): - """Tests when the content has a bad character encoding.""" - data = ('\n' - '' - '1123wooh') - topic = 'http://example.com/my-topic' - callback = 'http://example.com/my-subscriber' - self.assertTrue(Subscription.insert(callback, topic, 'token', 'secret')) - FeedToFetch.insert([topic]) - urlfetch_test_stub.instance.expect('get', topic, 200, data) - self.run_fetch_task() - # No retry task should be written. - feed = FeedToFetch.get_by_key_name(get_hash_key_name(topic)) - self.assertTrue(feed is None) - - def testPullGoodAtom(self): - """Tests when the Atom XML can parse just fine.""" - data = ('\n' - '1123wooh') - topic = 'http://example.com/my-topic' - callback = 'http://example.com/my-subscriber' - self.assertTrue(Subscription.insert(callback, topic, 'token', 'secret')) - FeedToFetch.insert([topic]) - urlfetch_test_stub.instance.expect('get', topic, 200, data) - self.run_fetch_task() - feed = FeedToFetch.get_by_key_name(get_hash_key_name(topic)) - self.assertTrue(feed is None) - event = EventToDeliver.all().get() - self.assertEquals(data.replace('\n', ''), event.payload.replace('\n', '')) - self.assertEquals('application/atom+xml', event.content_type) - self.assertEquals('atom', FeedRecord.all().get().format) - - def testPullWithUnicodeEtag(self): - """Tests when the ETag header has a unicode value. - - The ETag value should be ignored because non-ascii ETag values are invalid. - """ - data = ('\n' - '1123wooh') - topic = 'http://example.com/my-topic' - callback = 'http://example.com/my-subscriber' - self.assertTrue(Subscription.insert(callback, topic, 'token', 'secret')) - FeedToFetch.insert([topic]) - urlfetch_test_stub.instance.expect('get', topic, 200, data, - response_headers={ - 'ETag': '\xe3\x83\x96\xe3\x83\xad\xe3\x82\xb0\xe8\xa1\x86', - 'Content-Type': 'application/atom+xml', - }) - self.run_fetch_task() - feed = FeedToFetch.get_by_key_name(get_hash_key_name(topic)) - self.assertTrue(feed is None) - event = EventToDeliver.all().get() - self.assertEquals(data.replace('\n', ''), event.payload.replace('\n', '')) - self.assertEquals('application/atom+xml', event.content_type) - self.assertEquals( - {'Accept': '*/*', - 'Connection': 'cache-control', - 'Cache-Control': 'no-cache no-store max-age=1'}, - FeedRecord.all().get().get_request_headers(0)) - - def testPullGoodRss(self): - """Tests when the RSS XML can parse just fine.""" - data = ('\n' - '' - '1123wooh' - '') - topic = 'http://example.com/my-topic' - callback = 'http://example.com/my-subscriber' - self.assertTrue(Subscription.insert(callback, topic, 'token', 'secret')) - FeedToFetch.insert([topic]) - urlfetch_test_stub.instance.expect('get', topic, 200, data) - self.run_fetch_task() - feed = FeedToFetch.get_by_key_name(get_hash_key_name(topic)) - self.assertTrue(feed is None) - event = EventToDeliver.all().get() - self.assertEquals(data.replace('\n', ''), event.payload.replace('\n', '')) - self.assertEquals('application/rss+xml', event.content_type) - self.assertEquals('rss', FeedRecord.all().get().format) - - def testPullGoodRdf(self): - """Tests when the RDF (RSS 1.0) XML can parse just fine.""" - data = ('\n' - '' - '' - '1123wooh' - '') - topic = 'http://example.com/my-topic' - callback = 'http://example.com/my-subscriber' - self.assertTrue(Subscription.insert(callback, topic, 'token', 'secret')) - FeedToFetch.insert([topic]) - urlfetch_test_stub.instance.expect('get', topic, 200, data) - self.run_fetch_task() - feed = FeedToFetch.get_by_key_name(get_hash_key_name(topic)) - self.assertTrue(feed is None) - event = EventToDeliver.all().get() - self.assertEquals(data.replace('\n', ''), event.payload.replace('\n', '')) - self.assertEquals('application/rdf+xml', event.content_type) - self.assertEquals('rss', FeedRecord.all().get().format) - - def testPullArbitrary(self): - """Tests pulling content of an arbitrary type.""" - data = 'this is my random payload of data' - topic = 'http://example.com/my-topic' - callback = 'http://example.com/my-subscriber' - self.assertTrue(Subscription.insert(callback, topic, 'token', 'secret')) - FeedToFetch.insert([topic]) - urlfetch_test_stub.instance.expect( - 'get', topic, 200, data, - response_headers={'Content-Type': 'my crazy content type'}) - self.run_fetch_task() - feed = FeedToFetch.get_by_key_name(get_hash_key_name(topic)) - self.assertTrue(feed is None) - event = EventToDeliver.all().get() - self.assertEquals(data, event.payload) - self.assertEquals('my crazy content type', event.content_type) - self.assertEquals('arbitrary', FeedRecord.all().get().format) - - def testPullBinaryContent(self): - """Tests pulling binary content.""" - data = '\xff\x12 some binary data' - topic = 'http://example.com/my-topic' - callback = 'http://example.com/my-subscriber' - self.assertTrue(Subscription.insert(callback, topic, 'token', 'secret')) - FeedToFetch.insert([topic]) - urlfetch_test_stub.instance.expect( - 'get', topic, 200, data, - response_headers={'Content-Type': 'my crazy content type'}) - self.run_fetch_task() - feed = FeedToFetch.get_by_key_name(get_hash_key_name(topic)) - self.assertTrue(feed is None) - event = EventToDeliver.all().get() - self.assertEquals(data, event.payload) - self.assertEquals('my crazy content type', event.content_type) - self.assertEquals('arbitrary', FeedRecord.all().get().format) - - def testMultipleFetch(self): - """Tests doing multiple fetches asynchronously in parallel. - - Exercises the fork-join queue part of the fetching pipeline. - """ - data = ('\n' - '1123wooh') - topic_base = 'http://example.com/my-topic' - callback = 'http://example.com/my-subscriber' - topic_list = [topic_base + '1', topic_base + '2', topic_base + '3'] - FeedToFetch.insert(topic_list) - for topic in topic_list: - urlfetch_test_stub.instance.expect('get', topic, 200, data) - self.assertTrue(Subscription.insert(callback, topic, 'token', 'secret')) - - os.environ['HTTP_X_APPENGINE_TASKNAME'] = testutil.get_tasks( - main.FEED_QUEUE, index=0, expected_count=1)['name'] - try: - self.handle('post') - finally: - del os.environ['HTTP_X_APPENGINE_TASKNAME'] - - # Feed to fetch removed. - self.assertEquals([], list(FeedToFetch.all())) - self.assertEquals([(3, 0), (3, 0), (3, 0)], # 3 because of shared domain - main.FETCH_SCORER.get_scores(topic_list)) - - # All events written and correct. - all_events = list(EventToDeliver.all()) - all_topics = [e.topic for e in all_events] - self.assertEquals(3, len(all_events)) - self.assertEquals(set(topic_list), set(all_topics)) - event_tasks = testutil.get_tasks(main.EVENT_QUEUE, expected_count=3) - self.assertEquals(set(str(e.key()) for e in all_events), - set(task['params']['event_key'] for task in event_tasks)) - - # All feed records written. - all_records = list(FeedEntryRecord.all()) - all_parents = set(db.Key.from_path(FeedRecord.kind(), - FeedRecord.create_key_name(topic)) - for topic in topic_list) - found_parents = set(r.parent().key() for r in all_records) - self.assertEquals(3, len(found_parents)) - self.assertEquals(found_parents, all_parents) - -################################################################################ - -class PushEventHandlerTest(testutil.HandlerTestBase): - - handler_class = main.PushEventHandler - - def setUp(self): - """Sets up the test harness.""" - testutil.HandlerTestBase.setUp(self) - - self.chunk_size = main.EVENT_SUBSCRIBER_CHUNK_SIZE - self.topic = 'http://example.com/hamster-topic' - # Order of these URL fetches is determined by the ordering of the hashes - # of the callback URLs, so we need random extra strings here to get - # alphabetical hash order. - self.callback1 = 'http://example1.com/hamster-callback1-12' - self.callback2 = 'http://example2.com/hamster-callback2' - self.callback3 = 'http://example3.com/hamster-callback3-123456' - self.callback4 = 'http://example4.com/hamster-callback4-123' - self.header_footer = '\nblah\n' - self.test_payloads = [ - 'article1', - 'article2', - 'article3', - ] - self.expected_payload = ( - '\n' - '\n' - 'blah\n' - '\n' - 'article1\n' - 'article2\n' - 'article3\n' - '' - ) - - self.header_footer_rss = '' - self.test_payloads_rss = [ - 'article1', - 'article2', - 'article3', - ] - self.expected_payload_rss = ( - '\n' - '\n' - 'article1\n' - 'article2\n' - 'article3\n' - '' - ) - - self.bad_key = db.Key.from_path(EventToDeliver.kind(), 'does_not_exist') - - def tearDown(self): - """Resets any external modules modified for testing.""" - main.EVENT_SUBSCRIBER_CHUNK_SIZE = self.chunk_size - urlfetch_test_stub.instance.verify_and_reset() - - def testNoWork(self): - self.handle('post', ('event_key', str(self.bad_key))) - - def testNoExtraSubscribers(self): - """Tests when a single chunk of delivery is enough.""" - self.assertTrue(Subscription.insert( - self.callback1, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback2, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback3, self.topic, 'token', 'secret')) - main.EVENT_SUBSCRIBER_CHUNK_SIZE = 3 - urlfetch_test_stub.instance.expect( - 'post', self.callback1, 200, '', request_payload=self.expected_payload) - urlfetch_test_stub.instance.expect( - 'post', self.callback2, 204, '', request_payload=self.expected_payload) - urlfetch_test_stub.instance.expect( - 'post', self.callback3, 299, '', request_payload=self.expected_payload) - event = EventToDeliver.create_event_for_topic( - self.topic, main.ATOM, 'application/atom+xml', - self.header_footer, self.test_payloads) - event.put() - self.handle('post', ('event_key', str(event.key()))) - self.assertEquals([], list(EventToDeliver.all())) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - - self.assertEquals( - [(1, 0), (1, 0), (1, 0)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2, self.callback3])) - - def testHmacData(self): - """Tests that the content is properly signed with an HMAC.""" - self.assertTrue(Subscription.insert( - self.callback1, self.topic, 'token', 'secret3')) - # Secret is empty on purpose here, so the verify_token will be used instead. - self.assertTrue(Subscription.insert( - self.callback2, self.topic, 'my-token', '')) - self.assertTrue(Subscription.insert( - self.callback3, self.topic, 'token', 'secret-stuff')) - main.EVENT_SUBSCRIBER_CHUNK_SIZE = 3 - urlfetch_test_stub.instance.expect( - 'post', self.callback1, 204, '', - request_payload=self.expected_payload, - request_headers={ - 'Content-Type': 'application/atom+xml', - 'X-Hub-Signature': 'sha1=3e9caf971b0833d15393022f5f01a47adf597af5'}) - urlfetch_test_stub.instance.expect( - 'post', self.callback2, 200, '', - request_payload=self.expected_payload, - request_headers={ - 'Content-Type': 'application/atom+xml', - 'X-Hub-Signature': 'sha1=4847815aae8578eff55d351bc84a159b9bd8846e'}) - urlfetch_test_stub.instance.expect( - 'post', self.callback3, 204, '', - request_payload=self.expected_payload, - request_headers={ - 'Content-Type': 'application/atom+xml', - 'X-Hub-Signature': 'sha1=8b0a9da7204afa8ae04fc9439755c556b1e38d99'}) - event = EventToDeliver.create_event_for_topic( - self.topic, main.ATOM, 'application/atom+xml', - self.header_footer, self.test_payloads) - event.put() - self.handle('post', ('event_key', str(event.key()))) - self.assertEquals([], list(EventToDeliver.all())) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - - def testRssContentType(self): - """Tests that the content type of an RSS feed is properly supplied.""" - self.assertTrue(Subscription.insert( - self.callback1, self.topic, 'token', 'secret')) - main.EVENT_SUBSCRIBER_CHUNK_SIZE = 3 - urlfetch_test_stub.instance.expect( - 'post', self.callback1, 204, '', - request_payload=self.expected_payload_rss, - request_headers={ - 'Content-Type': 'application/rss+xml', - 'X-Hub-Signature': 'sha1=1607313b6195af74f29158421f0a31aa25d680da'}) - event = EventToDeliver.create_event_for_topic( - self.topic, main.RSS, 'application/rss+xml', - self.header_footer_rss, self.test_payloads_rss) - event.put() - self.handle('post', ('event_key', str(event.key()))) - self.assertEquals([], list(EventToDeliver.all())) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - - def testExtraSubscribers(self): - """Tests when there are more subscribers to contact after delivery.""" - self.assertTrue(Subscription.insert( - self.callback1, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback2, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback3, self.topic, 'token', 'secret')) - main.EVENT_SUBSCRIBER_CHUNK_SIZE = 1 - event = EventToDeliver.create_event_for_topic( - self.topic, main.ATOM, 'application/atom+xml', - self.header_footer, self.test_payloads) - event.put() - event_key = str(event.key()) - - urlfetch_test_stub.instance.expect( - 'post', self.callback1, 204, '', request_payload=self.expected_payload) - self.handle('post', ('event_key', event_key)) - urlfetch_test_stub.instance.verify_and_reset() - - urlfetch_test_stub.instance.expect( - 'post', self.callback2, 200, '', request_payload=self.expected_payload) - self.handle('post', ('event_key', event_key)) - urlfetch_test_stub.instance.verify_and_reset() - - self.assertEquals( - [(1, 0), (1, 0), (0, 0)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2, self.callback3])) - - urlfetch_test_stub.instance.expect( - 'post', self.callback3, 204, '', request_payload=self.expected_payload) - self.handle('post', ('event_key', event_key)) - urlfetch_test_stub.instance.verify_and_reset() - self.assertEquals([], list(EventToDeliver.all())) - - tasks = testutil.get_tasks(main.EVENT_QUEUE, expected_count=2) - self.assertEquals([event_key] * 2, - [t['params']['event_key'] for t in tasks]) - - self.assertEquals( - [(1, 0), (1, 0), (1, 0)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2, self.callback3])) - - def testBrokenCallbacks(self): - """Tests that when callbacks return errors and are saved for later.""" - self.assertTrue(Subscription.insert( - self.callback1, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback2, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback3, self.topic, 'token', 'secret')) - main.EVENT_SUBSCRIBER_CHUNK_SIZE = 2 - event = EventToDeliver.create_event_for_topic( - self.topic, main.ATOM, 'application/atom+xml', - self.header_footer, self.test_payloads) - event.put() - event_key = str(event.key()) - - urlfetch_test_stub.instance.expect( - 'post', self.callback1, 302, '', request_payload=self.expected_payload) - urlfetch_test_stub.instance.expect( - 'post', self.callback2, 404, '', request_payload=self.expected_payload) - self.handle('post', ('event_key', event_key)) - urlfetch_test_stub.instance.verify_and_reset() - - self.assertEquals( - [(0, 1), (0, 1), (0, 0)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2, self.callback3])) - - urlfetch_test_stub.instance.expect( - 'post', self.callback3, 500, '', request_payload=self.expected_payload) - self.handle('post', ('event_key', event_key)) - urlfetch_test_stub.instance.verify_and_reset() - - self.assertEquals( - [(0, 1), (0, 1), (0, 1)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2, self.callback3])) - - work = EventToDeliver.all().get() - sub_list = Subscription.get(work.failed_callbacks) - callback_list = [sub.callback for sub in sub_list] - self.assertEquals([self.callback1, self.callback2, self.callback3], - callback_list) - - tasks = testutil.get_tasks(main.EVENT_QUEUE, expected_count=1) - tasks.extend(testutil.get_tasks(main.EVENT_RETRIES_QUEUE, expected_count=1)) - self.assertEquals([event_key] * 2, - [t['params']['event_key'] for t in tasks]) - - def testDeadlineError(self): - """Tests that callbacks in flight at deadline will be marked as failed.""" - try: - def deadline(): - raise runtime.DeadlineExceededError() - main.async_proxy.wait = deadline - - self.assertTrue(Subscription.insert( - self.callback1, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback2, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback3, self.topic, 'token', 'secret')) - main.EVENT_SUBSCRIBER_CHUNK_SIZE = 2 - event = EventToDeliver.create_event_for_topic( - self.topic, main.ATOM, 'application/atom+xml', - self.header_footer, self.test_payloads) - event.put() - event_key = str(event.key()) - self.handle('post', ('event_key', event_key)) - - # All events should be marked as failed even though no urlfetches - # were made. - work = EventToDeliver.all().get() - sub_list = Subscription.get(work.failed_callbacks) - callback_list = [sub.callback for sub in sub_list] - self.assertEquals([self.callback1, self.callback2], callback_list) - - self.assertEquals(event_key, testutil.get_tasks( - main.EVENT_QUEUE, index=0, expected_count=1)['params']['event_key']) - - # In this case no reporting should happen, since we do not have - # any more time in the runtime to report stats. - self.assertEquals( - [(0, 0), (0, 0), (0, 0)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2, self.callback3])) - finally: - main.async_proxy = async_apiproxy.AsyncAPIProxy() - - def testRetryLogic(self): - """Tests that failed urls will be retried after subsequent failures. - - This is an end-to-end test for push delivery failures and retries. We'll - simulate multiple times through the failure list. - """ - self.assertTrue(Subscription.insert( - self.callback1, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback2, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback3, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback4, self.topic, 'token', 'secret')) - main.EVENT_SUBSCRIBER_CHUNK_SIZE = 3 - event = EventToDeliver.create_event_for_topic( - self.topic, main.ATOM, 'application/atom+xml', - self.header_footer, self.test_payloads) - event.put() - event_key = str(event.key()) - - # First pass through all URLs goes full speed for two chunks. - urlfetch_test_stub.instance.expect( - 'post', self.callback1, 404, '', request_payload=self.expected_payload) - urlfetch_test_stub.instance.expect( - 'post', self.callback2, 204, '', request_payload=self.expected_payload) - urlfetch_test_stub.instance.expect( - 'post', self.callback3, 302, '', request_payload=self.expected_payload) - self.handle('post', ('event_key', event_key)) - urlfetch_test_stub.instance.verify_and_reset() - - self.assertEquals( - [(0, 1), (1, 0), (0, 1), (0, 0)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2, self.callback3, self.callback4])) - - urlfetch_test_stub.instance.expect( - 'post', self.callback4, 500, '', request_payload=self.expected_payload) - self.handle('post', ('event_key', event_key)) - urlfetch_test_stub.instance.verify_and_reset() - - self.assertEquals( - [(0, 1), (1, 0), (0, 1), (0, 1)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2, self.callback3, self.callback4])) - - # Now the retries. - urlfetch_test_stub.instance.expect( - 'post', self.callback1, 404, '', request_payload=self.expected_payload) - urlfetch_test_stub.instance.expect( - 'post', self.callback3, 302, '', request_payload=self.expected_payload) - urlfetch_test_stub.instance.expect( - 'post', self.callback4, 500, '', request_payload=self.expected_payload) - self.handle('post', ('event_key', event_key)) - urlfetch_test_stub.instance.verify_and_reset() - - self.assertEquals( - [(0, 2), (1, 0), (0, 2), (0, 2)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2, self.callback3, self.callback4])) - - urlfetch_test_stub.instance.expect( - 'post', self.callback1, 204, '', request_payload=self.expected_payload) - urlfetch_test_stub.instance.expect( - 'post', self.callback3, 302, '', request_payload=self.expected_payload) - urlfetch_test_stub.instance.expect( - 'post', self.callback4, 200, '', request_payload=self.expected_payload) - self.handle('post', ('event_key', event_key)) - urlfetch_test_stub.instance.verify_and_reset() - - self.assertEquals( - [(1, 2), (1, 0), (0, 3), (1, 2)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2, self.callback3, self.callback4])) - - urlfetch_test_stub.instance.expect( - 'post', self.callback3, 204, '', request_payload=self.expected_payload) - self.handle('post', ('event_key', event_key)) - urlfetch_test_stub.instance.verify_and_reset() - - self.assertEquals( - [(1, 2), (1, 0), (1, 3), (1, 2)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2, self.callback3, self.callback4])) - - self.assertEquals([], list(EventToDeliver.all())) - tasks = testutil.get_tasks(main.EVENT_QUEUE, expected_count=1) - tasks.extend(testutil.get_tasks(main.EVENT_RETRIES_QUEUE, expected_count=3)) - self.assertEquals([event_key] * 4, - [t['params']['event_key'] for t in tasks]) - - def testUrlFetchFailure(self): - """Tests the UrlFetch API raising exceptions while sending notifications.""" - self.assertTrue(Subscription.insert( - self.callback1, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback2, self.topic, 'token', 'secret')) - main.EVENT_SUBSCRIBER_CHUNK_SIZE = 3 - event = EventToDeliver.create_event_for_topic( - self.topic, main.ATOM, 'application/atom+xml', - self.header_footer, self.test_payloads) - event.put() - event_key = str(event.key()) - - urlfetch_test_stub.instance.expect( - 'post', self.callback1, 200, '', - request_payload=self.expected_payload, urlfetch_error=True) - urlfetch_test_stub.instance.expect( - 'post', self.callback2, 200, '', - request_payload=self.expected_payload, apiproxy_error=True) - self.handle('post', ('event_key', event_key)) - urlfetch_test_stub.instance.verify_and_reset() - - work = EventToDeliver.all().get() - sub_list = Subscription.get(work.failed_callbacks) - callback_list = [sub.callback for sub in sub_list] - self.assertEquals([self.callback1, self.callback2], callback_list) - - self.assertEquals(event_key, testutil.get_tasks( - main.EVENT_RETRIES_QUEUE, index=0, expected_count=1) - ['params']['event_key']) - - self.assertEquals( - [(0, 1), (0, 1)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2])) - - def testNotAllowed(self): - """Tests pushing events to a URL that's not allowed due to scoring.""" - dos.DISABLE_FOR_TESTING = False - try: - main.DELIVERY_SCORER.blackhole([self.callback2]) - start_scores = main.DELIVERY_SCORER.get_scores([self.callback2]) - - self.assertTrue(Subscription.insert( - self.callback1, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback2, self.topic, 'token', 'secret')) - self.assertTrue(Subscription.insert( - self.callback3, self.topic, 'token', 'secret')) - main.EVENT_SUBSCRIBER_CHUNK_SIZE = 3 - urlfetch_test_stub.instance.expect( - 'post', self.callback1, 204, '', - request_payload=self.expected_payload) - urlfetch_test_stub.instance.expect( - 'post', self.callback3, 204, '', - request_payload=self.expected_payload) - event = EventToDeliver.create_event_for_topic( - self.topic, main.ATOM, 'application/atom+xml', - self.header_footer, self.test_payloads) - event.put() - self.handle('post', ('event_key', str(event.key()))) - self.assertEquals([], list(EventToDeliver.all())) - testutil.get_tasks(main.EVENT_QUEUE, expected_count=0) - - self.assertEquals( - [(1, 0)] + start_scores + [(1, 0)], - main.DELIVERY_SCORER.get_scores( - [self.callback1, self.callback2, self.callback3])) - finally: - dos.DISABLE_FOR_TESTING = True - -################################################################################ - -class SubscribeHandlerTest(testutil.HandlerTestBase): - - handler_class = main.SubscribeHandler - - def setUp(self): - """Tests up the test harness.""" - testutil.HandlerTestBase.setUp(self) - self.challenge = 'this_is_my_fake_challenge_string' - self.old_get_challenge = main.get_random_challenge - main.get_random_challenge = lambda: self.challenge - self.callback = 'http://example.com/good-callback' - self.topic = 'http://example.com/the-topic' - self.verify_token = 'the_token' - self.verify_callback_querystring_template = ( - self.callback + - '?hub.verify_token=the_token' - '&hub.challenge=this_is_my_fake_challenge_string' - '&hub.topic=http%%3A%%2F%%2Fexample.com%%2Fthe-topic' - '&hub.mode=%s' - '&hub.lease_seconds=432000') - - def tearDown(self): - """Tears down the test harness.""" - testutil.HandlerTestBase.tearDown(self) - main.get_random_challenge = self.old_get_challenge - - def verify_record_task(self, topic): - """Tests there is a valid KnownFeedIdentity task enqueued. - - Args: - topic: The topic the task should be for. - - Raises: - AssertionError if the task isn't there. - """ - task = testutil.get_tasks(main.MAPPINGS_QUEUE, index=0, expected_count=1) - self.assertEquals(topic, task['params']['topic']) - - def testDebugFormRenders(self): - self.handle('get') - self.assertTrue('' in self.response_body()) - - def testValidation(self): - """Tests form validation.""" - # Bad mode - self.handle('post', - ('hub.mode', 'bad'), - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.verify', 'async'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(400, self.response_code()) - self.assertTrue('hub.mode' in self.response_body()) - - # Empty callback - self.handle('post', - ('hub.mode', 'subscribe'), - ('hub.callback', ''), - ('hub.topic', self.topic), - ('hub.verify', 'async'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(400, self.response_code()) - self.assertTrue('hub.callback' in self.response_body()) - - # Bad callback URL - self.handle('post', - ('hub.mode', 'subscribe'), - ('hub.callback', 'httpf://example.com'), - ('hub.topic', self.topic), - ('hub.verify', 'async'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(400, self.response_code()) - self.assertTrue('hub.callback' in self.response_body()) - - # Empty topic - self.handle('post', - ('hub.mode', 'subscribe'), - ('hub.callback', self.callback), - ('hub.topic', ''), - ('hub.verify', 'async'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(400, self.response_code()) - self.assertTrue('hub.topic' in self.response_body()) - - # Bad topic URL - self.handle('post', - ('hub.mode', 'subscribe'), - ('hub.callback', self.callback), - ('hub.topic', 'httpf://example.com'), - ('hub.verify', 'async'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(400, self.response_code()) - self.assertTrue('hub.topic' in self.response_body()) - - # Bad verify - self.handle('post', - ('hub.mode', 'subscribe'), - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.verify', 'meep'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(400, self.response_code()) - self.assertTrue('hub.verify' in self.response_body()) - - # Bad lease_seconds - self.handle('post', - ('hub.mode', 'subscribe'), - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.verify', 'async'), - ('hub.verify_token', 'asdf'), - ('hub.lease_seconds', 'stuff')) - self.assertEquals(400, self.response_code()) - self.assertTrue('hub.lease_seconds' in self.response_body()) - - # Bad lease_seconds zero padding will break things - self.handle('post', - ('hub.mode', 'subscribe'), - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.verify', 'async'), - ('hub.verify_token', 'asdf'), - ('hub.lease_seconds', '000010')) - self.assertEquals(400, self.response_code()) - self.assertTrue('hub.lease_seconds' in self.response_body()) - - def testUnsubscribeMissingSubscription(self): - """Tests that deleting a non-existent subscription does nothing.""" - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.verify', 'sync'), - ('hub.mode', 'unsubscribe'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(204, self.response_code()) - - def testSynchronous(self): - """Tests synchronous subscribe and unsubscribe.""" - sub_key = Subscription.create_key_name(self.callback, self.topic) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', 200, - self.challenge) - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(204, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.verify_record_task(self.topic) - - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'unsubscribe', 200, - self.challenge) - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'unsubscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(204, self.response_code()) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - - def testAsynchronous(self): - """Tests sync and async subscriptions cause the correct state transitions. - - Also tests that synchronous subscribes and unsubscribes will overwrite - asynchronous requests. - """ - sub_key = Subscription.create_key_name(self.callback, self.topic) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - - # Async subscription. - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'async'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(202, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_NOT_VERIFIED, sub.subscription_state) - - # Sync subscription overwrites. - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', 200, - self.challenge) - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(204, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.verify_record_task(self.topic) - - # Async unsubscribe queues removal, but does not change former state. - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'unsubscribe'), - ('hub.verify', 'async'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(202, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - - # Synch unsubscribe overwrites. - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'unsubscribe', 200, - self.challenge) - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'unsubscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(204, self.response_code()) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - - def testResubscribe(self): - """Tests that subscribe requests will reset pending unsubscribes.""" - sub_key = Subscription.create_key_name(self.callback, self.topic) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - - # Async subscription. - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'async'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(202, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_NOT_VERIFIED, sub.subscription_state) - - # Async un-subscription does not change previous subscription state. - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'unsubscribe'), - ('hub.verify', 'async'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(202, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_NOT_VERIFIED, sub.subscription_state) - - # Synchronous subscription overwrites. - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', 200, - self.challenge) - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(204, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.verify_record_task(self.topic) - - def testMaxLeaseSeconds(self): - """Tests when the max lease period is specified.""" - sub_key = Subscription.create_key_name(self.callback, self.topic) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - - self.verify_callback_querystring_template = ( - self.callback + - '?hub.verify_token=the_token' - '&hub.challenge=this_is_my_fake_challenge_string' - '&hub.topic=http%%3A%%2F%%2Fexample.com%%2Fthe-topic' - '&hub.mode=%s' - '&hub.lease_seconds=864000') - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', 200, - self.challenge) - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token), - ('hub.lease_seconds', '1000000000000000000')) - self.assertEquals(204, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.verify_record_task(self.topic) - - def testDefaultLeaseSeconds(self): - """Tests when the lease_seconds parameter is ommitted.""" - sub_key = Subscription.create_key_name(self.callback, self.topic) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - - self.verify_callback_querystring_template = ( - self.callback + - '?hub.verify_token=the_token' - '&hub.challenge=this_is_my_fake_challenge_string' - '&hub.topic=http%%3A%%2F%%2Fexample.com%%2Fthe-topic' - '&hub.mode=%s' - '&hub.lease_seconds=432000') - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', 200, - self.challenge) - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token), - ('hub.lease_seconds', '')) - self.assertEquals(204, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.verify_record_task(self.topic) - - def testInvalidChallenge(self): - """Tests when the returned challenge is bad.""" - sub_key = Subscription.create_key_name(self.callback, self.topic) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - urlfetch_test_stub.instance.expect('get', - self.verify_callback_querystring_template % 'subscribe', 200, 'bad') - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - self.assertTrue(db.get(KnownFeed.create_key(self.topic)) is None) - self.assertEquals(409, self.response_code()) - - def testSynchronousConfirmFailure(self): - """Tests when synchronous confirmations fail.""" - # Subscribe - sub_key = Subscription.create_key_name(self.callback, self.topic) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - urlfetch_test_stub.instance.expect('get', - self.verify_callback_querystring_template % 'subscribe', 500, '') - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - self.assertTrue(db.get(KnownFeed.create_key(self.topic)) is None) - self.assertEquals(409, self.response_code()) - - # Unsubscribe - Subscription.insert(self.callback, self.topic, self.verify_token, 'secret') - urlfetch_test_stub.instance.expect('get', - self.verify_callback_querystring_template % 'unsubscribe', 500, '') - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'unsubscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertTrue(Subscription.get_by_key_name(sub_key) is not None) - self.assertEquals(409, self.response_code()) - - def testAfterSubscriptionError(self): - """Tests when an exception occurs after subscription.""" - for exception in (runtime.DeadlineExceededError(), db.Error(), - apiproxy_errors.Error()): - def new_confirm(*args): - raise exception - main.hooks.override_for_test(main.confirm_subscription, new_confirm) - try: - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(503, self.response_code()) - finally: - main.hooks.reset_for_test(main.confirm_subscription) - - def testSubscriptionError(self): - """Tests when errors occurs during subscription.""" - # URLFetch errors are probably the subscriber's fault, so we'll serve these - # as a conflict. - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', - None, '', urlfetch_error=True) - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(409, self.response_code()) - - # An apiproxy error or deadline error will fall through and serve a 503, - # since that means there's something wrong with our service. - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', - None, '', apiproxy_error=True) - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(503, self.response_code()) - - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', - None, '', deadline_error=True) - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(503, self.response_code()) - - def testCaseSensitive(self): - """Tests that the case of topics, callbacks, and tokens are preserved.""" - self.topic += FUNNY - self.callback += FUNNY - self.verify_token += FUNNY - sub_key = Subscription.create_key_name(self.callback, self.topic) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - self.verify_callback_querystring_template = ( - self.callback + - '?hub.verify_token=the_token%%2FCaSeSeNsItIvE' - '&hub.challenge=this_is_my_fake_challenge_string' - '&hub.topic=http%%3A%%2F%%2Fexample.com%%2Fthe-topic%%2FCaSeSeNsItIvE' - '&hub.mode=%s' - '&hub.lease_seconds=432000') - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', 200, - self.challenge) - - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(204, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.verify_record_task(self.topic) - - def testSubscribeNormalization(self): - """Tests that the topic and callback URLs are properly normalized.""" - self.topic += OTHER_STRING - orig_callback = self.callback - self.callback += OTHER_STRING - sub_key = Subscription.create_key_name( - main.normalize_iri(self.callback), - main.normalize_iri(self.topic)) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - self.verify_callback_querystring_template = ( - orig_callback + '/~one:two/&=' - '?hub.verify_token=the_token' - '&hub.challenge=this_is_my_fake_challenge_string' - '&hub.topic=http%%3A%%2F%%2Fexample.com%%2Fthe-topic' - '%%2F%%7Eone%%3Atwo%%2F%%26%%3D' - '&hub.mode=%s' - '&hub.lease_seconds=432000') - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', 200, - self.challenge) - - self.handle('post', - ('hub.callback', self.callback), - ('hub.topic', self.topic), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', self.verify_token)) - self.assertEquals(204, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.verify_record_task(main.normalize_iri(self.topic)) - - def testSubscribeIri(self): - """Tests when the topic, callback, verify_token, and secrets are IRIs.""" - topic = self.topic + FUNNY_UNICODE - topic_utf8 = self.topic + FUNNY_UTF8 - callback = self.callback + FUNNY_UNICODE - callback_utf8 = self.callback + FUNNY_UTF8 - verify_token = self.verify_token + FUNNY_UNICODE - verify_token_utf8 = self.verify_token + FUNNY_UTF8 - - sub_key = Subscription.create_key_name( - main.normalize_iri(callback), - main.normalize_iri(topic)) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - self.verify_callback_querystring_template = ( - self.callback + - '/blah/%%E3%%83%%96%%E3%%83%%AD%%E3%%82%%B0%%E8%%A1%%86' - '?hub.verify_token=the_token%%2F' - 'blah%%2F%%E3%%83%%96%%E3%%83%%AD%%E3%%82%%B0%%E8%%A1%%86' - '&hub.challenge=this_is_my_fake_challenge_string' - '&hub.topic=http%%3A%%2F%%2Fexample.com%%2Fthe-topic%%2F' - 'blah%%2F%%25E3%%2583%%2596%%25E3%%2583%%25AD' - '%%25E3%%2582%%25B0%%25E8%%25A1%%2586' - '&hub.mode=%s' - '&hub.lease_seconds=432000') - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', 200, - self.challenge) - - self.handle('post', - ('hub.callback', callback_utf8), - ('hub.topic', topic_utf8), - ('hub.mode', 'subscribe'), - ('hub.verify', 'sync'), - ('hub.verify_token', verify_token_utf8)) - self.assertEquals(204, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.verify_record_task(self.topic + FUNNY_IRI) - - def testSubscribeUnicode(self): - """Tests when UTF-8 encoded bytes show up in the requests. - - Technically this isn't well-formed or allowed by the HTTP/URI spec, but - people do it anyways and we may as well allow it. - """ - quoted_topic = urllib.quote(self.topic) - topic = self.topic + FUNNY_UNICODE - topic_utf8 = self.topic + FUNNY_UTF8 - quoted_callback = urllib.quote(self.callback) - callback = self.callback + FUNNY_UNICODE - callback_utf8 = self.callback + FUNNY_UTF8 - quoted_verify_token = urllib.quote(self.verify_token) - verify_token = self.verify_token + FUNNY_UNICODE - verify_token_utf8 = self.verify_token + FUNNY_UTF8 - - sub_key = Subscription.create_key_name( - main.normalize_iri(callback), - main.normalize_iri(topic)) - self.assertTrue(Subscription.get_by_key_name(sub_key) is None) - self.verify_callback_querystring_template = ( - self.callback + - '/blah/%%E3%%83%%96%%E3%%83%%AD%%E3%%82%%B0%%E8%%A1%%86' - '?hub.verify_token=the_token%%2F' - 'blah%%2F%%E3%%83%%96%%E3%%83%%AD%%E3%%82%%B0%%E8%%A1%%86' - '&hub.challenge=this_is_my_fake_challenge_string' - '&hub.topic=http%%3A%%2F%%2Fexample.com%%2Fthe-topic%%2F' - 'blah%%2F%%25E3%%2583%%2596%%25E3%%2583%%25AD' - '%%25E3%%2582%%25B0%%25E8%%25A1%%2586' - '&hub.mode=%s' - '&hub.lease_seconds=432000') - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', 200, - self.challenge) - - payload = ( - 'hub.callback=' + quoted_callback + FUNNY_UTF8 + - '&hub.topic=' + quoted_topic + FUNNY_UTF8 + - '&hub.mode=subscribe' - '&hub.verify=sync' - '&hub.verify_token=' + quoted_verify_token + FUNNY_UTF8) - - self.handle_body('post', payload) - self.assertEquals(204, self.response_code()) - sub = Subscription.get_by_key_name(sub_key) - self.assertTrue(sub is not None) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.verify_record_task(self.topic + FUNNY_IRI) - - -class SubscribeHandlerThroughHubUrlTest(SubscribeHandlerTest): - - handler_class = main.HubHandler - -################################################################################ - -class SubscriptionConfirmHandlerTest(testutil.HandlerTestBase): - - handler_class = main.SubscriptionConfirmHandler - - def setUp(self): - """Sets up the test fixture.""" - testutil.HandlerTestBase.setUp(self) - self.callback = 'http://example.com/good-callback' - self.topic = 'http://example.com/the-topic' - self.challenge = 'this_is_my_fake_challenge_string' - self.old_get_challenge = main.get_random_challenge - main.get_random_challenge = lambda: self.challenge - self.sub_key = Subscription.create_key_name(self.callback, self.topic) - self.verify_token = 'the_token' - self.secret = 'teh secrat' - self.verify_callback_querystring_template = ( - self.callback + - '?hub.verify_token=the_token' - '&hub.challenge=this_is_my_fake_challenge_string' - '&hub.topic=http%%3A%%2F%%2Fexample.com%%2Fthe-topic' - '&hub.mode=%s' - '&hub.lease_seconds=432000') - - def tearDown(self): - """Verify that all URL fetches occurred.""" - testutil.HandlerTestBase.tearDown(self) - main.get_random_challenge = self.old_get_challenge - urlfetch_test_stub.instance.verify_and_reset() - - def verify_task(self, next_state): - """Verifies that a subscription worker task is present. - - Args: - next_state: The next state the task should cause the Subscription to have. - """ - task = testutil.get_tasks(main.SUBSCRIPTION_QUEUE, - index=0, expected_count=1) - params = task['params'] - self.assertEquals(self.sub_key, params['subscription_key_name']) - self.assertEquals(next_state, params['next_state']) - - def verify_retry_task(self, - eta, - next_state, - verify_token=None, - secret=None, - auto_reconfirm=False): - """Verifies that a subscription worker retry task is present. - - Args: - eta: The ETA the retry task should have. - next_state: The next state the task should cause the Subscription to have. - verify_token: The verify token the retry task should have. Defaults to - the current token. - secret: The secret the retry task should have. Defaults to the - current secret. - auto_reconfirm: The confirmation type the retry task should have. - """ - task = testutil.get_tasks(main.SUBSCRIPTION_QUEUE, - index=1, expected_count=2) - params = task['params'] - self.assertEquals(testutil.task_eta(eta), task['eta']) - self.assertEquals(self.sub_key, params['subscription_key_name']) - self.assertEquals(next_state, params['next_state']) - self.assertEquals(verify_token or self.verify_token, params['verify_token']) - self.assertEquals(secret or self.secret, params['secret']) - self.assertEquals(str(auto_reconfirm), params['auto_reconfirm']) - - def verify_no_record_task(self): - """Tests there is not KnownFeedIdentity task enqueued. - - Raises: - AssertionError if the task is there. - """ - task = testutil.get_tasks(main.MAPPINGS_QUEUE, expected_count=0) - - def testNoWork(self): - """Tests when a task is enqueued for a Subscription that doesn't exist.""" - self.handle('post', ('subscription_key_name', 'unknown'), - ('next_state', Subscription.STATE_VERIFIED)) - - def testSubscribeSuccessful(self): - """Tests when a subscription task is successful.""" - self.assertTrue(db.get(KnownFeed.create_key(self.topic)) is None) - self.assertTrue(Subscription.get_by_key_name(self.sub_key) is None) - Subscription.request_insert( - self.callback, self.topic, self.verify_token, self.secret) - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', 200, - self.challenge) - self.handle('post', ('subscription_key_name', self.sub_key), - ('verify_token', self.verify_token), - ('secret', self.secret), - ('next_state', Subscription.STATE_VERIFIED)) - self.verify_task(Subscription.STATE_VERIFIED) - self.verify_no_record_task() - - sub = Subscription.get_by_key_name(self.sub_key) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.assertEquals(self.verify_token, sub.verify_token) - self.assertEquals(self.secret, sub.secret) - - def testSubscribeSuccessfulQueryStringArgs(self): - """Tests a subscription callback with querystring args.""" - self.callback += '?some=query&string=params&to=mess&it=up' - self.sub_key = Subscription.create_key_name(self.callback, self.topic) - self.assertTrue(db.get(KnownFeed.create_key(self.topic)) is None) - self.assertTrue(Subscription.get_by_key_name(self.sub_key) is None) - Subscription.request_insert( - self.callback, self.topic, self.verify_token, self.secret) - self.verify_callback_querystring_template = ( - self.callback + - '&hub.verify_token=the_token' - '&hub.challenge=this_is_my_fake_challenge_string' - '&hub.topic=http%%3A%%2F%%2Fexample.com%%2Fthe-topic' - '&hub.mode=%s' - '&hub.lease_seconds=432000') - - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'subscribe', 200, - self.challenge) - self.handle('post', ('subscription_key_name', self.sub_key), - ('verify_token', self.verify_token), - ('secret', self.secret), - ('next_state', Subscription.STATE_VERIFIED)) - self.verify_task(Subscription.STATE_VERIFIED) - self.verify_no_record_task() - - sub = Subscription.get_by_key_name(self.sub_key) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.assertEquals(self.verify_token, sub.verify_token) - self.assertEquals(self.secret, sub.secret) - - def testSubscribeFailed(self): - """Tests when a subscription task fails.""" - self.assertTrue(Subscription.get_by_key_name(self.sub_key) is None) - Subscription.request_insert( - self.callback, self.topic, self.verify_token, self.secret) - urlfetch_test_stub.instance.expect('get', - self.verify_callback_querystring_template % 'subscribe', 500, '') - self.handle('post', ('subscription_key_name', self.sub_key), - ('verify_token', self.verify_token), - ('secret', self.secret), - ('next_state', Subscription.STATE_VERIFIED)) - sub = Subscription.get_by_key_name(self.sub_key) - self.assertEquals(Subscription.STATE_NOT_VERIFIED, sub.subscription_state) - self.assertEquals(1, sub.confirm_failures) - self.assertEquals(self.verify_token, sub.verify_token) - self.assertEquals(self.secret, sub.secret) - self.verify_retry_task(sub.eta, - Subscription.STATE_VERIFIED, - verify_token=self.verify_token, - secret=self.secret) - - def testSubscribeConflict(self): - """Tests when confirmation hits a conflict and archives the subscription.""" - self.assertTrue(Subscription.get_by_key_name(self.sub_key) is None) - Subscription.request_insert( - self.callback, self.topic, self.verify_token, self.secret) - urlfetch_test_stub.instance.expect('get', - self.verify_callback_querystring_template % 'subscribe', 404, '') - self.handle('post', ('subscription_key_name', self.sub_key), - ('verify_token', self.verify_token), - ('secret', self.secret), - ('next_state', Subscription.STATE_VERIFIED)) - sub = Subscription.get_by_key_name(self.sub_key) - self.assertEquals(Subscription.STATE_TO_DELETE, sub.subscription_state) - testutil.get_tasks(main.SUBSCRIPTION_QUEUE, expected_count=1) - - def testSubscribeBadChallengeResponse(self): - """Tests when the subscriber responds with a bad challenge.""" - self.assertTrue(Subscription.get_by_key_name(self.sub_key) is None) - Subscription.request_insert( - self.callback, self.topic, self.verify_token, self.secret) - urlfetch_test_stub.instance.expect('get', - self.verify_callback_querystring_template % 'subscribe', 200, 'bad') - self.handle('post', ('subscription_key_name', self.sub_key), - ('verify_token', self.verify_token), - ('secret', self.secret), - ('next_state', Subscription.STATE_VERIFIED)) - sub = Subscription.get_by_key_name(self.sub_key) - self.assertEquals(Subscription.STATE_NOT_VERIFIED, sub.subscription_state) - self.assertEquals(1, sub.confirm_failures) - self.verify_retry_task(sub.eta, Subscription.STATE_VERIFIED) - - def testUnsubscribeSuccessful(self): - """Tests when an unsubscription request is successful.""" - self.assertTrue(Subscription.get_by_key_name(self.sub_key) is None) - Subscription.insert( - self.callback, self.topic, self.verify_token, self.secret) - Subscription.request_remove(self.callback, self.topic, self.verify_token) - urlfetch_test_stub.instance.expect( - 'get', self.verify_callback_querystring_template % 'unsubscribe', 200, - self.challenge) - self.handle('post', ('subscription_key_name', self.sub_key), - ('verify_token', self.verify_token), - ('next_state', Subscription.STATE_TO_DELETE)) - self.verify_task(Subscription.STATE_TO_DELETE) - self.assertTrue(Subscription.get_by_key_name(self.sub_key) is None) - - def testUnsubscribeFailed(self): - """Tests when an unsubscription task fails.""" - self.assertTrue(Subscription.get_by_key_name(self.sub_key) is None) - Subscription.insert( - self.callback, self.topic, self.verify_token, self.secret) - Subscription.request_remove(self.callback, self.topic, self.verify_token) - urlfetch_test_stub.instance.expect('get', - self.verify_callback_querystring_template % 'unsubscribe', 500, '') - self.handle('post', ('subscription_key_name', self.sub_key), - ('verify_token', self.verify_token), - ('next_state', Subscription.STATE_TO_DELETE), - ('secret', self.secret)) - sub = Subscription.get_by_key_name(self.sub_key) - self.assertEquals(1, sub.confirm_failures) - self.verify_retry_task(sub.eta, Subscription.STATE_TO_DELETE) - - def testUnsubscribeGivesUp(self): - """Tests when an unsubscription task completely gives up.""" - self.assertTrue(Subscription.get_by_key_name(self.sub_key) is None) - Subscription.insert( - self.callback, self.topic, self.verify_token, self.secret) - Subscription.request_remove(self.callback, self.topic, self.verify_token) - sub = Subscription.get_by_key_name(self.sub_key) - sub.confirm_failures = 100 - sub.put() - urlfetch_test_stub.instance.expect('get', - self.verify_callback_querystring_template % 'unsubscribe', 500, '') - self.handle('post', ('subscription_key_name', self.sub_key), - ('verify_token', self.verify_token), - ('next_state', Subscription.STATE_TO_DELETE)) - sub = Subscription.get_by_key_name(self.sub_key) - self.assertEquals(100, sub.confirm_failures) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.verify_task(Subscription.STATE_TO_DELETE) - - def testSubscribeOverwrite(self): - """Tests that subscriptions can be overwritten with new parameters.""" - Subscription.insert( - self.callback, self.topic, self.verify_token, self.secret) - second_token = 'second_verify_token' - second_secret = 'second secret' - new_template = self.verify_callback_querystring_template.replace( - self.verify_token, second_token) - urlfetch_test_stub.instance.expect( - 'get', new_template % 'subscribe', 200, self.challenge) - self.handle('post', ('subscription_key_name', self.sub_key), - ('verify_token', second_token), - ('secret', second_secret), - ('next_state', Subscription.STATE_VERIFIED)) - sub = Subscription.get_by_key_name(self.sub_key) - self.assertEquals(Subscription.STATE_VERIFIED, sub.subscription_state) - self.assertEquals(second_token, sub.verify_token) - self.assertEquals(second_secret, sub.secret) - self.verify_no_record_task() - - def testConfirmError(self): - """Tests when an exception is raised while confirming a subscription. - - This will just propagate up in the stack and cause the task to retry - via the normal task queue retries. - """ - called = [False] - Subscription.request_insert( - self.callback, self.topic, self.verify_token, self.secret) - # All exceptions should just fall through. - def new_confirm(*args, **kwargs): - called[0] = True - raise db.Error() - try: - main.hooks.override_for_test(main.confirm_subscription, new_confirm) - try: - self.handle('post', ('subscription_key_name', self.sub_key)) - except db.Error: - pass - else: - self.fail() - finally: - main.hooks.reset_for_test(main.confirm_subscription) - self.assertTrue(called[0]) - self.verify_task(Subscription.STATE_VERIFIED) - - def testRenewNack(self): - """Tests when an auto-subscription-renewal returns a 404.""" - self.assertTrue(Subscription.get_by_key_name(self.sub_key) is None) - Subscription.insert( - self.callback, self.topic, self.verify_token, self.secret) - urlfetch_test_stub.instance.expect('get', - self.verify_callback_querystring_template % 'subscribe', 404, '') - self.handle('post', ('subscription_key_name', self.sub_key), - ('verify_token', self.verify_token), - ('secret', self.secret), - ('next_state', Subscription.STATE_VERIFIED), - ('auto_reconfirm', 'True')) - sub = Subscription.get_by_key_name(self.sub_key) - self.assertEquals(Subscription.STATE_TO_DELETE, sub.subscription_state) - testutil.get_tasks(main.SUBSCRIPTION_QUEUE, expected_count=0) - - def testRenewErrorFailure(self): - """Tests when an auto-subscription-renewal returns errors repeatedly. - - In this case, since it's auto-renewal, the subscription should be dropped. - """ - self.assertTrue(Subscription.get_by_key_name(self.sub_key) is None) - Subscription.insert( - self.callback, self.topic, self.verify_token, self.secret) - sub = Subscription.get_by_key_name(self.sub_key) - sub.confirm_failures = 100 - sub.put() - urlfetch_test_stub.instance.expect('get', - self.verify_callback_querystring_template % 'subscribe', 500, '') - self.handle('post', ('subscription_key_name', self.sub_key), - ('verify_token', self.verify_token), - ('next_state', Subscription.STATE_VERIFIED), - ('auto_reconfirm', 'True')) - sub = Subscription.get_by_key_name(self.sub_key) - self.assertEquals(Subscription.STATE_TO_DELETE, sub.subscription_state) - testutil.get_tasks(main.SUBSCRIPTION_QUEUE, expected_count=0) - - -class SubscriptionReconfirmHandlerTest(testutil.HandlerTestBase): - """Tests for the periodic subscription reconfirming worker.""" - - def testFullFlow(self): - """Tests a full flow through the reconfirm worker.""" - self.now = time.time() - self.called = False - def start_map(*args, **kwargs): - self.assertEquals({ - 'name': 'Reconfirm expiring subscriptions', - 'reader_spec': 'mapreduce.input_readers.DatastoreInputReader', - 'queue_name': 'polling', - 'handler_spec': 'offline_jobs.SubscriptionReconfirmMapper.run', - 'shard_count': 4, - 'mapper_parameters': { - 'entity_kind': 'main.Subscription', - 'processing_rate': 100000, - 'threshold_timestamp': - int(self.now + main.SUBSCRIPTION_CHECK_BUFFER_SECONDS), - }, - 'mapreduce_parameters': { - 'done_callback': '/work/cleanup_mapper', - 'done_callback_queue': 'polling', - }, - }, kwargs) - self.called = True - - def create_handler(): - return main.SubscriptionReconfirmHandler( - now=lambda: self.now, - start_map=start_map) - self.handler_class = create_handler - - os.environ['HTTP_X_APPENGINE_QUEUENAME'] = main.POLLING_QUEUE - try: - self.handle('get') - task = testutil.get_tasks(main.POLLING_QUEUE, index=0, expected_count=1) - self.handle('post') - finally: - del os.environ['HTTP_X_APPENGINE_QUEUENAME'] - - self.assertTrue(self.called) - - -class SubscriptionCleanupHandlerTest(testutil.HandlerTestBase): - """Tests fo the SubscriptionCleanupHandler.""" - - handler_class = main.SubscriptionCleanupHandler - - def testEmpty(self): - """Tests cleaning up empty subscriptions.""" - self.handle('get') - - def testCleanup(self): - """Tests cleaning up a few deleted subscriptions.""" - callback = 'http://example.com/callback/%d' - topic = 'http://example.com/mytopic' - self.assertTrue(Subscription.insert(callback % 1, topic, '', '')) - self.assertTrue(Subscription.insert(callback % 2, topic, '', '')) - self.assertTrue(Subscription.insert(callback % 3, topic, '', '')) - self.assertEquals(3 * [Subscription.STATE_VERIFIED], - [s.subscription_state for s in Subscription.all()]) - - Subscription.archive(callback % 1, topic) - self.handle('get') - self.assertEquals(2 * [Subscription.STATE_VERIFIED], - [s.subscription_state for s in Subscription.all()]) - - -class CleanupMapperHandlerTest(testutil.HandlerTestBase): - """Tests for the CleanupMapperHandler.""" - - handler_class = main.CleanupMapperHandler - - def testMissing(self): - """Tests cleaning up a mapreduce that's not present.""" - self.assertEquals([], list(mapreduce.model.MapreduceState.all())) - os.environ['HTTP_MAPREDUCE_ID'] = '12345' - try: - self.handle('post') - finally: - del os.environ['HTTP_MAPREDUCE_ID'] - self.assertEquals([], list(mapreduce.model.MapreduceState.all())) - - def testPresent(self): - """Tests cleaning up a mapreduce that's present.""" - mapreduce_id = mapreduce.control.start_map( - name='Reconfirm expiring subscriptions', - handler_spec='offline_jobs.SubscriptionReconfirmMapper.run', - reader_spec='mapreduce.input_readers.DatastoreInputReader', - mapper_parameters=dict( - processing_rate=100000, - entity_kind='main.Subscription')) - - self.assertEquals(1, len(list(mapreduce.model.MapreduceState.all()))) - os.environ['HTTP_MAPREDUCE_ID'] = mapreduce_id - try: - self.handle('post') - finally: - del os.environ['HTTP_MAPREDUCE_ID'] - self.assertEquals([], list(mapreduce.model.MapreduceState.all())) - -################################################################################ - -PollingMarker = main.PollingMarker - - -class TakePollingActionTest(unittest.TestCase): - """Tests for the take_polling_action function.""" - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - - def testFailure(self): - """Tests when inserting a new feed to fetch raises an exception.""" - called = [False] - topics = ['one', 'two', 'three'] - @classmethod - def new_insert(cls, topic_list, memory_only=True): - called[0] = True - self.assertFalse(memory_only) - self.assertEquals(topic_list, topics) - raise db.Error('Mock DB error') - - old_insert = main.FeedToFetch.insert - main.FeedToFetch.insert = new_insert - try: - main.take_polling_action(['one', 'two', 'three'], '') - finally: - main.FeedToFetch.insert = old_insert - - self.assertTrue(called[0]) - - -class PollBootstrapHandlerTest(testutil.HandlerTestBase): - - handler_class = main.PollBootstrapHandler - - def setUp(self): - """Sets up the test harness.""" - testutil.HandlerTestBase.setUp(self) - self.original_chunk_size = main.BOOSTRAP_FEED_CHUNK_SIZE - main.BOOSTRAP_FEED_CHUNK_SIZE = 2 - os.environ['HTTP_X_APPENGINE_QUEUENAME'] = main.POLLING_QUEUE - - def tearDown(self): - """Tears down the test harness.""" - testutil.HandlerTestBase.tearDown(self) - main.BOOSTRAP_FEED_CHUNK_SIZE = self.original_chunk_size - del os.environ['HTTP_X_APPENGINE_QUEUENAME'] - - def testFullFlow(self): - """Tests a full flow through multiple chunks.""" - topic = 'http://example.com/feed1' - topic2 = 'http://example.com/feed2' - topic3 = 'http://example.com/feed3-124' # alphabetical on the hash of this - db.put([KnownFeed.create(topic), KnownFeed.create(topic2), - KnownFeed.create(topic3)]) - self.assertTrue(FeedToFetch.get_by_topic(topic) is None) - self.assertTrue(FeedToFetch.get_by_topic(topic2) is None) - self.assertTrue(FeedToFetch.get_by_topic(topic3) is None) - - # This will repeatedly insert the initial task to start the polling process. - self.handle('get') - self.handle('get') - self.handle('get') - task = testutil.get_tasks(main.POLLING_QUEUE, index=0, expected_count=1) - sequence = task['params']['sequence'] - self.assertEquals('bootstrap', task['params']['poll_type']) - - # Now run the post handler with the params from this first task. It will - # enqueue another task that starts *after* the last one in the chunk. - self.handle('post', *task['params'].items()) - self.assertTrue(FeedToFetch.get_by_topic(topic) is not None) - self.assertTrue(FeedToFetch.get_by_topic(topic2) is not None) - self.assertTrue(FeedToFetch.get_by_topic(topic3) is None) - - # Running this handler again will overwrite the FeedToFetch instances, - # but it will not duplicate the polling queue Task in the chain of - # iterating through all KnownFeed entries or the fork-join queue task that - # will do the actual fetching. - self.handle('post', *task['params'].items()) - task = testutil.get_tasks(main.POLLING_QUEUE, index=1, expected_count=2) - self.assertEquals(sequence, task['params']['sequence']) - self.assertEquals('bootstrap', task['params']['poll_type']) - self.assertEquals(str(KnownFeed.create_key(topic2)), - task['params']['current_key']) - self.assertTrue(task['name'].startswith(sequence)) - - # Now running another post handler will handle the rest of the feeds. - self.handle('post', *task['params'].items()) - self.assertTrue(FeedToFetch.get_by_topic(topic) is not None) - self.assertTrue(FeedToFetch.get_by_topic(topic2) is not None) - self.assertTrue(FeedToFetch.get_by_topic(topic3) is not None) - - # Running this post handler again will do nothing because we de-dupe on - # the continuation task to prevent doing any more work in the current cycle. - self.handle('post', *task['params'].items()) - - task_list = testutil.get_tasks(main.POLLING_QUEUE, expected_count=3) - - # Deal with a stupid race condition - task = task_list[2] - if 'params' not in task: - task = task_list[3] - - self.assertEquals(sequence, task['params']['sequence']) - self.assertEquals('bootstrap', task['params']['poll_type']) - self.assertEquals(str(KnownFeed.create_key(topic3)), - task['params']['current_key']) - self.assertTrue(task['name'].startswith(sequence)) - - # Starting the cycle again will do nothing. - self.handle('get') - testutil.get_tasks(main.POLLING_QUEUE, expected_count=3) - - # Resetting the next start time to before the present time will - # cause the iteration to start again. - the_mark = PollingMarker.get() - the_mark.next_start = \ - datetime.datetime.utcnow() - datetime.timedelta(seconds=120) - db.put(the_mark) - self.handle('get') - - task_list = testutil.get_tasks(main.POLLING_QUEUE, expected_count=4) - task = task_list[3] - self.assertNotEquals(sequence, task['params']['sequence']) - - def testRecord(self): - """Tests when the parameter "poll_type=record" is specified.""" - topic = 'http://example.com/feed1' - topic2 = 'http://example.com/feed2' - topic3 = 'http://example.com/feed3-124' # alphabetical on the hash of this - db.put([KnownFeed.create(topic), KnownFeed.create(topic2), - KnownFeed.create(topic3)]) - self.assertTrue(FeedToFetch.get_by_topic(topic) is None) - self.assertTrue(FeedToFetch.get_by_topic(topic2) is None) - self.assertTrue(FeedToFetch.get_by_topic(topic3) is None) - - # This will insert the initial task to start the polling process. - self.handle('get', ('poll_type', 'record')) - task = testutil.get_tasks(main.POLLING_QUEUE, index=0, expected_count=1) - sequence = task['params']['sequence'] - self.assertEquals('record', task['params']['poll_type']) - - # Now run the post handler with the params from this first task. It will - # enqueue another task that starts *after* the last one in the chunk. - self.handle('post', *task['params'].items()) - task = testutil.get_tasks(main.POLLING_QUEUE, index=1, expected_count=2) - self.assertEquals('record', task['params']['poll_type']) - - # Now running another post handler will handle the rest of the feeds. - self.handle('post', *task['params'].items()) - - # And there will be tasks in the MAPPINGS_QUEUE to update all of the - # KnownFeeds that we have found. - task = testutil.get_tasks(main.MAPPINGS_QUEUE, index=0, expected_count=3) - self.assertEquals(topic, task['params']['topic']) - task = testutil.get_tasks(main.MAPPINGS_QUEUE, index=1, expected_count=3) - self.assertEquals(topic2, task['params']['topic']) - task = testutil.get_tasks(main.MAPPINGS_QUEUE, index=2, expected_count=3) - self.assertEquals(topic3, task['params']['topic']) - -################################################################################ - -KnownFeedIdentity = main.KnownFeedIdentity - - -class RecordFeedHandlerTest(testutil.HandlerTestBase): - """Tests for the RecordFeedHandler flow.""" - - def setUp(self): - """Sets up the test harness.""" - self.now = [datetime.datetime.utcnow()] - self.handler_class = lambda: main.RecordFeedHandler(now=lambda: self.now[0]) - testutil.HandlerTestBase.setUp(self) - - self.old_identify = main.feed_identifier.identify - self.expected_calls = [] - self.expected_results = [] - def new_identify(content, feed_type): - self.assertEquals(self.expected_calls.pop(0), (content, feed_type)) - result = self.expected_results.pop(0) - if isinstance(result, Exception): - raise result - else: - return result - - main.feed_identifier.identify = new_identify - self.topic = 'http://www.example.com/meepa' - self.feed_id = 'my_feed_id' - self.content = 'my_atom_content' - - def tearDown(self): - """Tears down the test harness.""" - main.feed_identifier.identify = self.old_identify - testutil.HandlerTestBase.tearDown(self) - urlfetch_test_stub.instance.verify_and_reset() - - def verify_update(self): - """Verifies the feed_id has been added for the topic.""" - feed_id = KnownFeedIdentity.get(KnownFeedIdentity.create_key(self.feed_id)) - feed = KnownFeed.get(KnownFeed.create_key(self.topic)) - self.assertEquals([self.topic], feed_id.topics) - self.assertEquals(feed.feed_id, self.feed_id) - self.assertEquals(feed.feed_id, feed_id.feed_id) - - def testNewFeed(self): - """Tests recording details for a known feed.""" - urlfetch_test_stub.instance.expect('GET', self.topic, 200, self.content) - self.expected_calls.append((self.content, 'atom')) - self.expected_results.append(self.feed_id) - self.handle('post', ('topic', self.topic)) - self.verify_update() - - def testNewFeedFetchFailure(self): - """Tests when fetching a feed to record returns a non-200 response.""" - urlfetch_test_stub.instance.expect('GET', self.topic, 404, '') - self.handle('post', ('topic', self.topic)) - feed = KnownFeed.get(KnownFeed.create_key(self.topic)) - self.assertTrue(feed.feed_id is None) - - def testNewFeedFetchException(self): - """Tests when fetching a feed to record returns an exception.""" - urlfetch_test_stub.instance.expect('GET', self.topic, 200, '', - urlfetch_error=True) - self.handle('post', ('topic', self.topic)) - feed = KnownFeed.get(KnownFeed.create_key(self.topic)) - self.assertTrue(feed.feed_id is None) - - def testParseRetry(self): - """Tests when parsing as Atom fails, but RSS is successful.""" - urlfetch_test_stub.instance.expect('GET', self.topic, 200, self.content) - self.expected_calls.append((self.content, 'atom')) - self.expected_results.append(xml.sax.SAXException('Mock error')) - self.expected_calls.append((self.content, 'rss')) - self.expected_results.append(self.feed_id) - self.handle('post', ('topic', self.topic)) - self.verify_update() - - def testParseFails(self): - """Tests when parsing completely fails.""" - urlfetch_test_stub.instance.expect('GET', self.topic, 200, self.content) - self.expected_calls.append((self.content, 'atom')) - self.expected_results.append(xml.sax.SAXException('Mock error')) - self.expected_calls.append((self.content, 'rss')) - self.expected_results.append(xml.sax.SAXException('Mock error 2')) - self.handle('post', ('topic', self.topic)) - feed = KnownFeed.get(KnownFeed.create_key(self.topic)) - self.assertTrue(feed.feed_id is None) - - def testParseFindsNoIds(self): - """Tests when no SAX exception is raised but no feed ID is found.""" - urlfetch_test_stub.instance.expect('GET', self.topic, 200, self.content) - self.expected_calls.append((self.content, 'atom')) - self.expected_results.append(None) - self.expected_calls.append((self.content, 'rss')) - self.expected_results.append(None) - self.handle('post', ('topic', self.topic)) - feed = KnownFeed.get(KnownFeed.create_key(self.topic)) - self.assertTrue(feed.feed_id is None) - - def testParseFindsEmptyId(self): - """Tests when no SAX exception is raised but the feed ID is empty.""" - urlfetch_test_stub.instance.expect('GET', self.topic, 200, self.content) - self.expected_calls.append((self.content, 'atom')) - self.expected_results.append('') - self.handle('post', ('topic', self.topic)) - feed = KnownFeed.get(KnownFeed.create_key(self.topic)) - self.assertTrue(feed.feed_id is None) - - def testExistingFeedNeedsRefresh(self): - """Tests recording details for an existing feed that needs a refresh.""" - KnownFeed.create(self.topic).put() - self.now[0] += datetime.timedelta( - seconds=main.FEED_IDENTITY_UPDATE_PERIOD + 1) - - urlfetch_test_stub.instance.expect('GET', self.topic, 200, self.content) - self.expected_calls.append((self.content, 'atom')) - self.expected_results.append(self.feed_id) - self.handle('post', ('topic', self.topic)) - self.verify_update() - - def testExistingFeedNoRefresh(self): - """Tests recording details when the feed does not need a refresh.""" - feed = KnownFeed.create(self.topic) - feed.feed_id = 'meep' - feed.put() - self.handle('post', ('topic', self.topic)) - # Confirmed by no calls to urlfetch or feed_identifier. - - def testExistingFeedNoIdRefresh(self): - """Tests that a KnownFeed with no ID will be refreshed.""" - feed = KnownFeed.create(self.topic) - urlfetch_test_stub.instance.expect('GET', self.topic, 200, self.content) - self.expected_calls.append((self.content, 'atom')) - self.expected_results.append(self.feed_id) - self.handle('post', ('topic', self.topic)) - self.verify_update() - - def testNewFeedRelation(self): - """Tests when the feed ID relation changes for a topic.""" - KnownFeedIdentity.update(self.feed_id, self.topic) - feed = KnownFeed.create(self.topic) - feed.feed_id = self.feed_id - feed.put() - self.now[0] += datetime.timedelta( - seconds=main.FEED_IDENTITY_UPDATE_PERIOD + 1) - - new_feed_id = 'other_feed_id' - urlfetch_test_stub.instance.expect('GET', self.topic, 200, self.content) - self.expected_calls.append((self.content, 'atom')) - self.expected_results.append(new_feed_id) - self.handle('post', ('topic', self.topic)) - - feed_id = KnownFeedIdentity.get(KnownFeedIdentity.create_key(new_feed_id)) - feed = KnownFeed.get(feed.key()) - self.assertEquals([self.topic], feed_id.topics) - self.assertEquals(feed.feed_id, new_feed_id) - self.assertEquals(feed.feed_id, feed_id.feed_id) - - # Old KnownFeedIdentity should have been deleted. - self.assertTrue(KnownFeedIdentity.get( - KnownFeedIdentity.create_key(self.feed_id)) is None) - - -class RecordFeedHandlerWithParsingTest(testutil.HandlerTestBase): - """Tests for the RecordFeedHandler that excercise parsing.""" - - handler_class = main.RecordFeedHandler - - def testAtomParsing(self): - """Tests parsing an Atom feed.""" - topic = 'http://example.com/atom' - feed_id = 'my-id' - data = ('' - 'my-id') - urlfetch_test_stub.instance.expect('GET', topic, 200, data) - self.handle('post', ('topic', topic)) - - known_id = KnownFeedIdentity.get(KnownFeedIdentity.create_key(feed_id)) - feed = KnownFeed.get(KnownFeed.create_key(topic)) - self.assertEquals([topic], known_id.topics) - self.assertEquals(feed.feed_id, feed_id) - self.assertEquals(feed.feed_id, known_id.feed_id) - - def testRssParsing(self): - """Tests parsing an Atom feed.""" - topic = 'http://example.com/rss' - feed_id = 'http://example.com/blah' - data = ('' - 'http://example.com/blah') - urlfetch_test_stub.instance.expect('GET', topic, 200, data) - self.handle('post', ('topic', topic)) - - known_id = KnownFeedIdentity.get(KnownFeedIdentity.create_key(feed_id)) - feed = KnownFeed.get(KnownFeed.create_key(topic)) - self.assertEquals([topic], known_id.topics) - self.assertEquals(feed.feed_id, feed_id) - self.assertEquals(feed.feed_id, known_id.feed_id) - -################################################################################ - -class HookManagerTest(unittest.TestCase): - """Tests for the HookManager and Hook classes.""" - - def setUp(self): - """Sets up the test harness.""" - self.hooks_directory = tempfile.mkdtemp() - if not os.path.exists(self.hooks_directory): - os.makedirs(self.hooks_directory) - self.valueA = object() - self.valueB = object() - self.valueC = object() - self.funcA = lambda *a, **k: self.valueA - self.funcB = lambda *a, **k: self.valueB - self.funcC = lambda *a, **k: self.valueC - self.globals_dict = { - 'funcA': self.funcA, - 'funcB': self.funcB, - 'funcC': self.funcC, - } - self.manager = main.HookManager() - self.manager.declare(self.funcA) - self.manager.declare(self.funcB) - self.manager.declare(self.funcC) - - def tearDown(self): - """Tears down the test harness.""" - shutil.rmtree(self.hooks_directory, True) - - def write_hook(self, filename, content): - """Writes a test hook to the hooks directory. - - Args: - filename: The relative filename the hook should have. - content: The Python code that should go in the hook module. - """ - hook_file = open(os.path.join(self.hooks_directory, filename), 'w') - try: - hook_file.write('#!/usr/bin/env python\n') - hook_file.write(content) - finally: - hook_file.close() - - def load_hooks(self): - """Causes the hooks to load.""" - self.manager.load(hooks_path=self.hooks_directory, - globals_dict=self.globals_dict) - - def testNoHooksDir(self): - """Tests when there is no hooks directory present at all.""" - hooks_path = tempfile.mktemp() - self.assertFalse(os.path.exists(hooks_path)) - self.manager.load(hooks_path=hooks_path, - globals_dict=self.globals_dict) - for entry, hooks in self.manager._mapping.iteritems(): - self.assertEquals(0, len(hooks)) - - def testNoHooks(self): - """Tests loading a directory with no hooks modules.""" - self.load_hooks() - self.assertEquals(self.valueA, self.manager.execute(self.funcA)) - self.assertEquals(self.valueB, self.manager.execute(self.funcB)) - self.assertEquals(self.valueC, self.manager.execute(self.funcC)) - - def testOneGoodHook(self): - """Tests a single good hook.""" - self.write_hook('my_hook.py',""" -class MyHook(Hook): - def inspect(self, args, kwargs): - return True - def __call__(self, *args, **kwargs): - return 'fancy string' -register(funcA, MyHook()) -""") - self.load_hooks() - self.assertEquals('fancy string', self.manager.execute(self.funcA)) - - def testDifferentHooksInOneModule(self): - """Tests different hook methods in a single hook module.""" - self.write_hook('my_hook.py',""" -class MyHook(Hook): - def __init__(self, value): - self.value = value - def inspect(self, args, kwargs): - return True - def __call__(self, *args, **kwargs): - return self.value -register(funcA, MyHook('fancy A')) -register(funcB, MyHook('fancy B')) -register(funcC, MyHook('fancy C')) -""") - self.load_hooks() - self.assertEquals('fancy A', self.manager.execute(self.funcA)) - self.assertEquals('fancy B', self.manager.execute(self.funcB)) - self.assertEquals('fancy C', self.manager.execute(self.funcC)) - - def testBadHookModule(self): - """Tests a hook module that's bad and throws exception on load.""" - self.write_hook('my_hook.py',"""raise Exception('Doh')""") - self.assertRaises( - Exception, - self.load_hooks) - - def testIncompleteHook(self): - """Tests that an incomplete hook implementation will die on execute.""" - self.write_hook('my_hook1.py',""" -class MyHook(Hook): - def inspect(self, args, kwargs): - return True -register(funcA, MyHook()) -""") - self.load_hooks() - self.assertRaises( - AssertionError, - self.manager.execute, - self.funcA) - - def testHookModuleOrdering(self): - """Tests that hook modules are loaded and applied in order.""" - self.write_hook('my_hook1.py',""" -class MyHook(Hook): - def inspect(self, args, kwargs): - args[0].append(1) - return False -register(funcA, MyHook()) -""") - self.write_hook('my_hook2.py',""" -class MyHook(Hook): - def inspect(self, args, kwargs): - args[0].append(2) - return False -register(funcA, MyHook()) -""") - self.write_hook('my_hook3.py',""" -class MyHook(Hook): - def inspect(self, args, kwargs): - return True - def __call__(self, *args, **kwargs): - return 'peanuts' -register(funcA, MyHook()) -""") - self.load_hooks() - value_list = [5] - self.assertEquals('peanuts', self.manager.execute(self.funcA, value_list)) - self.assertEquals([5, 1, 2], value_list) - - def testHookBadRegistration(self): - """Tests when registering a hook for an unknown callable.""" - self.write_hook('my_hook1.py',""" -class MyHook(Hook): - def inspect(self, args, kwargs): - return False -register(lambda: None, MyHook()) -""") - self.assertRaises( - main.InvalidHookError, - self.load_hooks) - - def testMultipleRegistration(self): - """Tests that the first hook is called when two are registered.""" - self.write_hook('my_hook.py',""" -class MyHook(Hook): - def __init__(self, value): - self.value = value - def inspect(self, args, kwargs): - args[0].append(self.value) - return True - def __call__(self, *args, **kwargs): - return self.value -register(funcA, MyHook('fancy first')) -register(funcA, MyHook('fancy second')) -""") - self.load_hooks() - value_list = ['hello'] - self.assertEquals('fancy first', - self.manager.execute(self.funcA, value_list)) - self.assertEquals(['hello', 'fancy first', 'fancy second'], value_list) - -################################################################################ - -if __name__ == '__main__': - dos.DISABLE_FOR_TESTING = True - unittest.main() diff --git a/hub/mapreduce.yaml b/hub/mapreduce.yaml deleted file mode 100644 index b2b86f9..0000000 --- a/hub/mapreduce.yaml +++ /dev/null @@ -1,44 +0,0 @@ -mapreduce: -- name: Cleanup old EventToDeliver instances - mapper: - input_reader: mapreduce.input_readers.DatastoreInputReader - handler: offline_jobs.CleanupOldEventToDeliver.run - params: - - name: entity_kind - default: main.EventToDeliver - - name: shard_count - default: 32 - - name: processing_rate - default: 100000 - - name: age_days - default: 14 - params_validator: offline_jobs.CleanupOldEventToDeliver.validate_params -- name: Reconfirm expiring subscriptions - mapper: - input_reader: mapreduce.input_readers.DatastoreInputReader - handler: offline_jobs.SubscriptionReconfirmMapper.run - params: - - name: entity_kind - default: main.Subscription - - name: shard_count - default: 32 - - name: processing_rate - default: 100000 - - name: threshold_timestamp - params_validator: offline_jobs.SubscriptionReconfirmMapper.validate_params -- name: Count subscribers by topic and callback pattern - mapper: - input_reader: mapreduce.input_readers.DatastoreInputReader - handler: offline_jobs.CountSubscribers.run - params: - - name: entity_kind - default: main.Subscription - - name: shard_count - default: 128 - - name: processing_rate - default: 1000000 - - name: topic_pattern - default: http(s)?://.* - - name: callback_pattern - default: http(?:s)?://(?:[^\\.]+\\.)*([^\\./]+\.[^\\./]+)(?:/.*)? - params_validator: offline_jobs.CountSubscribers.validate_params diff --git a/hub/offline_jobs.py b/hub/offline_jobs.py deleted file mode 100644 index ab0610d..0000000 --- a/hub/offline_jobs.py +++ /dev/null @@ -1,147 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2010 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Offline cleanup and analysis jobs used with the hub.""" - -import datetime -import logging -import math -import re -import time - -from google.appengine.ext import db - -import main - -from mapreduce import context -from mapreduce import input_readers -from mapreduce import mapreduce_pipeline -from mapreduce import operation as op -from mapreduce import util - - -class CleanupOldEventToDeliver(object): - """Removes EventToDeliver instances older than a certain value.""" - - @staticmethod - def validate_params(params): - assert 'age_days' in params - params['oldest_last_modified'] = ( - time.time() - (86400 * int(params['age_days']))) - - def __init__(self): - self.oldest_last_modified = None - - def run(self, event): - if not self.oldest_last_modified: - params = context.get().mapreduce_spec.mapper.params - self.oldest_last_modified = datetime.datetime.utcfromtimestamp( - params['oldest_last_modified']) - - if event.last_modified < self.oldest_last_modified: - yield op.db.Delete(event) - - -class CountSubscribers(object): - """Mapper counts active subscribers to a feed pattern by domain. - - Args: - topic_pattern: Fully-matching regular expression pattern for topics to - include in the count. - callback_pattern: Full-matching regular expression pattern for callback - URLs, where the first group is used as the aggregation key for counters. - """ - - @staticmethod - def validate_params(params): - topic_pattern = params['topic_pattern'] - assert topic_pattern and re.compile(topic_pattern) - callback_pattern = params['callback_pattern'] - assert callback_pattern and re.compile(callback_pattern) - - def __init__(self): - self.topic_pattern = None - self.callback_pattern = None - - def run(self, subscription): - if self.topic_pattern is None: - params = context.get().mapreduce_spec.mapper.params - self.topic_pattern = re.compile(params['topic_pattern']) - self.callback_pattern = re.compile(params['callback_pattern']) - - if self.topic_pattern.match(subscription.topic): - the_match = self.callback_pattern.match(subscription.callback) - if (the_match and - subscription.subscription_state == main.Subscription.STATE_VERIFIED): - yield op.counters.Increment(the_match.group(1)) - elif the_match: - yield op.counters.Increment('matched but inactive') - - -class SubscriptionReconfirmMapper(object): - """For reconfirming subscriptions that are nearing expiration.""" - - @staticmethod - def validate_params(params): - assert 'threshold_timestamp' in params - - def __init__(self): - self.threshold_timestamp = None - - def run(self, sub): - if sub.subscription_state != main.Subscription.STATE_VERIFIED: - return - - if self.threshold_timestamp is None: - params = context.get().mapreduce_spec.mapper.params - self.threshold_timestamp = datetime.datetime.utcfromtimestamp( - float(params['threshold_timestamp'])) - - if sub.expiration_time < self.threshold_timestamp: - sub.request_insert(sub.callback, sub.topic, sub.verify_token, - sub.secret, auto_reconfirm=True) - - -def count_subscriptions_for_topic(subscription): - """Counts a Subscription instance if it's still active.""" - print subscription.subscription_state - if subscription.subscription_state == main.Subscription.STATE_VERIFIED: - yield (subscription.topic_hash, '1') - - -def save_subscription_counts_for_topic(topic_hash, counts): - """Sums subscriptions to a topic and saves a corresponding KnownFeedStat.""" - total_count = len(counts) - entity = main.KnownFeedStats( - key=main.KnownFeedStats.create_key(topic_hash=topic_hash), - subscriber_count=total_count) - yield op.db.Put(entity) - - -def start_count_subscriptions(): - """Kicks off the MapReduce for determining and saving subscription counts.""" - job = mapreduce_pipeline.MapreducePipeline( - 'Count subscriptions', - 'offline_jobs.count_subscriptions_for_topic', - 'offline_jobs.save_subscription_counts_for_topic', - 'mapreduce.input_readers.DatastoreInputReader', - mapper_params=dict(entity_kind='main.Subscription'), - shards=4) - # TODO(bslatkin): Pass through the queue name to run the job on. This is - # a limitation in the mapper library. - job.start() - return job.pipeline_id diff --git a/hub/offline_jobs_test.py b/hub/offline_jobs_test.py deleted file mode 100755 index 98916a8..0000000 --- a/hub/offline_jobs_test.py +++ /dev/null @@ -1,287 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2010 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Tests for the offline_jobs module.""" - -import datetime -import logging -logging.basicConfig(format='%(levelname)-8s %(filename)s] %(message)s') -import re -import time -import unittest - -import testutil -testutil.fix_path() - -from google.appengine.ext import db - -from mapreduce import context -from mapreduce.lib import key_range - -import main -import offline_jobs - -################################################################################ - -Subscription = main.Subscription - - -class SubscriptionReconfirmMapperTest(unittest.TestCase): - """Tests for the SubscriptionReconfirmMapper.""" - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - self.mapper = offline_jobs.SubscriptionReconfirmMapper() - self.callback = 'http://example.com/my-callback-url' - self.topic = 'http://example.com/my-topic-url' - self.token = 'token' - self.secret = 'my secrat' - - self.now = datetime.datetime.utcnow() - self.threshold_seconds = 1000 - self.threshold_timestamp = ( - time.mktime(self.now.utctimetuple()) + self.threshold_seconds) - self.getnow = lambda: self.now - - class FakeMapper(object): - params = {'threshold_timestamp': str(self.threshold_timestamp)} - class FakeSpec(object): - mapreduce_id = '1234' - mapper = FakeMapper() - self.context = context.Context(FakeSpec(), None) - context.Context._set(self.context) - - def get_subscription(self): - """Returns the Subscription used for testing.""" - return Subscription.get_by_key_name( - Subscription.create_key_name(self.callback, self.topic)) - - def testValidateParams(self): - """Tests the validate_params static method.""" - self.assertRaises( - AssertionError, - offline_jobs.SubscriptionReconfirmMapper.validate_params, - {}) - offline_jobs.SubscriptionReconfirmMapper.validate_params( - {'threshold_timestamp': 123}) - - def testIgnoreUnverified(self): - """Tests that unverified subscriptions are skipped.""" - self.assertTrue(Subscription.request_insert( - self.callback, self.topic, self.token, self.secret, - now=self.getnow)) - sub = self.get_subscription() - self.mapper.run(sub) - testutil.get_tasks(main.POLLING_QUEUE, expected_count=0) - - def testAfterThreshold(self): - """Tests when a subscription is not yet ready for reconfirmation.""" - self.assertTrue(Subscription.insert( - self.callback, self.topic, self.token, self.secret, - now=self.getnow, lease_seconds=self.threshold_seconds)) - sub = self.get_subscription() - self.mapper.run(sub) - testutil.get_tasks(main.POLLING_QUEUE, expected_count=0) - - def testBeforeThreshold(self): - """Tests when a subscription is ready for reconfirmation.""" - self.assertTrue(Subscription.insert( - self.callback, self.topic, self.token, self.secret, - now=self.getnow, lease_seconds=self.threshold_seconds-1)) - sub = self.get_subscription() - self.mapper.run(sub) - task = testutil.get_tasks(main.POLLING_QUEUE, index=0, expected_count=1) - self.assertEquals('polling', task['headers']['X-AppEngine-QueueName']) - -################################################################################ - -class CountSubscribersTest(unittest.TestCase): - """Tests for the CountSubscribers job.""" - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - self.mapper = offline_jobs.CountSubscribers() - self.callback = 'http://foo.callback-example.com/my-callback-url' - self.topic = 'http://example.com/my-topic-url' - self.token = 'token' - self.secret = 'my secrat' - # Do not make these raw strings on purpose, since they will get - # passed through escaped in the mapreduce.yaml. - self.topic_pattern = '^http://example\\.com/.*$' - self.callback_pattern = ( - 'http(?:s)?://(?:[^\\.]+\\.)*([^\\./]+\.[^\\./]+)(?:/.*)?') - - class FakeMapper(object): - params = { - 'topic_pattern': self.topic_pattern, - 'callback_pattern': self.callback_pattern, - } - class FakeSpec(object): - mapreduce_id = '1234' - mapper = FakeMapper() - self.context = context.Context(FakeSpec(), None) - context.Context._set(self.context) - - def get_subscription(self): - """Returns the Subscription used for testing.""" - self.assertTrue(Subscription.insert( - self.callback, self.topic, self.token, self.secret)) - return Subscription.get_by_key_name( - Subscription.create_key_name(self.callback, self.topic)) - - def testExpressions(self): - """Tests the default expressions we're going to use for callbacks.""" - callback_re = re.compile(self.callback_pattern) - self.assertEquals( - 'blah.com', - callback_re.match('http://foo.blah.com/stuff').group(1)) - self.assertEquals( - 'blah.com', - callback_re.match('http://blah.com/stuff').group(1)) - self.assertEquals( - 'blah.com', - callback_re.match('http://one.two.three.blah.com/stuff').group(1)) - self.assertEquals( - 'blah.com', - callback_re.match('http://no-ending.blah.com').group(1)) - self.assertEquals( - 'example.com', - callback_re.match('https://fun.with.https.example.com/').group(1)) - - def testValidateParams(self): - """Tests the validate_params function.""" - self.assertRaises( - KeyError, - offline_jobs.CountSubscribers.validate_params, - {}) - self.assertRaises( - AssertionError, - offline_jobs.CountSubscribers.validate_params, - {'topic_pattern': ''}) - self.assertRaises( - re.error, - offline_jobs.CountSubscribers.validate_params, - {'topic_pattern': 'this is bad('}) - self.assertRaises( - KeyError, - offline_jobs.CountSubscribers.validate_params, - {'topic_pattern': 'okay'}) - self.assertRaises( - AssertionError, - offline_jobs.CountSubscribers.validate_params, - {'topic_pattern': 'okay', 'callback_pattern': ''}) - self.assertRaises( - re.error, - offline_jobs.CountSubscribers.validate_params, - {'topic_pattern': 'okay', 'callback_pattern': 'this is bad('}) - offline_jobs.CountSubscribers.validate_params( - {'topic_pattern': 'okay', 'callback_pattern': 'and okay'}) - - def testTopicMatch_CallbackMatch(self): - """Tests when the topic and callbacks match.""" - sub = self.get_subscription() - gen = self.mapper.run(sub) - counter = gen.next() - self.assertEquals('callback-example.com', counter.counter_name) - self.assertEquals(1, counter.delta) - self.assertRaises(StopIteration, gen.next) - - def testTopicMatch_CallbackMatch_Inactive(self): - """Tests when the subscription matches but is inactive.""" - sub = self.get_subscription() - sub.subscription_state = Subscription.STATE_NOT_VERIFIED - sub.put() - gen = self.mapper.run(sub) - counter = gen.next() - self.assertEquals('matched but inactive', counter.counter_name) - self.assertEquals(1, counter.delta) - self.assertRaises(StopIteration, gen.next) - - def testTopicMatch_CallbackNoMatch(self): - """Tests when the topic matches but the callback does not.""" - self.callback = 'some garbage' - sub = self.get_subscription() - gen = self.mapper.run(sub) - self.assertRaises(StopIteration, gen.next) - - def testTopicNoMatch(self): - """Tests when the topic does not match.""" - self.topic = 'http://does-not-match.com' - sub = self.get_subscription() - gen = self.mapper.run(sub) - self.assertRaises(StopIteration, gen.next) - -################################################################################ - -class SaveSubscriptionCountsTest(unittest.TestCase): - """Tests for the MapReduce that saves subscription counts.""" - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - self.callback = 'http://foo.callback-example.com/my-callback-url' - self.topic = 'http://example.com/my-topic-url' - self.token = 'token' - self.secret = 'my secrat' - - def testMap(self): - """Tests the mapper function.""" - self.assertTrue(Subscription.insert( - self.callback, self.topic, self.token, self.secret)) - sub = Subscription.get_by_key_name( - Subscription.create_key_name(self.callback, self.topic)) - - # Active subscription. - it = offline_jobs.count_subscriptions_for_topic(sub) - self.assertEquals(('95ff66c343530c88a750cbc7fd1e0bbd8cc7bce2', '1'), - it.next()) - self.assertRaises(StopIteration, it.next) - - # Not active - Subscription.archive(self.callback, self.topic) - sub = db.get(sub.key()) - it = offline_jobs.count_subscriptions_for_topic(sub) - self.assertRaises(StopIteration, it.next) - - def testReduce(self): - """Tests the reducer function.""" - self.assertEquals(0, len(list(main.KnownFeedStats.all()))) - it = offline_jobs.save_subscription_counts_for_topic( - '95ff66c343530c88a750cbc7fd1e0bbd8cc7bce2', - ['1'] * 321) - op = it.next() - self.assertEquals( - db.Key.from_path( - 'KnownFeed', '95ff66c343530c88a750cbc7fd1e0bbd8cc7bce2', - 'KnownFeedStats', 'overall'), - op.entity.key()) - self.assertEquals(321, op.entity.subscriber_count) - self.assertRaises(StopIteration, it.next) - - def testStart(self): - """Tests starting the mapreduce job.""" - job_id = offline_jobs.start_count_subscriptions() - self.assertTrue(job_id is not None) - task = testutil.get_tasks('default', expected_count=1, index=0) - self.assertEquals('/mapreduce/pipeline/run', task['url']) - -################################################################################ - -if __name__ == '__main__': - unittest.main() diff --git a/hub/publish_debug.html b/hub/publish_debug.html deleted file mode 100644 index 6f2b3cf..0000000 --- a/hub/publish_debug.html +++ /dev/null @@ -1,38 +0,0 @@ - - - Hub - Publisher debug - - - - - -

Publish

- -
- -

- - -

-

-
-Note: submission will result in a HTTP 204 response to acknowledge; in browsers this looks like a no-op - -

Publisher Diagnostics

- -Retrieve details about a topic URL. -
-

- - -

-

-
-Note: This hub ignores publisher notifications about feeds with no -subscribers. If you are trying to test that your publisher works correctly, -you may want to use the Subscription page to subscribe -the example subscriber -app to your feed. - - - diff --git a/hub/queue.yaml b/hub/queue.yaml deleted file mode 100644 index 6f29ad5..0000000 --- a/hub/queue.yaml +++ /dev/null @@ -1,19 +0,0 @@ -queue: -- name: subscriptions - rate: 1/s -- name: polling - rate: 1/s -- name: feed-pulls - rate: 5/s -- name: feed-pulls-retries - rate: 1/s -- name: event-delivery - rate: 5/s -- name: event-delivery-retries - rate: 1/s -- name: mappings - rate: 1/s -- name: mapreduce - rate: 2/s -- name: default - rate: 0/s diff --git a/hub/remote_shell.py b/hub/remote_shell.py deleted file mode 100755 index 2e89b59..0000000 --- a/hub/remote_shell.py +++ /dev/null @@ -1,47 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -import testutil -testutil.fix_path() - -from main import * - -import code -import getpass -import sys - -from google.appengine.ext.remote_api import remote_api_stub -from google.appengine.ext import db - -def auth_func(): - return raw_input('Username:'), getpass.getpass('Password:') - -if len(sys.argv) > 3: - print "Usage: %s [app_id] [host]" % (sys.argv[0],) - sys.exit(1) - -app_id = 'pubsubhubbub' -if len(sys.argv) >= 2: - app_id = sys.argv[1] - -host = '%s.appspot.com' % app_id -if len(sys.argv) == 3: - host = sys.argv[2] - -remote_api_stub.ConfigureRemoteDatastore(app_id, '/remote_api', auth_func, host) - -code.interact('App Engine interactive console for %s' % app_id, None, locals()) diff --git a/hub/run_tests.sh b/hub/run_tests.sh deleted file mode 100755 index 5a0f4a3..0000000 --- a/hub/run_tests.sh +++ /dev/null @@ -1,11 +0,0 @@ -#!/bin/bash - -for test_file in $(ls *_test.py ../nonstandard/*_test.py) -do - echo -e "========== Running $test_file" - ./$test_file - if [ "$?" -ne "0" ]; then - echo "Died in $test_file" - exit 1 - fi -done diff --git a/hub/stats_table.html b/hub/stats_table.html deleted file mode 100644 index ef280bf..0000000 --- a/hub/stats_table.html +++ /dev/null @@ -1,33 +0,0 @@ -
-

{{result.title}}

-
- Sample window: {{result.time_elapsed|floatformat:"0"}} seconds - {% if show_everything %} - Total samples: {{result.total_samples}} - Unique keys: {{result.unique_samples}} - Overall rate: {{result.overall_rate|floatformat:"-4"}}/sec - {% endif %} -
-{% if result.unique_samples %} - - - - - - - - - - {% for sample in result.sample_objects|dictsortreversed:"frequency"|slice:":40" %} - - - - - - - - - {% endfor %} -
{{result.key_name}}SamplesFrequencyMinMaxAverage
{{sample.key|escape}}{{sample.count}}{{sample.frequency|floatformat:"-2"}}/sec{{sample.min|floatformat:"-2"}}{{sample.max|floatformat:"-2"}}{{sample.average|floatformat:"-2"}} {{result.value_units}}
-{% endif %} -
diff --git a/hub/subscribe_debug.html b/hub/subscribe_debug.html deleted file mode 100644 index 8276396..0000000 --- a/hub/subscribe_debug.html +++ /dev/null @@ -1,68 +0,0 @@ - - - Hub - Subscription debug - - - - - -

Subscribe/Unsubscribe

- -Create a new subscription. -
-

- - -

-

- - -

-

- - -

-

- - -

-

- - -

-

- - -

-

-
-Note: submission will result in a HTTP 204 response to acknowledge; in browsers this looks like a no-op - -

Subscriber Diagnostics

- -Retrieve details about a subscription. -
-

- - -

-

- - -

-

- - -

- -

-
- - - diff --git a/hub/testutil.py b/hub/testutil.py deleted file mode 100644 index 2d47047..0000000 --- a/hub/testutil.py +++ /dev/null @@ -1,283 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Utilities common to all tests.""" - -import StringIO -import base64 -import cgi -import logging -import os -import sys -import tempfile -import unittest -import urllib - - -TEST_APP_ID = 'my-app-id' -TEST_VERSION_ID = 'my-version.1234' - -# Assign the application ID up front here so we can create db.Key instances -# before doing any other test setup. -os.environ['APPLICATION_ID'] = TEST_APP_ID -os.environ['CURRENT_VERSION_ID'] = TEST_VERSION_ID - - -def fix_path(): - """Finds the google_appengine directory and fixes Python imports to use it.""" - all_paths = os.environ.get('PATH').split(os.pathsep) - for path_dir in all_paths: - dev_appserver_path = os.path.join(path_dir, 'dev_appserver.py') - if os.path.exists(dev_appserver_path): - google_appengine = os.path.dirname(os.path.realpath(dev_appserver_path)) - sys.path.append(google_appengine) - # Use the next import will fix up sys.path even further to bring in - # any dependent lib directories that the SDK needs. - dev_appserver = __import__('dev_appserver') - sys.path.extend(dev_appserver.EXTRA_PATHS) - return - - -def setup_for_testing(require_indexes=True): - """Sets up the stubs for testing. - - Args: - require_indexes: True if indexes should be required for all indexes. - """ - from google.appengine.api import apiproxy_stub_map - from google.appengine.api import memcache - from google.appengine.tools import dev_appserver - from google.appengine.tools import dev_appserver_index - import urlfetch_test_stub - before_level = logging.getLogger().getEffectiveLevel() - try: - logging.getLogger().setLevel(100) - root_path = os.path.realpath(os.path.dirname(__file__)) - dev_appserver.SetupStubs( - TEST_APP_ID, - root_path=root_path, - login_url='', - datastore_path=tempfile.mktemp(suffix='datastore_stub'), - history_path=tempfile.mktemp(suffix='datastore_history'), - blobstore_path=tempfile.mktemp(suffix='blobstore_stub'), - require_indexes=require_indexes, - clear_datastore=False) - dev_appserver_index.SetupIndexes(TEST_APP_ID, root_path) - apiproxy_stub_map.apiproxy._APIProxyStubMap__stub_map['urlfetch'] = \ - urlfetch_test_stub.instance - # Actually need to flush, even though we've reallocated. Maybe because the - # memcache stub's cache is at the module level, not the API stub? - memcache.flush_all() - finally: - logging.getLogger().setLevel(before_level) - - -def create_test_request(method, body, *params): - """Creates a webapp.Request object for use in testing. - - Args: - method: Method to use for the test. - body: The body to use for the request; implies that *params is empty. - *params: List of (key, value) tuples to use in the post-body or query - string of the request. - - Returns: - A new webapp.Request object for testing. - """ - assert not(body and params), 'Must specify body or params, not both' - from google.appengine.ext import webapp - - if body: - body = StringIO.StringIO(body) - encoded_params = '' - else: - encoded_params = urllib.urlencode(params) - body = StringIO.StringIO() - body.write(encoded_params) - body.seek(0) - - environ = os.environ.copy() - environ.update({ - 'QUERY_STRING': '', - 'wsgi.input': body, - }) - if method.lower() == 'get': - environ['REQUEST_METHOD'] = method.upper() - environ['QUERY_STRING'] = encoded_params - else: - environ['REQUEST_METHOD'] = method.upper() - environ['CONTENT_TYPE'] = 'application/x-www-form-urlencoded' - environ['CONTENT_LENGTH'] = str(len(body.getvalue())) - return webapp.Request(environ) - - -class HandlerTestBase(unittest.TestCase): - """Base-class for webapp.RequestHandler tests.""" - - # Set to the class being tested. - handler_class = None - - def setUp(self): - """Sets up the test harness.""" - setup_for_testing() - - def tearDown(self): - """Tears down the test harness.""" - pass - - def handle(self, method, *params): - """Runs a test of a webapp.RequestHandler. - - Args: - method: The method to invoke for this test. - *params: Passed to testutil.create_test_request - """ - from google.appengine.ext import webapp - before_software = os.environ.get('SERVER_SOFTWARE') - before_auth_domain = os.environ.get('AUTH_DOMAIN') - before_email = os.environ.get('USER_EMAIL') - - os.environ['wsgi.url_scheme'] = 'http' - os.environ['SERVER_NAME'] = 'example.com' - os.environ['SERVER_PORT'] = '' - try: - if not before_software: - os.environ['SERVER_SOFTWARE'] = 'Development/1.0' - if not before_auth_domain: - os.environ['AUTH_DOMAIN'] = 'example.com' - if not before_email: - os.environ['USER_EMAIL'] = '' - self.resp = webapp.Response() - self.req = create_test_request(method, None, *params) - handler = self.handler_class() - handler.initialize(self.req, self.resp) - getattr(handler, method.lower())() - logging.info('%r returned status %d: %s', self.handler_class, - self.response_code(), self.response_body()) - finally: - del os.environ['SERVER_SOFTWARE'] - del os.environ['AUTH_DOMAIN'] - del os.environ['USER_EMAIL'] - - def handle_body(self, method, body): - """Runs a test of a webapp.RequestHandler with a POST body. - - Args: - method: The HTTP method to invoke for this test. - body: The body payload bytes. - """ - from google.appengine.ext import webapp - before_software = os.environ.get('SERVER_SOFTWARE') - before_auth_domain = os.environ.get('AUTH_DOMAIN') - before_email = os.environ.get('USER_EMAIL') - - os.environ['wsgi.url_scheme'] = 'http' - os.environ['SERVER_NAME'] = 'example.com' - os.environ['SERVER_PORT'] = '' - try: - if not before_software: - os.environ['SERVER_SOFTWARE'] = 'Development/1.0' - if not before_auth_domain: - os.environ['AUTH_DOMAIN'] = 'example.com' - if not before_email: - os.environ['USER_EMAIL'] = '' - self.resp = webapp.Response() - self.req = create_test_request(method, body) - handler = self.handler_class() - handler.initialize(self.req, self.resp) - getattr(handler, method.lower())() - logging.info('%r returned status %d: %s', self.handler_class, - self.response_code(), self.response_body()) - finally: - del os.environ['SERVER_SOFTWARE'] - del os.environ['AUTH_DOMAIN'] - del os.environ['USER_EMAIL'] - - def response_body(self): - """Returns the response body after the request is handled.""" - return self.resp.out.getvalue() - - def response_code(self): - """Returns the response code after the request is handled.""" - return self.resp._Response__status[0] - - def response_headers(self): - """Returns the response headers after the request is handled.""" - return self.resp.headers - - -def get_tasks(queue_name, index=None, expected_count=None, usec_eta=False): - """Retrieves Tasks from the supplied named queue. - - Args: - queue_name: The queue to access. - index: Index of the task (ordered by ETA) to retrieve from the queue. - expected_count: If not None, the number of tasks expected to be in the - queue. This function will raise an AssertionError exception if there are - more or fewer tasks. - usec_eta: If ETAs should be formatted as microseconds since the UNIX epoch. - When False, the ETA will be rendered as a string. - - Returns: - List of dictionaries corresponding to each task, with the keys: 'name', - 'url', 'method', 'eta', 'body', 'headers', 'params'. The 'params' - value will only be present if the body's Content-Type header is - 'application/x-www-form-urlencoded'. - """ - from google.appengine.api import apiproxy_stub_map - stub = apiproxy_stub_map.apiproxy.GetStub('taskqueue') - - # Gross hack to modify the stub's module-level function to pass through ETAs. - if usec_eta: - stub_globals = stub.GetTasks.func_globals - old_format = stub_globals['_FormatEta'] - # TODO: Taskqueue stub should have more resolution! This will only be - # accurate to the nearest whole second. - stub_globals['_FormatEta'] = lambda x: x - try: - tasks = stub.GetTasks(queue_name) - finally: - if usec_eta: - stub_globals['_FormatEta'] = old_format - - if expected_count is not None: - assert len(tasks) == expected_count, 'found %s == %s' % ( - len(tasks), expected_count) - for task in tasks: - del task['eta_delta'] - task['body'] = base64.b64decode(task['body']) - # Convert headers list into a dictionary-- we don't care about repeats - task['headers'] = dict(task['headers']) - if ('application/x-www-form-urlencoded' in - task['headers'].get('content-type', '')): - task['params'] = dict(cgi.parse_qsl(task['body'], True)) - if index is not None: - return tasks[index] - else: - return tasks - - -def task_eta(eta): - """Converts a datetime.datetime into a taskqueue ETA. - - Args: - eta: Naive datetime.datetime of the task's ETA. - - Returns: - The ETA formatted as a string. - """ - return eta.strftime('%Y/%m/%d %H:%M:%S') diff --git a/hub/topic_details.html b/hub/topic_details.html deleted file mode 100644 index 2152bc1..0000000 --- a/hub/topic_details.html +++ /dev/null @@ -1,88 +0,0 @@ - - - Hub - Topic Details - {{topic_url|escape}} - - - - - -

Topic Details - {{topic_url|escape}}

- -{% if error %} -
{{error|escape}}
-{% else %} - - {% if next_fetch %} - - - - - - - - - - - - - {% endif %} - - - - - - - - - - - - - - - - - {% if subscriber_count %} - - - - - - - - - {% endif %} - - - - - - - - -
Next fetch time (UTC):{{next_fetch|date:"Y-m-d\TH:i:s\Z"}}
Current fetch attempts:{{fetch_attempts}}
All attempts failed{{totally_failed}}
Last successful fetch (UTC):{{last_successful_fetch|date:"Y-m-d\TH:i:s\Z"}}
Last Content-Type:{{last_content_type|escape}}
Last ETag:{{last_etag|escape}}
Last Modified:{{last_modified|escape}}
Active subscribers:{{subscriber_count}}
Last count (UTC):{{feed_stats_update_time|date:"Y-m-d\TH:i:s\Z"}}
Fetch from domain: - {% if fetch_blocked %} - BLOCKED - {% else %} - OK - {% endif %} -
Fetch short-term:{{fetch_errors|floatformat:"-2"}}% errors for domain
- -

Error rate statistics

-{% for result in fetch_url_error %} - {% include "stats_table.html" %} -{% endfor %} - -

Latency statistics

-{% for result in fetch_url_latency %} - {% include "stats_table.html" %} -{% endfor %} - -

Last feed envelope retrieved:

-
-{{last_header_footer|escape}}
-
-{% endif %} - - - diff --git a/hub/urlfetch_async.py b/hub/urlfetch_async.py deleted file mode 100644 index 6e83bbd..0000000 --- a/hub/urlfetch_async.py +++ /dev/null @@ -1,137 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2008 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -from google.appengine.api import urlfetch -from google.appengine.api import apiproxy_stub_map -from google.appengine.api import urlfetch_service_pb -from google.appengine.runtime import apiproxy_errors - - -def fetch(url, payload=None, method=urlfetch.GET, headers={}, - allow_truncated=False, follow_redirects=True, - callback=None, async_proxy=None, - deadline=5): - """Fetches the given HTTP URL, blocking until the result is returned. - - Other optional parameters are: - method: GET, POST, HEAD, PUT, or DELETE - payload: POST or PUT payload (implies method is not GET, HEAD, or DELETE) - headers: dictionary of HTTP headers to send with the request - allow_truncated: if true, truncate large responses and return them without - error. otherwise, ResponseTooLargeError will be thrown when a response is - truncated. - follow_redirects: Whether or not redirects should be followed. - callback: Callable that takes (_URLFetchResult, URLFetchException). - Exactly one of the two arguments is None. Required if async_proxy is - not None. - async_proxy: If not None, instance of AsyncAPIProxy to use for executing - asynchronous API calls. - deadline: How long to allow the request to wait, in seconds. Defaults - to 5 seconds. - - We use a HTTP/1.1 compliant proxy to fetch the result. - - The returned data structure has the following fields: - content: string containing the response from the server - status_code: HTTP status code returned by the server - headers: dictionary of headers returned by the server - - If the URL is an empty string or obviously invalid, we throw an - urlfetch.InvalidURLError. If the server cannot be contacted, we throw a - urlfetch.DownloadError. Note that HTTP errors are returned as a part - of the returned structure, so HTTP errors like 404 do not result in an - exception. - """ - request = urlfetch_service_pb.URLFetchRequest() - response = urlfetch_service_pb.URLFetchResponse() - request.set_url(url) - - if isinstance(method, basestring): - method = method.upper() - method = urlfetch._URL_STRING_MAP.get(method, method) - if method not in urlfetch._VALID_METHODS: - raise InvalidMethodError('Invalid method %s.' % str(method)) - if method == urlfetch.GET: - request.set_method(urlfetch_service_pb.URLFetchRequest.GET) - elif method == urlfetch.POST: - request.set_method(urlfetch_service_pb.URLFetchRequest.POST) - elif method == urlfetch.HEAD: - request.set_method(urlfetch_service_pb.URLFetchRequest.HEAD) - elif method == urlfetch.PUT: - request.set_method(urlfetch_service_pb.URLFetchRequest.PUT) - elif method == urlfetch.DELETE: - request.set_method(urlfetch_service_pb.URLFetchRequest.DELETE) - - request.set_followredirects(follow_redirects) - - if payload and (method == urlfetch.POST or method == urlfetch.PUT): - request.set_payload(payload) - - for key, value in headers.iteritems(): - header_proto = request.add_header() - header_proto.set_key(key) - header_proto.set_value(value) - - if async_proxy: - def completion_callback(response, urlfetch_exception): - result, user_exception = HandleResult(response, urlfetch_exception, - allow_truncated) - callback(result, user_exception) - async_proxy.start_call('urlfetch', 'Fetch', request, response, - completion_callback, deadline=deadline) - return - - user_exception = None - try: - apiproxy_stub_map.MakeSyncCall('urlfetch', 'Fetch', request, response) - except apiproxy_errors.ApplicationError, e: - user_exception = e - - result, user_exception = HandleResult( - response, user_exception, allow_truncated) - if user_exception: - raise user_exception - else: - return result - - -def HandleResult(response, urlfetch_exception, allow_truncated): - """Returns (result, user_exception) to return from a fetch() call.""" - result = None - user_exception = None - - if urlfetch_exception: - user_exception = urlfetch_exception - if hasattr(urlfetch_exception, 'application_error'): - if (urlfetch_exception.application_error == - urlfetch_service_pb.URLFetchServiceError.INVALID_URL): - user_exception = urlfetch.InvalidURLError(str(urlfetch_exception)) - elif (urlfetch_exception.application_error == - urlfetch_service_pb.URLFetchServiceError.UNSPECIFIED_ERROR): - user_exception = urlfetch.DownloadError(str(urlfetch_exception)) - elif (urlfetch_exception.application_error == - urlfetch_service_pb.URLFetchServiceError.FETCH_ERROR): - user_exception = urlfetch.DownloadError(str(urlfetch_exception)) - elif (urlfetch_exception.application_error == - urlfetch_service_pb.URLFetchServiceError.RESPONSE_TOO_LARGE): - user_exception = urlfetch.ResponseTooLargeError(None) - else: - result = urlfetch._URLFetchResult(response) - if not allow_truncated and response.contentwastruncated(): - user_exception = urlfetch.ResponseTooLargeError(result) - - return result, user_exception diff --git a/hub/urlfetch_test_stub.py b/hub/urlfetch_test_stub.py deleted file mode 100644 index ea04993..0000000 --- a/hub/urlfetch_test_stub.py +++ /dev/null @@ -1,139 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""URLFetchServiceStub implementation that returns mock values.""" - -import logging - -from google.appengine import runtime -from google.appengine.api import apiproxy_stub -from google.appengine.api import urlfetch_service_pb -from google.appengine.api import urlfetch_stub -from google.appengine.runtime import apiproxy_errors - - -class URLFetchServiceTestStub(urlfetch_stub.URLFetchServiceStub): - """Enables tests to mock calls to the URLFetch service and test inputs.""" - - def __init__(self): - """Initializer.""" - super(URLFetchServiceTestStub, self).__init__() - # Maps (method, url) keys to (request_payload, request_headers, - # response_code, response_data, response_headers, error_instance) - self._expectations = {} - - def clear(self): - """Clears all expectations on this stub.""" - self._expectations.clear() - - def expect(self, method, url, response_code, response_data, - response_headers=None, request_payload='', request_headers=None, - urlfetch_error=False, apiproxy_error=False, deadline_error=False, - urlfetch_size_error=False): - """Expects a certain request and response. - - Overrides any existing expectations for this stub. - - Args: - method: The expected method. - url: The expected URL to access. - response_code: The expected response code. - response_data: The expected response data. - response_headers: Headers to serve back, if any. - request_payload: The expected request payload, if any. - request_headers: Any expected request headers. - urlfetch_size_error: Set to True if this call should raise - a urlfetch_errors.ResponseTooLargeError - urlfetch_error: Set to True if this call should raise a - urlfetch_errors.Error exception when made. - apiproxy_error: Set to True if this call should raise an - apiproxy_errors.Error exception when made. - deadline_error: Set to True if this call should raise a - google.appengine.runtime.DeadlineExceededError error. - """ - error_instance = None - if urlfetch_error: - error_instance = apiproxy_errors.ApplicationError( - urlfetch_service_pb.URLFetchServiceError.FETCH_ERROR, 'mock error') - elif urlfetch_size_error: - error_instance = apiproxy_errors.ApplicationError( - urlfetch_service_pb.URLFetchServiceError.RESPONSE_TOO_LARGE, - 'mock error') - elif apiproxy_error: - error_instance = apiproxy_errors.OverQuotaError() - elif deadline_error: - error_instance = runtime.DeadlineExceededError() - - self._expectations[(method.lower(), url)] = ( - request_payload, request_headers, response_code, - response_data, response_headers, error_instance) - - def verify_and_reset(self): - """Verify that all expectations have been met and clear any remaining.""" - old_expectations = self._expectations - self._expectations = {} - if old_expectations: - assert False, '%d expectations remain: %r' % ( - len(old_expectations), old_expectations) - - def _RetrieveURL(self, url, payload, method, headers, request, - response, follow_redirects=True, deadline=None, - validate_certificate=False): - """Test implementation of retrieving a URL. - - Args: - All override super-class's parameters. - """ - header_dict = dict((h.key(), h.value()) for h in headers) - header_text = None - if headers: - header_text = ', '.join( - '%r="%r"' % (k, v) for (k, v) in header_dict.iteritems()) - logging.info('Received URLFetch request:\n%s %r\nHeaders: %r\nPayload: %r', - method, url, header_text, payload) - - key = (method.lower(), url) - try: - expected = self._expectations.pop(key) - except: - assert False, 'Did not expect: %s %s' % key - - (request_payload, request_headers, response_code, - response_data, response_headers, error_instance) = expected - - if request_payload: - assert payload == request_payload, ( - 'Request payload: "%s" did not match expected: "%s"' % - (request_payload, payload)) - if request_headers: - for key, expected in request_headers.iteritems(): - found = header_dict.get(key) - assert found == expected, ('Value for request header %s was ' - '"%s", expected "%s"' % (key, found, expected)) - if error_instance is not None: - raise error_instance - - response.set_statuscode(response_code) - response.set_content(response_data) - if response_headers: - for key, value in response_headers.iteritems(): - header = response.add_header() - header.set_key(key) - header.set_value(value) - - -instance = URLFetchServiceTestStub() diff --git a/hub/welcome.html b/hub/welcome.html deleted file mode 100644 index 358bb83..0000000 --- a/hub/welcome.html +++ /dev/null @@ -1,56 +0,0 @@ - - - Hub - PubSubHubbub - - - - -

Welcome to the PubSubHubbub reference Hub server!

- -

-PubSubHubbub is a simple, open, web-hook-based pubsub (publish/subscribe) protocol. -

-

-Decentralized and free. Anybody can run a PubSubHubbub server or anybody can use an open server. -

-

-PubSubHubbub is just a protocol, not a service, but we're running this as an open test server for anybody to use to help bootstrap the protocol. Feel free to publish to or subscribe from this hub. You can migrate in the future when you want to run your own hub server, or you can just keep using this one. -

-

-See the project for details. This presentation has an overview: -

- - -

Hub debug

-

From here you can, -

    -
  • Subscribe to a feed or debug your subscriber (with stats!).
    • -
  • Publish a feed or debug your published feeds.
    • -
-

- -
- -

-These legal disclaimers are here because this Hub is run by Google as a service. If you don't want to agree to these terms you should just run your own hub. The PubSubHubbub protocol is decentralized and free. -

- -
-
-©2010 Google - - -Terms of Service - - - - -Privacy Policy - -
-
- Powered by Google App Engine -
-
- - - diff --git a/loadtest/app.yaml b/loadtest/app.yaml deleted file mode 100644 index 3513f02..0000000 --- a/loadtest/app.yaml +++ /dev/null @@ -1,8 +0,0 @@ -application: pubsubhubbub-loadtest -version: 1 -runtime: python -api_version: 1 - -handlers: -- url: .* - script: main.py diff --git a/loadtest/atom.xml b/loadtest/atom.xml deleted file mode 100644 index d9b9328..0000000 --- a/loadtest/atom.xml +++ /dev/null @@ -1,24 +0,0 @@ - - - Random test blog - - - {% now "Y-m-d\TH:i:s\Z" %} - {{self_url}} - - Foobar - - - {% for random_id in all_ids %} - - Random item #{{random_id}} - {{random_id}} - {% now "Y-m-d\TH:i:s\Z" %} - {% now "Y-m-d\TH:i:s\Z" %} - - This is the content for random item #{{random_id}} - - - {% endfor %} - - diff --git a/loadtest/index.yaml b/loadtest/index.yaml deleted file mode 100644 index a3b9e05..0000000 --- a/loadtest/index.yaml +++ /dev/null @@ -1,11 +0,0 @@ -indexes: - -# AUTOGENERATED - -# This index.yaml is automatically updated whenever the dev_appserver -# detects that a new type of query is run. If you want to manage the -# index.yaml file manually, remove the above marker line (the line -# saying "# AUTOGENERATED"). If you want to manage some indexes -# manually, move them above the marker line. The index.yaml file is -# automatically uploaded to the admin console when you next deploy -# your application using appcfg.py. diff --git a/loadtest/main.py b/loadtest/main.py deleted file mode 100755 index 24c3319..0000000 --- a/loadtest/main.py +++ /dev/null @@ -1,63 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Loadtest script that provides a dummy publisher and subscriber. - -Every time a feed is requested from this loadtest publisher, it will produce a -new, random Atom payload. The loadtest app also provides a subscriber interface -that will accept any subscription. All notification messages will be thrown -away; it only keeps a count. -""" - -import random -import wsgiref.handlers -from google.appengine.ext import webapp -from google.appengine.ext.webapp import template - - -class FeedHandler(webapp.RequestHandler): - - def get(self, name): - self.response.headers['Content-Type'] = 'application/xml+atom' - self.response.out.write(template.render('atom.xml', { - 'self_url': self.request.url, - 'all_ids': random.sample(xrange(10**9), 25), - })) - - -class SubscriberHandler(webapp.RequestHandler): - - def get(self, name): - self.response.out.write(self.request.get('hub.challenge')) - self.response.set_status(200) - - def post(self, name): - pass - - -application = webapp.WSGIApplication([ - (r'/feed/(.*)', FeedHandler), - (r'/subscriber/(.*)', SubscriberHandler), -], debug=True) - - -def main(): - wsgiref.handlers.CGIHandler().run(application) - - -if __name__ == '__main__': - main() diff --git a/media/light_pings_bandwidth.png b/media/light_pings_bandwidth.png deleted file mode 100644 index 75c62e428ec27217a74df1b2c5ca470a37e68343..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 24583 zcmbTc^LwLT8?RkWZQDw1+xFD9ZQHiZsqN|1wx^ofw%>f8{qBEY|BxIxawjY6Ub%RF zt|%o1Nd#D2SP&2p1ZgQT6%Y{6-@w;b&|tvlam>e05D-K?D^XD;X;D#PC1(e7D_b)V z5KqwB3=1VS+4gWBb3^E47j*LDTxI7Ot>RFU(I669;$UK8VX@!?Ixz4Ea^lE9=vZQE zWfV1ZP-$ln@LT(b{oF3W-(3Or8kc7lEBd|OkN!SgHlRY=C$SRm1E3)OU;V=7f2}W8 zINB~C96-Qwp;80E9eGNaEPtY*fsY;bwOlWPxW8G8ys)WDpVMwizG_dHSS1{lB(4*E zo6Tiq(LrY;gJdF`7T&%L(o|gBMbIm7(_s_9zk24gOf0Tr?Aaj0{m{y+68!)%W=Rm- z^q*h|@H|NsRVJ)3u>ciPdF}Ro1s7^SY)r1kgZ$AekheOI5poyu!ZFnB?+>cv>wE(0 zOYMrxmj1Cc`49wB>_~4-M;^3eXA7qFZB>$~gBv>TiT?8&jnDyJB z@4MzzkPJDIEAbB#cn5qiVgk_)-fOHY%bfD;3U;g`Xk zl8joN+NpA$x{m73D*00JT=}xmg4wdkyal@UL=Mk$i2Ro|^J5sY$%TyChudc=C zSox~^kp0M4%HT>G8I_8KI+jstbahrvS$9-KP(^u0bbHgRxB<7IR=_$4cZ+eMN+RY6 z`5MO%KN}w%fRAxcnEdH%(8f$TY`&BE$LhUFjD70x&(YQGA<8AHl^tuTU($7QfR4N* z+ziartNdM;Q9(2pPBz*LeaE(dc#S%f{8ztP-%hY?k+XsQ;^n=lX7x1&c$&1uLoiS@pr?3bKQ?KN$!znMhLt*UL`7ue@?Uih13ThnX3 zU!@gP=T#2%5=1sT^sS#dIr5&wU{A4&Kl^J&?sU`-a1${LB1nfqf z08Vk||jRRO%$kpueGjo!{L5AJ&sIQ45Y!8yORPp;oD|5T?eCMkl-LKr&^b1{~F zjh)Tbf7$@fG4bf|WOMv<%694;ct7a-MBDG}JRIv!d~T4o3Tgy710F9eh&&1P`HFe8 z1+I8*xwwNKEP{F?Oi&O!9g?u1RidDy;G_k!J_0nzDJRPI0 zsD*>DpILFr*FG`N`*iS+Lk!)L#B+D&ra!QCg{j%&1g^S z={I~C-mkl_+i&@=?#`irUV>R?xG=m|Vys%VgFbU4SkL0ulV4L4#nxvOr1bd(BK)P9 zqZvcoM~@AD3X;vV>aY$KBftLHW&^LRHjmDHuqtg5%?bfoswIo6U=MLOY%A6UJ@=F4lV{YdSBK)Ri7~i z(5H=}j-z?_^YY8~20h#ddj@pVv*tXqdq}y#8~q)W63XJa4RaU7l5TGpZ*! zXq&3ps&xz`R~ydD@P6d1>salewv~J#{&m`F{k!{ayr71uUZlRRnx}lO#<&!@(z2?uV!leU%)OwunzJ~H!^cv?G{F?l=ETa*p~`gJ zRM^1Pq}!g|$7lUHR6gG}#xS$pFMI{NoF+f2T;YA}nn9e}S{7SXaa-}#6)z)Neo{)(0(*0JGSuRC_eO4-FH%}<_F$fD`aA3O{^#yT zc<{wQBx!{4GU}B|@xpXd)ZI*U@Gy@{MXFWC{p)AS8smh6VtPA0MGop#!jC91M4E_?XlWyJJe`| zb%etnzP?l(a{N@BfG-Z`5wrcB%r5&X#Ocu0!G+qf>#p2G%_rV#dy7NgG(sP3UV<)@ z&+Iqo)9$q7rtx#d+w8h5vjJZQz50@dS)WWTpw?hJa_izv;{nC3=b5q7Kw=pQd13+K(uQG#bm@=9Q)}qvWPho5MrwEpUqKLr+ z@hsCY_K?`{(uD1x?|{m*_0-$BFGUVu1I6d^2QQ*=Ji|=2?yt?zO*B67o_t@H52-Ie zkW9Z434xLME_)KgyeqSXlM_tnP^@XMT9a!-Y;{d%Zg@{5SPp5`-tO?DESwD5L9r$Y0?j67eHNlv(AP%`o@ivih{ulYo_wHc$7nCjg>q zJe>l=j1_~T@`ky4EMFjHM%tnzZ&b! z>UD5JLPoiu?jiA;wjV(-=k-dK{yX&>qGZ zL=^rFAsxsjib=u=oeI+gtq!vcBMY4nl^d0ha*s-d;vn?bBjqOLAPF@^pXyUOoMeM? zH1WH*Ls(iuONv5dS<+6jS2jg>Qg}nILcU#yXhLXwZp?C`V>ETProU%6dG;3+z+lpR zR$*k@gCtip(@7>K-L_gc&$mjX&iLaf<}!aVe|N8uz~A3h{;Z%_ zb6-JQ*vW?PiCuGpj)Rd4)yH**5;3FjLpuqf$@!)hs zH`eled~OB7{Iv)wiK0GNh+wEeXiNL}=6-Peff5UXR|4hvgZ%;)Px47&D8WRe$x?&J z0l5*xI@tOT+w+Gnu5j?2kQfOeiTlma&77ya=guw0?f#8qQmho?feDxlm_x9zi2i`- zKws2FRCttGRQ1e!LAQLcB&w*h9ImW{P`dPt!nRzI^l6l}tN_=cx z+;&z_Y!TF3-#sfm3s&P=BTMs49;2y?>9L_fXW$|9G21`X!}48$gV&*$eVe^mtPYYB zdQ%!Y+5s9^EImv-6o=HY^w{*fz%?C!D^5 zlO5ySavqQ$dQMvpN)F%W3iya2_=!q``orhKB*N&$GsO_~nj`Sm_1_5{A641$nMZy_7=G?HTk*t zh3*zA`RIn{c zmbqu&75Z;_s{ed&ctl$lza8%H5x8TdLB%O=J(yX-y+uxNMnki0@*BG|(yws3d2CJ! zoJuRY=5e~Atg`YN+ne*pak^i1vJ04bG%tyWIAf0lpQIFHCM^VnNzBtNF3<|U6Z)!i zMg(79-f@LJjtlsDgWVL*mv^|q84aOxLC+NVVYEO|wKamS0gr9)x$fW9Kf1$2TPZ=# zKu;ox8IfiU-G5eQyQ3MeK1xPGH_ApvjfZ@La`CduWEZ?r0sBoDM=32A5D+-D{~n+q z*}2#tAjBZjV!~>kpqF`2fojX^U$b;NL1oP0l3P}r#paQm@|gC#;kNed)|1^UBNPl}C2qtVNnW!DA1ck(=*9rLpC^49b8uBLh< z`FxHx7q^dd?>C>9&hOtpCE`d6p{c>5h3KG5hfy^LX~3cbf$wlZQ@dI7DnX!wiW8ed zr1F@A%aH*;1-!IWWhaCJybzR$qI4FE)1(&ZxT0n8>iatmk24&0vWqk!UhwN>PEuF^ zwMjOELHO&c00RT#s$jm`!26UUy3zab?4-m}N}M2QwP%4&sST}s@mGPG|9H( zn(g*_CnXI6(>a_-=Lu9j>y^qSW1HG~n~&$K_mv$T9bF)2_0UVSU^01+unwq{`RVD9 zW%gTL>@w@2VS|vAfDbZ9n>Ee7*NvSo_wTRIQG6G4fqsc&>4o}SZFVN`KV|xPzwAcrkAo0hCX+lJjHevVYZ&;6du|r^-i`m% z&}((r5x^72pG>F6V>X6Jf%MpPf^uU1XaWD275x4<%5lKd*Y9+uknTSsS7=D5*Gbkh zGAiN~jz*U%fkPA#c$gDSl>z%#_%T%M$>n~vc^Y47FHXz{7TdQ(4JHizaJ7|l)MP%L zO&s8#o{@21>2f@Ccao-|53|t#ZEnRt{pYfMM`6<<-)rQOD0_9S(ZmjMh z6|%tL_bX&OZz)1}Nnv4Ng^FQ&Uk8!zjc`7LUYDAGS2Hv{JjpUOm_3BrIsB#S85#_z z8Y|%>bxzd?ZCyujfy>cU(NAIPfllGu_s4T8-*(SiW5VfNZZw~Ru_VvEz~;zvbB3tx zQfV|N-`B$o$1F3U@Us_A`%TS!Kj|^Sk6k1# z^Vxg^4T0Msv<@xxFK?(grnKy9Vm{yT(Jo-NBtUJeM; z;JbXEtH$}JrY4a`Nj?e?F>_IgQ?BPt7rU`?`JBDBDVxvX{-uh?&VRvhL-gD#rJI|& z?@I)C^O8iv-@6e+Gh<_hT`6A6qDcH|V}HXnB1n;=163@jDbLXGz-qNyoh8>=Z8F|1 z)<}AIg-qMw&q4;qN`(_Ea`1PBy=X{6qSaJXjQ92ZUk~v(Y=xXgA`B}lBL_*75egB- ziRpl5Ze*l9TZz2Z?ZLRKUaM^;%8H7#2Y9c%LM-Cz;G%O2mp5pcDI{f1Y!A{p8J&jo z5h0DAaw`s95fN^)`bCC;taK(9rd?MSEBx*wqI$a1Czu~wb!q&@zN(9cTf-ob99HT$ zN#Fi2l8+NN73)5y$&}6S&DCpYhFptlkLts7Nm-Iv1gqHeG^$eprhEw}wDb#JM5u}t z8u`-;BnSw!igr2?-YK?no$tn};Fuf#4H9QmG&zz>cZh~RCV^a>o2CI=4JyQp%u_xy zZP&=1*5xLWXM#v2c9SXG+`$szRI|Liyf{#c^*ndOK0=MwvhI zv0o-3XY7WOZ1dv6wn%W{P>SNoX_NrVkI?oN{!kt-uMDpPd!dHFAz5LyPA_ZPv~IEJ zxP?u@ePHZmFqs4E1QmCf+Cf`x2?YnVY-a4`WKjzG4?7F8Icp-mNk-?)nSzCcO!apD zdZ)rzhKNXs>F`i+lWDJTJ}L~YTe%qfYC&SG3pYGs5QBCLbdHzegV-}*T-#!r6k{>o zeyhP>GgG%Gvhec9f`I&l*=21sTG%PE{xPfBAx$tWeuxD$xo;{J&(7 z%F~MQzwCg_3N%<|(Q*`E-T+=WTjKaX$z|%lSP!2i@xO#3RHeG{Uyh*$1Fo`!!)l5v z{9i%=EmN=q|6lSMiUm5*|KsAsdL&8^hzwxNeieZ>2}t%<>>lDmKp$92pPPf$tQ#V+ zZzpJDOJ{b9Ofu{k4A)Q;FZ>PMXpKWC`=<;9ogj}d&I@V!X9ph1P@E`Xr*gBd)_Ar6 z(at#XLW@8s7LkV-&_W&~fE)ZYss`{vYtpoc0T6AO5fdN<3Zm$DhmCfdKd57IOeYob z!Zjy~FnQdTh`_vMeLszI&Hy?zp`>B>)oV?`^^eirJ;iMFmoXBj2AtLpdL<7CakzF; zvK#yN7-eOb_eD`}&9pSmA78n5ccK%Mi1dttQwH;`H8mF5^*FKPqdSdT642;Gg&JV; zk53x2ceHLRtbYJmJvnS!t}rIiw>ghlT5zl^85U-Ku(Bi2$@QhBK33zmWfXps6AI%} zv*?JeZOcN#C?sS39e&cba34fsQz#aVk+{W;j}*{5@6US3vKRXet0Rv#)U<=^M`7$M2C zZ0tw)CU5UkRRS(javiVoNzC83InSTw`A#oO%;Ms`&({Rn%G+3A2zyG^p)yiH@9iK4 zS`rqvDnAM~8Z@yyezCboHnvoAkFm?*<}og3*7f~Qu3W1b8P*J3);|_a=keJ)2k+DP zeO}9%A}X|i)2@ntlmWvy4O9i;9yW!){8tF<Vz1A&Y?>hZM)_s;BV98$+|bWk+9SL`=W!)hk5i) ztcCZ|_3UQvc~^3AH7hHtvfw4MzPVuIeokw7dN9zT$_>j#SSDshOLkdmx%`c~C$J`>oPVS!VzH&Af z>pQkYVcvm5BXc8GOItaq)$bhqE4tZ8kwmH5pT58raQBS3p793mq`pso`rk+I6tvl$J50zzS(usi=U)wbn9aV` zg_+75RIzH=wEaGSJ)ABsE?#JIyX4)@PHG&?++Ud5@hzA4Gb8fp!Z@1szh}E`v+t~} zIXGTlU!TZtEU9D;MwzRQ4?&sVK|v1Wq<4${4dZ~B@!=@--VNU4Wu5J{uG$ktXLZCW za8Df1VOMZhMql`6W(f>W0bJs#SOQs#2modTj4AMNG2Y?Af2MPqG7%9j8UJRjUTxRV zjhsqWWF7m>fXd8fvE9=abWR`NAGhM|bIKC1cebFTT=Y|k-Rl;$3T*?AVsYbfzic7u zH{d-{X%l~Yv#;;x`6wQzx!%bf8|%7-bFbPqQ5wbc<{qm?MOoTGt50Q%Z3!zko}r?e zq8G&nb<39$gf%c*H&cc_c!7ZK%HtgTE%G*h+Qg*Ca``D4$hqN-PgCHvmg#?b8dm%F z!)WKLw}FZggglwKnDFUUQqS{-sNF^cYY#8~eolOz5@s z0*~b-u*>QtpX2|R%_ACqqxPyQC11Z@Fd+^2RTGT8@jcD7MfTy&KD`LRiZYD%soBLT zihMe^Op#YPn}SzXSxLLUzjb%NHxW0?7F022nG&ls*nvi=4j${RL4rJ#1Mh5%u! z&GtHC@%M*B|4(7G-TK*&A?~At`}T1k%;Cl9e5q(@2$GgqC?a5Z2{C{oWDG)v6?Ln2 z#>}v_*)h^CT+3~K*h}^{mC9RoU+l74{E4IW-L_;!#ZNZ6ToD}zj2>0=B&c9Flp$J{ zKL%Tf#X_vs&xmkvevCB4+!sqF^}bD6WaGGCmD#NN%Q%e_lJC_Lvz*0NXwXi(9IBi> z=%#u85)!7NDtSy^xb%vcsz}@X;pnj+wi+X>}CkzG?ghywr+ayXK-QeAD7rhz9#%S-3M0dM?QPbTuZ zm((VTFBBO6B4`F}#8C*1u;D8H&;|V{_5hU5!ry8u+h`CLbY?1Iw%cYIXt#;BD3FWm zL)7a9$JZ@936n$HI^MN&j}3f&I?#snaR8CxIol& zp^1%N=+`nMrO8$;il*)675^cyPeW7aXR~T5RxVL7QFzKi+y+<^$nL>i)LU;GSB+U} zL?auFUbqc$be7P%QF?r?=<`I1dWJI7L6*_AuhS&kj5)L{|9(&&MR&^P{QlKZDn*_K z+I?rfgj{YZR5pWN`!Z%MijU34=m{YrOcuhE)BcjIDd1v#&=K{xWbxOimH z(rR55S&B}pr3E1h7`jD^^RT^OY{mlhDj^gA^=r#D>*gjbai@9M#$tLh1>A8B^4b0j zOMu|XKmzJw1qtwSOkg!s^>asA#^$F&wVSz_-{_r^q0WNv3zuW+aGhO)zSz{bmcvg4 zBgMn%zk6Azx2Zg;#n~np3pDv6d5$vbPtW9gta&E#6Ysm?l^416kx@O^Ke>AiY@m8W zW%8hUVfi#bCUc5?g()0m6yinme5twghd+()ly(AP!l06AbNN6L(xCWs>ju*H{dz~c z!MgK@``5$Rvf0+prexJ{%x1a%WiLrnyHUD5uE=l|DcGKrL`zRJH@8Ef#^AZ7V>+-U zoBkw;aYAo?1>`#QG_wrwM@1MwDPSHRTrkvE_J~M(u@Y8Ndg03CN$dAFMnjpPihC|v z=OJ5`Jbb=D)!D?bk4x?9*=7#n{~9b4uO`A_G95V!jE?ddo8zvIk&{Rt4={VEEE1Rs zRCcJ3sQ{aZ;QT0WB+GN?i?pp$or@$76p;N1v7q|XF^v}$ObK%2E>biv4!>*;f|^og z3Ok>j_4QgIYo4dQG*l`pD+~@ZdnNaVZmZXE_o8OYOhKl@LUG#L&^I8$7%P7Lc{Ad5 zaOYL8FDP%CvuwX>xcS!Eh}Gi$nY8MrJcqx?rh>^D9TW@f*4D4ibUEt}wB~lp1x!(C z1uq1a#@Q6R`B`(qfljF-!jYs9$~5K4K#gGU7%Tsj`VS+H+v*&DXgbkCaJg6HkFU`1llR zm`ES@yGkq9$WY{W_lM|w^^;LfsL{x^H(T|=>bKhEAMo-27%{!M{$*%3ywFmA` zOPgjf`Q5s}z9Vx6!nzEQh69SGN&Qz(dptI_m{wlknKs5r;L1qOcjql$*UT*I%BgFN zLF-p7Gz1B-WP*tN;tLciJHx>4T0wIQ-|fpilEiNI9j_2KKaTYYr>~(yw2|@0%BX;UTiei&$HpO(vRLNzF5klvU;46tnxLCqNe;sWQO+^wQqBF7wH z_gamUliUpH7?62!ZUVg9mFu@%9?U+S?b*u%0!A52n$iTkwCbty3VSK(3vfo+N&Bj9 zvi#;uy*gDP*rSEmfI(6sBsrWpENsB_d@oEq!N%gX-i<2V=W-*Bke}gm|BJu_Gy9>9 zzSf$1;F`#20=E5%ZeqqRM~7YTEZzX>S)vcH(apJPFkgunWx2HUU*p<(#;a~+W`O7} zEPO7s+1gmH)P1u~uM=K0`mot%N1wIAu-nkMvZte@)Cr5h5$a6?Br_+v7RbbJ_aI=sZiOoHj^&3YZx?HNvR_!RbHu)Mun`Shd8|xc3r(q2hyC{sBFVg)ZTrl&mZ* z^_a=>(DnC#1C7Q2nx34-tH$1T>p61L5+e;miN@$ zw%OJC3A7>JdKH(l_%}m%wb@+;XHMiu|7?8(#Hv{M73XAH>5L4a6i&BD#NqC)wcIK} z+~p*os@B|;J>^V~*itjh&{3Zd8%K|g5efvq(SU*e*Qb$$3jb-UC{wUJe4ma$TXMh* zi%M+J_ixT@a`@|NS<>QaIz-&m!wLa$I2T&G@kZYPY;^W=9IN0|p*=dhSo!(=7R&9+ z%Hlr0%>0`Hy9dAO{`j+INS?0}Sa|^*UnFl?TA|rqocRuCpD}N#sbsm7~n`TQ3@En*hBjfyE!v8W;rPrE3`G!4_~tX8j-L`OJ9j4i3MaOn^yTPO>X7h+lkv1=J^1s@$BZ zY-XwESxQAG4Gj{7BS@VXi@Ct>Z+A!LefRZiTyqMaa9ne@;GeI_jJ(XWEQ(?nA6SR8 zKz?DHw*KharFBCkDiw)zezQLeOIa99zWJ8JcZATYMqi0iq@Nu%{;VNZ5y8PD*L@jO z&i(oJ!>Y(HPUN3u(D*_^Rres6XU=3G9%Dm9?cerm4ZDKhud~5F;LN8oZ-I=ELC1R{ zpMP`qNm<;`B7s+3q@$B(_BtT7n8Ew_VK_zro7er~?eV-w;W?1t_MAc1$Y@u~B5%1& zHUouB;zs!B47KN^I3~1e*nYj~u=`q_H|?WB@bmQR{koo^D)U35UY`Jq*<^yv3XIl` zF!a~Ko2<8NXpXDb!If+Wm14e}FkVgV@$oSdF5Ah=euCh~&0x3tC6DP?V)s?o`DsN# zKD*5dlHf<+Ugyna3U$KHw`9P-4BY(D>}1$_i~o) zT{pLPf)@>g0x$nUJj>FpPpREFEaL{FblUBEcf;}YeJ)#}mjGtohiMw6yt{=FB~fge zI+ESGEtc~@E~%xY^oMin>1s<>F}%ONV-MDnjhFX5=I5y2vmWjKd%pvrtrEm}Zq`nZ z!EV98XgVeX7b_K2h132>hOYDY#d@>P^OfIeSw=iAyY>D^+}-vs6Lsp-QYMe9%@jp} z*Yo*JX`4tBRd zpg)ChgvjS`93CFZ=W;P;>&}Ol^6CMBV;-+Zxd!lt`;PN{f?LQnk8)jRI#0`U{>eu; zIpfae_^3-ull8q?guQC8?Rk>K?%3AfB;37z#9$HhdCVF?2Md$74B|QTIE^P$5b(Hi zeLgJiqHtBm{}2EYGUaUw6mxDzrJUum@yRI3JN}u|#ftr_r7E-oahum+M*kp|Xmi;5 zt`gOwqv@P`X97-pd~F)11fH|XNrrB@0eAu)bgj)@FC7El+u^BRzWXWG(1=lw>+R2j zl$qZ5$_+)n+aYPHycX9}75%IP!7r}-KLdOt+3YqzZ2NRK$%wX=m)(`dgV%!Kda;(I z!86U7t$T_ALH6-Cu=8dB4rro_8a@vvptVxmr{a|gQ%$?j4RI!y8yoi9HdJVZ1K+%T zPL=)p;Ye0$nHzBq=h^IDz|hbbOq^QN&~Cka)(=G#TKWh7mdNuT==RT6Od3wkb_+!d zGAuRdDrG;*4kOhNP$K^qqX*tB2BB6erWg&zo*S@T5*8^m%xxeN_CfChBK9ND!hM%n zevRbb_p5Fg@ZI8q1yld;_Z=uRNz#@-No103mh*eB#|7;Ul9Am8eg2l+ODxbgs_3Sv zX4~s>E>LA9g2KQ)v3t4@=#{QiM_brU%(-F!%fPl7E|lfuo*CY2zOf&!g=u8*T*hZh zRUf5-CZeF&_y)fI7o*?YQ?I_Ao#~=++hHt9O@B5AihF%nkEaPTQ}h5}JyF684Q5%; zcOvsXXH^vfUoR%EjXN?qid`O#i8%>X<C<;8q@qAGP52v<~7`?bl>CKbHKj|{Ji^kFDm`=TRLHjXn z-)uG~0ck~}LJg39dCWU0J5FHvY|qwn=zm_@?)hEvVt4{COwV;?=eN;j=dtZY)eEQc zdRAROr!^9bBYGSvqaX0;=1Tn%R*=pEBf;tO88EBcUiag2sC9DpuWK9h;W@>klSoyE%sa4_)tiMQ$oo&LjDVlBv_gwO;i^l<5QMT3rnCnZH2#Tele~3xb*i9$Qk`4 zV7Gr0^lvip(ExPbQ11OvAETh5DvfHiWVJ2ecAHagx)OveMOI{Y=$zNwGLyebLPtkF$EgaK3;_8YJzNKF zlRilUYZ?wp*strq{e1A{*pyTXgrvMu3t`!EaQpBe2A>9#GUoqP(8`on0U7MsmJR+ z7%cR2+?V+)wtSfByvcrxr!vKLj&w^o^W60tozujR0W$TJ%q5Rw@kI+Tba@Cp$XZqRM$PAmG+Hkjm}2$0 zMX7aytxE;~zzF$mRPZb5F=)O-axrgHamyZ7RGC?cTNe3**K|4%MGu1%IfR#g|J?xL zy|1Uoj}EaS3m~w+8RP31_x~d=8S${|0#?PZx5<2_A1UF;2po|9C|hXdiJdbIOQ-3< zc5=^K9z>@NmLoi^@5=n0I4|G=6!7u|XMtC{euT>MbEJs2in~%TU+rx8b$lRg7|(Dx zXYJm2;Ff~xiYED-ConVmKX>mi=N@ml48Tw=VV4-WOT%<)^1H$9+pm|A-St0?KSyl@3H3*nGgfGfmb@5*?g1mm`NfSR{J&UV&7 zOgJZKe@xQT#Jb(z!y@=2Xn~cr-!2Kss1$?pf3F|Bx;B##dC^+T3pZpB@Ctr^8 z#nVXCV+9u#!ps|%p`}o5yHe@!H(W$Y0%i)kc-`qJTCct1axvuOpZuRQDVn%=+ z3M{sdJnUoqacFy)E;wL0niZIQU!4*VScL6@ho7T`I(6?#QD%aCI;chFck7CQh5o)5 z{2t7OiKtOJ$ck_h{ON%T6kM`~(sTg0Ik}nnCNergRq#dTVI4Lpbf%8&nqn zi0HT=6`j_vud|}bzpW-`X!nb3E(NnojI}TFQ9E)~H-f_giwg@aUiFWfPs)nu%#kXU zs_2T7IhJ`%4KqVTJyB6~{-G6eFU41%hl~Ncal`539Cm-jplcG6!GZDbpmOv^rRRCu zC-LZcCty}2QSLPY2`i5=x?-7MizPVb87el1e^)*e9oz>q+F()y;tY@CvB#--%4HdduSA=bhHIo&qV@6(w+E_fMI9 z4x{;4^!v?U+G-@a*x8(*)&9hk6@gJV)YcOvSPFP6zcH_kI9tZZ>qRh}fuyW6PA2dx!PgSW{T=@HE)1@4`uFQ%qMa=?~(j{Ma_VTs+?|jH=^~61J;Y{ z(+Nb4g43ZNq9Y9fi3r=46LM+J?#OY@B|Aprt^W5}I|V>Zh7fbDmDXhV&V4e2;P+uf z8{LcMHhOJJV<&dCE$T@8;(nb&xbe7?^Hre;(&r%2*B=qztz!t0W~G9Vut1gLei4EE z*QU|0BuPReB-YV_PNybN^YzV(@qc+@s0C@fdbus%%}3}hZS zJ#ayg>IwL8+b#C^$ka>H*kC6AHt(Vr5DDDfPCB~nHvH`FpAHW%9X2~+&B`upIUL@( z=~UI0pnXQ;FKTsg9d>t+PQu8l)^s{Of_qJsFDeM{<|0%g?K{b#vG!8r|yZu1oYr2(dKC> z;2XyvDS~&I9~yU2=QwF8wo}Az2L*0!jmkYRkK%_wPFU5Q>|0CK1If~9D{fUMUu;-s z#NKSc7wblYR@lF4JoeG5cH{xqVjq!!1|y*&S7>zSP-Z7+hiGs-G(!c+=hPd}BiBka zv>=`^&PI9%?KAY{g@v-4Dhl~(TUa=gRXjp=s@NqoDg{$Kw1RrW?67VnoA?rv9-tmu z@qAYLhAPZ+(QQ7&>G)5m&H7F_=WLK;6KygdxggOHIS5vRCl!ZSzA?;bI9+osoktoC z6hDmBP;94#hDr^Ze!^03jdcujfgIZ?lA@fZF=RZaO+9ns-{+_Wz5myJK}p0JGkJ_$ zF;^-NT1h!^N#EzC!yJW2SWyE$a11D)rkyDdxxh?Ows0V!*h_QJoaQl~@xHj~d+JqCFwcpQ7E^)QQf=BLupR>dE2QsQ*SZOvB2uxyO>cSB} zfd5a*rpE_ppmz{fMgBAHxgEi)$r+@y z%sws%@V_x}_(r5q%4~@y33yn2+ebc2?XZ6pvkOHi65kcum24CrZBe{!u`cJ@l=j-0 zhEm`Xp49giup2NVjoklasW690chZTFwB3|K~}v z3yGL52u$nnVmQf<%}08*!BWA1FW(s_mfHS&Sb^IWrmVlZr92mkPN9$Ru=|GvMRsIM zR1(H0{=IFOSTf#Q^5Cg04uazrY{}~ z)`qiVwqCs4OXDdJ(OWfV9$M22KTw|>yZ(2=QSSBK=f@~(O+f9S?eQD z<`+vcpwBT<6ThMMM?}X~oA}6OLo2cxU}cAZ>vhw$1Mun-tHI8Z|X@^a5wE2 z$4H~(z6q~?{~|ze&C<7F%-@UtLA$f~QMUcSlJrY`1!5kP0!p4ASniwd8+MzwszjZh zg43C}iu}uA&&tK2wwK8XnfZQC>r)}4pF*KGWW9J$Z4a&+JBL+kFrXSrBxQ$&CMT!H z!R3>O%1T3L{u0Fs!b(D^X7jQxbpf;{PHt8dLEqdIeij!2ghDth8vW-VarKrL`zFmO z-a~Pm+haeRd^b3LpW0YU#|H9;Pok3Ury&yX49RL%qwXg9nQ&*Ao6XF|YP=E3RXl7i ze6r>uvBV@XAO%UNE?G+p>ocZv1|?_cJKs}!PS5&gm;^T&<+O+SElPl!u^9o!{>Fy{ zcS=i>e}CM`LK;lu%>OGlq63Rn$b2)UPuluDO6WsZug_t!R?+IdR<6)o(Y*NM1bTcr z$1v?y9kPY;8fL!!M}(zeYzw~8x~gXiAGvtnI=cJ<4AzK6E*2L(WPjOByz{jSy2}Mm z^q>V*K76JuW3TJsL>d9FdyPpjE`J(IAg30)aef4M0dSyBC7#5I$iJ33X@((0)-z?s z{=NHFquOwphgVVTfm@cVt#5Hu*|PZhB1wn@W1c6Br}KLR4Q$ngq=P(8!URJRxzZ$@ ze2gAxO76DReq}DJPG!4>tQ1!d*>bgxpdFDxrwyK>1qj@FvPpuqLri$Pm8dS;R-`GE z#4O{!7^115g}jw9e`}w)-j@qykuHs=abU_9qO+AiEyeM6IL)J!z5=o6l-7v)SolF_Sxf*>(kTrVgAgH+!14U~1znh?M>L#|#Q78PAUqTXRT<%R^JFC0Cd zmM*T-c|c{LnOKaM8PHI)-~q;Bx3RhE&V0b5w#{8Ji8%X*TxRL(my?oeYrBWJaX-V$ zIH8FvhZ4yMb_@w`La>tbatF)i4Md=lGsVBUd84V~3cm75eQ`#l{S<4KZuAID@^tS#Pis2W5X7Ll?cjZ)9JX6 zb6sAD4}l|`a_0v=!obQlK)f&r#jt|&dDdkOi#=6+B9En7qaKky#O^@-XRsFj{WP?h68tu(_gEKEyqEG9FDM^Z26G(xPo}4?h8~}%sa?aY2|c5 zRJXt6bcHKaQ3MOFq$!k8L4~qcp!@POHXmK*b+QxP@yQ+Os!D9}B+MwYM|(gr*&OS& zs^@XJ)+p-e`F`1+wPVoJaTnYA^lX_e*}8-?K~N+xZ<^?6B(`3ou;zBY^7*#fceT;Z zNHibL=9P6XqsWER`Uemr1l;#aBEHAGOHbUii*8wu#VnyfBn0th)zk$VBCcR~d?GA0 ziB)1|k$^Dhfko@mxCvBWVB=MTGy<{E*}R(RTsbMamMN-Z& zG*eF-Xn;7@7H$fHR5{B?`Zq|Txf7Q$pQ(MBZ zDV9dd7e>gSbL^uF!5!fO5?4>7jd_>zE%Br>o9 z5DrxPI`CWp_ExhJ#+00bKoAd{Uk+zhcqu&FAch|DJF68yuYQwi)}KG5)lAJ&PW|Kq zoty^7i!=w)Wt)|#e4qm5h_K+w1?M|Xk)EcJjP%QG?Fjp_t zs382J^wjM|Um&~Tje)qG`d!$}M3PenU5fzmF5&3d1UTOfB$Z_P0460x36-#}%LPP-GMuRZ~Sof}n+|X(87Aq3ghX z$~&8l@=|!hKsnEE*P&E&-a#BI5&{=h_+1=Z?u;3E%NJA%g?P4jB~h|}e58!u^g3;G zGHdUjKz4V7L9p*I+c$SJzDu?cN5K08^y1Qz1)VkS9-CE$Z1i82sAE#qVhkt{obVXx z)Ht~JD30%H?jO4ev$XX+q_sKH@Gu|(cSX#oJwU>4#fpu8w{(dZXY-8ubiRs|Xa^Fx zafCRUM7Da`jFiN(RzSDDPDji#kO)90&PRtNNk(($b4Dy&BjaXb#E8?wG!1g%id>+{QD?{y*A1DU>${l~oxazm#(LE;~%_7N$Mui2;g+nLc z{?IB^bP6JbD&EEQUX|zE8shIR{WAh?i*2z|qh)FB2n!iOZogIJWR(pxValqc)nf6O zx996wFJa@P)jvVt6g+JgJO=_aPtMKMQ)X%h!@Vbx1a9aEd3!+V#YsQMeHI^%Xo~{& zjkwv<5vR<|m*8QXk7N`$Q0~eQ@0kLK$_@B>b%c5;G*D&Y47y7ZTg#>tFNUW!GaXfY z_e1YUo6X)6wH^~ehpBOIA}s`eGOb-_avoO^N+9GnZDY6_07?M8o6?1QxAz%+9~8K` z@b~jPMN9o5Q2Twx!?5Lujaf+tR3#dCt6ie|&ZLQk@bDzWmU(&2u`avB>YiJoRwuEB zrW1ERC?YIiMk4W?5A0>eBd3wL?(XlkZUYr@Bt@^pOlN|)c~5kLqYy^5CdddVEkZx% zMYsBEcq5@uvR1>#!hV}0CBq22sG^`mk&^l4MDirVgD&%=)QH$%Mg+kS5T>OpdZLJw zG>v~?sr{JO4fuSV1NFv%dLjM+{}9xNUmnaU4ZESDqBLQ&k4i{-^#3(;RzYz@ZMP-_ zcXxM!y9R>LOvQMCn5>F-1-0gaQt!VxFsHqAmcpkG}E#g;D z&74#SMO(m{7YvL(my9zqL)++t#oxz2m#wGDVt@diQlmVe2=}L#LsG@vTefv)Ka@9P)$gbroxQw1_kvp8 zUq8)i5qk{~()FX!nlueD;B^?(TAkuXIFs4;!@fsdC@2gY4%1Sj)@!v1R=4kl&#mh27`q=2Ie=3zJQf9+YRrzzRPVf_lL*MrosWB*Zk2WM-XAKsl*&vMSn%5a7v z@-fSyW0n|B?t8LnAgB#GM$O?>yhCkX<7dYRpq3^ z=db?!P2ol_BPmifZOUj|%H7X$TuZ&#%sCRXdEc?k`1!&b29)BX^;~D=s&SoWMXBe& zn8At*D#1ZzrsMm1KO|QW$%qwInn!&pU5Aa!>kT67_I~ zsjw7sYnI#4rQBcFLpwloY-HN)Jb=RWxNxGoM#bCza56#kmsjUJjo9$^})655OV-FQx zF>z21gc%tb?bYqCZGQRh%a^{FbCOT&y`*PF8IYBCt+P!euVM03kj*`pz-0c8_<7AA zVtZz|d1azwe3{Djt!F^&%*2i8F%OYbO_{dnot@00^@{agHM5bKS7Fk#BS~n-(X#Rn zs&E=?U9c$e^SC(%G{3Lk7l)O}a$lQN8*WXQK|Tj5nY%X7FY}$pZzt88+1z|&b)vi7 zgHyji~M+e)- zaTc_TeXTOh(#r)8o>7vQGs_iB&_qW z0vI6224bw>wq7?LNB8#0=Gh)C^>e3e)jLdR7AE`73dd-pS#8c)$toGEPuYM_88LsM zXVhNHeK%=LKAx%CXs{X5&2_S0`82H^PdWSfJeqQ7o)Rzv%+?~=8*%#ta+Kmn&|K?V z%_eLc>nOeKwEOT$RQzGrpW8nA{BdadfB7~Y=t>p8yOd~Ix(%46*7byp__h?wVog9NWIN4w>wxFy+$h~G}UJkuGCO=epatM#Nt zSvlNafVB#FnuF7!T^$~K@lcAl)$KOw0X!V99R(c5B;337K1RA;+B^+ct97*Dg2JbX zpH0?6J@sV{t=4<8o-TFBo|x7e_miln<80tE>-yVPsc9?pUe+5ZhHV0qGpW`)bmLYAtto5wQ1L2rW6A-g|LDlYrMsog}EBCVl4c zX+WHE_N#vtn~2eK2cs-zxAn-aS>)+L_CBOYW)7C5IyGgz1PJpw{XvYz`fp4&)%|@WzYz_!LNDRH}S{sKlZQ3 zr;A)h*IF#MYnybbGUmpxt~Cv$x`^i6E<~T~5oAd)Qfjw5t)EA&Tkc-z8XrwtY+quc_mvtdc))Teb~u5fxY#-$W2>NI`fmY_|^Bi1XdH? zsy~Yc5lWU<-ERHxkch5LD~T^J=M_`m{e`D>b$}_J78#vd?N_o&OEz6~^1rS5w}Kh}X7HRzh7CKsw@A+YRD|-KP5~ z0%&C8WIw*>Yz*|r8=dKMX$cz}Ej+0CDfoKz#CsX^^d-FfW+b0np8h%h42vS*D3?On zWxLU2b8S0cLFwLYzq%wc^DTDd3?6kUP~&77GGfaY)4&UQXdWxUy}SDKNN+kWqHN?P&d5f^%=Uu&@xxFYV^+l7P60M6jD zKp1%vv>WjenMTzn0Kfk8i~1%U34HM$w@}&ky{qMV!|RKl%Nx+&#GRz=CeU-i%BT*q zYlycIt3Al>+s=H?vP}hnpV{^>H*nk4crdxhJ|Oe8I(52Tb0PHNmYH4)A3zFs^j=>> zrWGc3`#&(H(;#_?G~pyE(g``^D5U$5r%1?J&D|u> zBrYNu+Eq)7iNA(r)c03~33WLU-|e#PG2lCHwz_YH1`UL723%$)PLm6Wo`aW;J6KChkWZ{ufix|sy5a#CMGtzVm9vK-Dd6l zL$_U}_2wxzfyHm5oXX?Xfa9$v%4W6VQ8T$6TrG` z{+*hgurKBZIv!tABw7Sclt|q){!~;bDBdkRv{XJ`{fU?dV5C6fMZ{ex&hIL}{z=fNxCi-nQd>U7%PV;t9A4jFgz7WeJ(rIg92(`vq4 zkJ}7ZH+q`TU1WEN(#t)u;)JUks(9{d#rDJRo*HSx)R|ePB!9tJzaxm(H9Do(4i$-Q zvOhUb{r#gRc4TbtT*w!j$+yc1kcOs6zBmZWwzubsq}$1f(c8VAtPY>cwN*K%5)skj{R#BaUbJD&ddtYp~jajp1Y^8cmwc3 z9@X98k+>gwjY>~W;Jn!V9DI*Z)xk>|oZZrWZ*BfN<;8$D?W6OCnL}=)rH+id{dJt{ zlaVsq*}&)zKv}SLG5@S1ch_!zbzaUFx1++=dNJAD#!&7Eg>1UbUlAgBVY>SvoYqvI zF4m9aEK^?iy?|7VFQ{%8gF&0~sKUGDmdR+g)QYx!8H^lfe~NI+mx~T~I*LoZK8wCW zySv&2Q1ObFkF`|(qLH`^c?1t{@?QBvtVCKac~{Xw0;DUg!bDo|GCNN(={W1^T}HZN zhpU8D`LMxiJ0;{YLT!B~a*;b<_IakK7xuer7T9Xq@!v?~-QIZ+Tx{G(N!ZECR%nyE zHn8Q)dH#kN2;iUdOz9txQ-#tTs!kmDt%{o?WxJ-mm0i(Gg{WI8e{CKUgEdMD4W zc6qkntDV8tFuG1nLoeLGjQv)VCJVAo?JB7?dS(JR8YADruCj@^qhwmRO3sg_kWCzTQdI`EssKa4Z!C(1DNPf zR?FvtnE^w+7hn{+aon^W100jR4S@XP+x)T76gc_(FaoNTE(_lE85kIB!GE~`1_Jur zz%yL^GX+DdNZ2xfpY|pMY?D8i;=Y0b3#BNa`<2>M$fA}2=du6iDgQ6i*uua$0*Ve` zYJI(M3SeP%5Adyfvz%#esTWqsPee~1r4k=*kCd}KW)E$0g#mkI>PNeVF2^PPe%gwp}qH)!(oKq=e2_h zWf>|htRJXj{rL@mIbO{Famw1VT%MvMM*+e<`F!z^pX=d9T`;{b_al~P+WYnIos4qs z%yO&C-p$QT?#oSS{L;f~vdOc)V%ehJr(@m%nnY0~UWc{D#zyzvz&AREE<*sO)CItr z7wavI3EqFGqSS5P2bP20!A6CA07~j+hjspsi)BDfR;yMhi?*^eHOTxT!SYT0NFv0T zM;op)u-D|}n()qRrAxIalqtkfSt0V{yyU+Xwg4*Ijkdq7-M=6OYG45V@0G}C;nn&d zRqD%bc8NOD&GEj|vu9(3goIuv^I=K>-|^jnCRT7-6S9fXkI@&POJmsK>9EiF*eHfo zTeT^CN=xWe5;a;!z&g*Jbb&yZC2XsYRYj`}PT}waXj{PwL=V|v%ai$HV4>K*0J1IF zPp~Lhx;eUvwyjteoTN#%8!x;6v1xjiPSU?%jB2NUFxs>qndnmxrSCDdH&2!>W3Hd; z(Yu9a2ZI7<8ks9UfK78i$%ooDjZg-NQV$$@0J#s?kW$;i**hQ_A&m6krlO`hnKz2Q z4Ga|}&IRaFW1xHdFCqcT)N`vH0|*=7;GM+CqS)-BtMt};#NzN7;57n8aMBrQYcsf{ ztPrHurs&GD=$8RqQ2yF=Y|vTbj(m(o713GBAVw0e!hJFkA~w43zl;VTGlDdZKq%nl z87QR5DCqtnGyw2A@p9U-@Dmu^B!{fvh zyEg?4-oQqoBsc;5G(cF2pOzJ(prAy`Apcqgnyqa)?(-nPzwZmg2Y5GHjKt%rh}P*f zSYxr{jiD35m3W_9(xtCE^%$uecY1T_n4$sp{n#l83Is}Qy4Z;uT6z8iAZec? z$bBLI7BFWb#tMSZ7eEjgr0=8x6MR~#39XTXOWLX!jY%CSIdbj|vVJzR0e!l+QeuXc- z-HqYca$itNCLx!YFLjXrl|1m(A7UyKaKsmt(V1ITNu6$(Lk26GxEpZP)z|U$W3jTG z;>{fZ(P#O4C~Y#}gOcd#iE#QqP%_$!tqp?}!*1I$YnUQlH<4nQS~^!q|Fc3nEsI_sJiav?2RqNG)PS z`b3HWqOiv2LT-ng;z({Ti$9-!_F$eN@3g1X7aiWFa+*t}YZ8Ok zgv&Ih)rxcefmr1MloBnbm=G#0EG@-^w#eKr3_E^Bc8j-#hb5|hh`^5UJ2|;fQ=kcr zU?T01D2B@>ow&!6W>`>D#8b?6bf{yE9Y}5X{$D zDg_2y2IZXlepHSR4rs$b=!gw%GG67>AiY@G*DG?3Ou*6*;63#p{M%?P(GhVcM1Aj2 z!QG|=HUrChH;U1jk;bLf3hnHxXS`AaVOnrJ)nB7iBVp9Pfe=ihT$X$2jO(u(i14%pl-<=Lswd< zHL~Jmv~_8by73;E7eOg7yr(1^-4BP^0ROD_%c^?8wc`GF%89ZXjM_$q0o*_>w2}kz z`Ld0luf>r?Z$gvdjc&8KhrDFH^WaB8rKItC7h)W<%92=dgA(0GFGPz#%!q3w7yI$a z++E}$#A4acRD}7a1+5d-JWB3}R2pqJR*xd(^t$=h3IQVoX}A3aIG^e-7CZrA!SzNz?F zQ81}nk=XO8>6mXgLkGR9o}<*EweGm5$kTk>S&?9)&~Rxl=eIQFj<&U`lwPc77z*eC z?YP4T^4xNHK|0mg)C_UC(D=UG+#8HXc!<#!rMo8uJsE6J^?7ZnyXX2gHo5>*eq7_^ z=bSv@H$E6LWW90*A%WE3!s10+?%$e3cI@(uunIBQA42kOH0zo;`Dl7?Rhr4Z6M^5t zQBy(Q_h!Zq0e8D23U^%m#GzuUz6;RjPkF)6iOyp7tn54qq$LVdV22S}^XY{lt0Dgc zC$}Xonu=Gh$jEEOaUWPn>-S^R)CBW77+!-5mP>^TXA6~nnVSjrPY}%CWnxi;l9S`b z=F&Z9U7p$)Sy(#vfKrVGNElOvaQkl^Kkw-L2Dydpitobo+^Z|T{c^5pEr~ z2hNtgt)K(wGC|e5C#> zQ?$XgIj%1cM{dv78?7$O#-FRa0a^dNeuCYCg)CR`e4~vAYSiv-mWwsQ;}ez<8|^Z>^4iK>}iDWgpY_!5{=J<$R>%w706u#`EpFOW%F!J|GP`n58LHthK{s4@6GVC4xb(TTBFr-Se!Dhxf zf`OWz5IZ{e+<@kj!V{3cvd0Vpl9*DI3SsCwnW5Ksr#3CjPs7*|xEl6+X%-M1hB|wR zY<8-QD_q3y(QF7V&blJl#f6hdk#X+L4KWETbEsN89tc*4!^#_QweiP1x03R9Ean;% zWJ~hD?oYy8mp&1j(m!^Jpo(b^sF?9;s_Ejx$JI>K#~JdfmU)gQQYWJJ<#B#A@y10T zY8EF7J+McM9V=082Dg86+vyK;Z9W2oLU)@ky9I{3uV9Kk)l}8#Dh;}ip}+IWg7WEO zyX%ANshIiqEha!d`5qJ5_k~u4w={g0RKJ0P_ZYcar}b*sjhu26@R(QV$z%j+x03kYUX7U>~o!2NXE*(B867T&YhNG9p@a63BQOs>3 zk-zRR8-#3nq0cibIFVWo2MiH?g0 z;~Pv7QX+HoV^E6a%qw(@N@C)}XZkVAmMTN`ON+vT!7v-PgDYT($bj9o%i*7%G1ADJ z+fqXkWwp>bO%u&UJ6x10hQ$#CZMk3?m@|nIb?9DlIn-90r~t$K0ygCs{w5Den6Nge-D#m0*}%0W@8qo-6z-L{PrrL2>GB+YO92D z%@&kcdj7HAta7h;-O)lhMKRkO*pDpmX1KZZbo>J%tn(gYvw`>lBVnL<1Kgluuom}*;{daYE&1EJ-JfF0 zrx+!d`%(bs{BYV>jl)H81Vsgf$&ixuGXQu5jtX)6Za9tA$#dHgbg$HKhT3f7kx=JL zqz#+BXFv7?yF9nkRgB3qO=D;da$QspV3^vVo7qj~<1RLR8!DXfrZ;8vtvx|lt;0iR zO7U~SFw}F+jx5njPEIXsi3{!Z7b4c3h6f`TP(FhU+nVr{+*y#2hS2$<^<>I|I{2M= z;znojDTu|tbQZDGS`E9D6~s=lfx2EE&q6JilHFD1KTSdFk=y_ZAra#DHsm^#EkA8Z zsc_fMXEq$!b(D-=(X5iNu76r%j1X}HT~E;)!xkZlHbyd$L6)5!c{2n*HR%OR0k^S7 z;!z6lUNzKmEMj{a>w~MM%rBl+;c;?H5sCZ+%vdqso%Mw3m^pJ=%nDqbv$0)>;T26g z%tIL8TK+;a=(ojbF)KqvC146G9pia^j<>B|-izHjp&{(I}LfWlo|Y2t5#IGokpMqjg=3j3r5Ps0T9|G7dSP2BFj`tVQ&o z)+snCTAK?WC|9BXY|o-|i;e$kSDAmc>wm8RaZb2ON{T?!LH!>@kN3?MUjrEI{>w@D e|K^sUSInTGG%;N_S{)#85e6iqEL|;W8vH+>|DSsR diff --git a/media/light_pings_cache_sync.png b/media/light_pings_cache_sync.png deleted file mode 100644 index 113ef99ed696a7e887fb2dc6ceca160952fe664d..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 36383 zcmdpdV|OK8)NO1V9ot67>J!_xZQJPBw%r}u?%1~Nq?5d-pZDG|?r*qfjQVhD)ZVqR z)|z|GH7im&Jk zS=yL_fOvq`q?s$INVkM}n;F0)I%AL@XDd4W(JTxh83`nzBMu@a78VOSpa%mFCnt^w zfQccdRzy|70F`tC0l&3-*w1bk>~8nBQ@=bjU()OHdi3*dw+0p3I*9?i_k)7?ef9~P ztyx_xaW-E-*n@y&LnjA-JMa`STd1O=gO48e{Jx$CaeK28d0|(RJg3_bf7Kc{wv0O} zieDxAGM&lDpohss0ZB(O$-jLWpe?(&3uln~PLD%?@amDvIzGROxo3?652=}6A^I1@ zh&4`d!*86?-{T}%RFSaE*c?9xb_6&$ipC71# zkJAaL548&ld+OhXKdx`O`Gi&^uOQSv!9dJkm(B2@g>(^;b7y)u38}F&(?DFNzO2_- z-al##T#RwtB_p?Y4aluPc9^oWFK&d|Ou-ynjt>sJ z3bTFb_k2~q3X-A3bI12GgSR3CA;l4G7Z^*@oD?){RIVU3YzH8CT%XPFv{7ZOFU3YoKs`{Y;-^LI^e>@ zWvtY{Q;<@rRXJ76QPWo5UM62CoGD#2oHJcCo;Bw%U@qn=@q4n7 zwoAwSW3+VHZP0G`GihKcg^WtcTn*bWIjSlntE3|`Jg}@ZEvlt)`iK5^K~4Wvkng{Z z@|EJThRIhr2l?6g=xO+v_Jqlw&IYVa6+>s+SRj}0jic?7hg3(Fw+1N}sFt>^Bq}9q zWoTM+67bTnlCN@ioks-Gow?ZQF7zCl{bSW@jdNdpYkbi|U7+jXC(<~87&)1uI}Vaeg1j>WA_*!*O;MdfLC#>vL|BY8cv zegqtbTr^xicpq)?xReF(UxyDEme;%5KHb0HlfbK8n+neOu6%HJzw9Vanom#!mIO1k z9%f@MRF0la*L_&ioMYkB<4b4xYL{%++VlQp=n-wXw{>@@JMq3j-ps2Of}*=wY9L4WkqZ6A3SIAdxoqi(0jU)1vXT_|!25Ak#&^ zQT=p`zKXYU{C$*rv2|v{l#k7a{O>pzXwVN4vi^?32P3JyW;C2JlM2#PaaOj*_qzwU z#wbecO~xNW-o(-+8ck9)fG$9h)-RnZ4PJRF<>%Bb*AIzchyj}-r+uiTk<#f&z4SP3 z8O=XhQ@VQfp9c4z&EkmD~8hUIt_XIP~CR z72_`B{Jl6H@OTrxtaMCqau~%v9i!axom*7KYt!i6tqcse;>z}{>f(8$- z5l

q-rjE3+C3~=0j5qYY9@JvY=8TB_wks<0qLe!YDo~RxBNw(>H)IzA)x7R5W>W3Y6#d6e)7u}d0pa#K}QRz7bqbl^z$ zap`j6bI^44wRI2bmpN#Tg^hu!0xG2-Hxs$wZ|Z9LPM$)_I}#Vh1pt3UZNQ(C|_& z>-~@2zhOZa{Sl<$MvG`yN`-S%jgfbMq7ui8X=NT$pxZeLk;e!b7n>JLmUxX#@g(pB zxCCCS@@X1ZyMHvLwEXP6TrN6%8jJn>^E86oG1uOeTmHoS?BmZf`>wv7_B~UG zJ#;y7I?UeFU!YIBQ{o#&&t-4ZtI{m`d}$173+kplQZ+O+`dbm37jJ-WUwd)exa;s~ zfpx{5ickNm?s;BN8gQXDXpp5n5S$Ir{CETqLU53BO%P@h$X*e`-X9hq*(MOZ06?$* z74pdzDa7vp^ayZO12`QJDDnV41!S*2gq46@;p1rbNt`1@=@8Z4H-l&gK5nKB5JCi| zkRGvK)Vl~FF$N>pIK*jCCL(*JJlt*29t?k6nji$xC)9X!Zd7(uQrJ3_W^_gLP!w4- zX|!#UEdg`S+Ta7QG22A_V!h&f6EhR0QP)vung<#^wG5)b+lviB0)44(-{GL0%6(fMuZR)2FPCla;IDoTekQN^{6YOvqkv*DZ zZ8_V|65NpMIC%RA3y8#*te^pFfu8#|k9=jaaX5W8&N;dI$9fW(A(?57&XV!I2Bli3 znz6E>&a_T@sF|yjy{+Y>d8~!am0qCsGWLq)67#BzAb@|HaIM!i?pvHQKr z-~F=Akk8ZmLflxM9YYBNb}eTuq8+_2?{mvd?d$VNp6Pq*z~=Tb^tX5rGhz^o0D*ew zPhu>SK+H znnr)ZY+7!3%bg@!G~GDmSLiuq3t}7$Q_wSmKD>WsKv{k}O4dxlO^ig6MOb=WYbr!I zxr~#dmDpQ`Op8sGPL5B7NUhP@P^)x;6pra{I4uq#1`U2KGRLy`R^(I~yuNst6c)pH7` z`o$o9s;3_-c@_8G1X)fxw->9l?9>?5OdAe8ni-}w;zfJmVC<8m25)&DF1~{F>rYYb z9o3S2q!;vC5)=aTY50=E2N@=leJpfmbM8WVY96MCGzXVJ-kshx+0fp?@gCC&W=)-q zwKzV!w&?mwj<@%%Aef&fK{-+6#}W}NH3(gC58n(VXD_r^Ac6uYPcP03SS-m0g#mz> zNQ1Q+i4$r)kZqu82gd`_2TwR?Mo5f=ki_j~@MgwC)?@n?^LGD6JRwGc>A)CF3d}x8 zSVXViq`xQfA~Gz}G_vZ?Y+i?KkT{yClMJ3TKqyu6kKC3_f%t7GYi?AuRRm9bSb|x= zQc`S8?a!@@z?cH)x1M`823G8bl?K*de{z^ioK21m^xFasVUF2%&<;y?1rA;ZqxY@% zrmFN4u;jneF@KNoPM^j@`?-H96SmIR^l9G>A@>K`bH#%BfECH5co6-O`^3ZwObWn8oK9k2s48c!S9M~5&6AB1r_>nG#r28vkEmkt-uzeQY z-rJdqg(Q-t?XB6w%DvqUigEtoYJva$;&dba{qJjZ=;}~AMY!oB<{wq|#n#MLtwk@9 z3ln42`A4i{&VeU*g8R5@*Q_T6zMKm>Ppk(W;|N4(?*<;8@0>4{-i4->j!^HVevCGH zhx}9F*U|QZf}e>UL7%iO&20(YLw5|`?k4v}KVRJb4$fo%lMQ+%&kw5!il(I=cun)zjF9d2RR!4* zD%wN|at3-5LCl0aZQ!O_p6P~ewEQR@3DY1Q5jht81zYnbg1DbSmK!)sYZ>I(;X_ObsMLW4+-4(Pag6*PyA4c~-x zOWQQn+bB^7?+-#-vCVzSicq?ewi7t8(P$tv#L5Q42%uO5rV_PUGbQJ3DVw;%f`Cl9QdcBEc;rG29b*03^wzS*b@C7 zzZ?7Q?vG9PZPi>(>m`K1nFa$NM23+{)vCcFbSgPwfxnWHlA>VuBm*wt4R|U6nSnb5kIPBGlh@mWrSceXxkie1b_{MU z2Eq`{v^fiD_^dH@57YDkYjFZ^5(IXc>MAP9XrQY!elc$eKA(SIVZM9bk^enQmtyyD za&o#+!O$RJ{QJv%dU#&n|3h`7@)t7$f>EO}#6<*1T!(B2c{n!~D1uxGvX9pHLb*UIRwAg14>AT{k8z#+ua0{BLSD)H?Un$OVXN5o*#ESu4gdvQc`fE zDg_1>(kOZzZnn1=>J&%M+y2Ok5t==Iz9C;9&)cnXIXsx^A;jP0QK4HLNEe-_`Jn}I zbZ(kn3L}t%NwD;BK*NcFn}VXDSsn`G^Z9xl@%k_?4}Te6R(9MM3@tnF_q^%u5prX< z*}e-$5Q>v%T!_|kc-~=bWVH6%GT1^P*7zG@T)v-2%tktkF`?H92?XhpwtW|*yp0Y0 z=o@ed;Y7|^B3-fEI4^XTp-ZMCu>?FhNP#bf8$S{8-}zP~pEQj_hj=lyjGJ!p)43jTB?z%3}hiTQKml#rjFKp`Qon~WrgX#}bwZ5-`2YIby7pym}PoqkNm&nO7pC^Xy& z-JKCRqCqj&kZ$||2Yf$LYF6N!RU&|nABy4#v5v~DWoAxGO;3*ys9;SkEft1{Z-!UH zNYN`&9=do6!=g7Ze}nuQZV;p3+qmRM7JdmPO0< zZf){FH~jO)1_%89p+cugx>Q=zA6!O;uuB8P*yX>1gMyMV%GZqJ_`|dn_)<#-NSHQA z6=ZB^|JyiR(BFP;F#(&Xy_EvL7%<=9SO&wy$1vdel1Gg~pG%E6Mh{g4#eOao4p5p%RFfq@ddbkLBe z1od2H61{HwLnyYMguJ}{N_~NXhA}||Pf)1eMbcn?w`3CK-b7$bh)J@7CK~vqf|(g5 z1gFJ}5dX2IA=bB_sP$N&OBou`I3q1oV8nLRxIR8U5MLtfZY}#>$2sm=xrnKLS!gYZ z-|oX-Z~~fa$?QhkKAzSKX2ZI*KLtEI43hW-U}2zT>DmJ7`t}`UHsB~P9I1g;gA|$; zsvZC`DtAI!Pbr_yj{0`h$T_Y~{D&nD)0b<7C=?=&jOfHIy_6uBOS%aL=oHZgdlIpt zAeB%!P@uurn;qEdC*3ScYW5l}->oN;MINgO3Dzm$&?{%$MH`TY;Nf61R{FlSysuX& ze=4(pxd{h6Zn^~~g#HI9J1P(!8<#4r-`V~Hl8Yc<{MI!vAps&%FAO&(@NH%NQyDD( z5Xu1ipB;gb!5c#0fC73efbPSKY4<1QA7p`c0ON%%HjXCDf9NLnBcN@)!ok_>ziw6_ zf!%cUj*0-A1)w_60w*mOn#E@PUpI{ZybuzA)&CFC0+dk=uH0xhvT^_G1~}BVbw=h! zl>f$-9R(bl^6t^(f8Er>1H1Wur;*-~1IJ}P{9iY^K%8ubkD(9wZ)|1%0OtR{Dc<~! z#=s(#Ohkn#B>|w)w{g&k5tPqb$Q-64vj0@`i>N@EkH4e1Q3mv)!j!M~#M|TTMfea< z&D%_~;+HdmJGbB=R()8o7jBmG#}`6qF*K0Zpcs*hZ{Uro^ce4ssCu9%-{O?eeyJ6+ zw(qGCD0M^ljl-;9gO)J$7QG~d-c<2FO)byP#k?gKB#nWyHjUWevP(@(2^{q{qQqy( zN6w!=-b7hTYTPn^YcZ8%hQnq_If#Ou4KeYUlv3X6@>o5iOZ4!-s2UPuFOr$sq6NFf z@RLxe?I-L1!Tt-4J07*32~5g8V1#jVs(Yv^hJ7~9L6uJ`4n0SGBh##J-%eSE773LB z)>fkRe7TN}aJHEkjPOt^R*WJuo+dGx&Lm1`7j+J$FxBjB9JR31d#FxKRO@9CP3D6% zC=qLJ$7-RRgfA)t?l4{I2nEm!1(B>r%oB8CCsl@?18MZLJq!_7RT2$IITKQOWt`Zx zMwP*^U)oJ>Hg_`3>dYk01nju*Y$i30{8e!7VQ3teosU1!yR#4_tclc0C}r_{L0hD# z6jc#Rruvf96f2W>OM37}qe%S3Ng;i98q&VKF|>W2f~4c;KZFXV45brdwv|_tI4F+^ zFonT!<;tV7^71?WGw6C*VC{)t>*eWLuvb_IN~Qc}mJ?|@C5{On5L5^07~Hg5tJ~ow zT@+hMopR@ufFZ}>l_ZXQXCbb}1Tju*Np$)g?+1U%w3af$WJ(C|2JBibh>i(q`UCic<+NS1d=p;j(rBmc@tq-Kf# z^vt%}x$a@T-mWU}!}CIL3K3eb#j}bDDW{}mBsUmD4A<7NO&Y7f0hLBU@s-7;HOyAY zmTL6UFqU*vB@!9I2-10DBPkt<7kqFin56)7KX~@mCY*GsAh>P^06}HTP`AOsCYy9xtHx&%bTwm3EhO%*QYdDR$v1 zN@R7%2UY5;A*L^3F(d{73?OI2C1!Zj&$94Ok-RP5)Q5%vtWUP_?l`fRQ<)uphe4qt zCQ=JCA)mQRKft=M;$>DA1mZPjIx8wucZ7n2fx&4@4O`-XPN1OJBB=jv$+F$}xvMB? ze=qj9E3{{|BDGmgRNq4nAtnu$tdJ%24h5}5N7uOO5c%6Hv#!jK*bb3nK_MC1_nIWG z^%Agg=EJej237NrPayV;le|Cwa96Gq^RS3YcN0Bc2p?IYMXVqU<~IqWf&|*PSy%_l zK!Im?D5e&-fP++6ii20UvF7j3u`tncj^4pGoDhh723B(@0*b;32g$1*A3op8ByoRP71B6 zvIaEG;yQ8Jp=quMQqZ7QwL<#rWYlsT(Ail#+AFMma#we@(8#uRjHD=02=mBYs+-U% z=AXG((hoc~Nfsw1cn=9v(fqWNqx~?1?32L)RB*lDN^`>`UE2CX%1g^xmEA%$93gl~ z4Hh;ps8>yY;7XJPT@7#8?w|jvkOnPGzs^2j(u1 zV@XunDT6tr(cPsF-0qcHny!ki+6#EIJ1kL?)(}5I8urwLm2cB!tIJfwe7W=p9}2<< zIq}OX!8lwxpnWUK3dBYp*@uG#=*(-PEdYn=&6TuD89x3myW!zPe%zFlrNHC%$NRIO z!;X-Pi;E^$i|zVSjW$<#+}-^>uiM2+v1HQ4h0XjZ7=^cN^-m(fPfAUFMXW^9jgPfl zOW%}CwUtee4P7j+qk)tqGCnZjz8Bdhm_M zg_?y0l`!UE+xJs^7lnBMgO`PehACpX&z3W)YJGQBlwpzh`bp>}RsJ>tjYo zjo)T~{7>RJ{7qUk3Le^7j18+3Rpd8!M-Rh2huM^&rsIQPT(dHsUuh5D>gBK6xHfi& z3=N~vX_)kiV1I^V_RTRq-=N8cQ3ZcWc>T3E00$SAgYwNnMr27z^@rQba10&?Eg2aZ1H)ym_m%K#0xuy6Lm|!F#=ySZpj(n@RIDO)_Q7C4)qJtyN$CNbrTL%i?-}(g_KM51))S-~JbGs?Atf~#%-)CS zi4F#vIn0pO2L~y2TP4akL)7I!B3a#-rnA#h(W^VQJ8eS zF^3DR?CdHRichzpfZSR1nd?HA8(HX{ryVH z%C{Cz7puS|GuV8)+qYHZwr~(TH_z`4cK>95ByJyTN(^F;3=}z0$db)&gZrhRMYGN6 z@V_+5BquSE)adTfObB@9MY3OgNP;OqnmJp>)AdRo!67n_EsuS~TNuaQQ5<4XE-*rMQuw&UPP3^@K%4{ok0_qCy`gCDhZ7PJ z4E`8PS|mq7V2(leE;sAC8&ljHlP9L%r&I;~vAl7yoqGTt8IF#Qe6`N$zQB&Rg!2T# zG*rj$|D#md!gZ?$GXh{4 z+$U^U6?Jg;FCxWuG5hkM=&sU5_MgfGqWN*d7!-h!a$=0tL-hj7`O==95XLK0bI6v)Ln`{yIDi3$=k(w|OnK2V3lw!%A~f^8enQ zoC9U%hw&ZXqw!sPgL1eR{h`d^E$Pnq)8()peUS6sw`;$~|VVdI32`G)!OR4bbUzag{}zf(m%-ZV?qo=?Dv2`nU;5UOY=f zvb=Kr-Yk8<6>JdNQ%Kq@+5eAGJjx;3m`z$hX;T~{tR)(nl?3w}cdx^>ct2mAWQb;N z<1ma#b9O~>Eb&;)6e`}5F(FI_pY0a9O_`gP3^Bp<+|8HetV70W)13o$O-i_+{yyRf zDMg;z(=$(0ty^kMw)=q^DV9f=L|D4aDxm-Dd_|v-J?gD*eXGz$l}#&K3aY>Fe-1M`j=`QSyXk{&&E)xuB!uR`MaeMKsuu~K5k*9Ja#G+b+)&_;O$0?|?R++R;Z6nN;p<+q zMd>8~&~}Kzh-8$!D<+DOp6X*(gXOxjXn_BKGTkqTO*~zAbvZkD)O`?x)0UfYSH5^L zeMc*Go0i)U$m>rG_LWk+D%ot(qL-vz;rTTk|88yVRidA;T$;j-I$yH7mr3Kj#GxfDZlH5u&7?@+7Jg3)QV$=Fe|=@$BJI1tlwr4ShqL?SC0WKq}s zR!JR}NMMHwtsc`_kdM6^j!ZPHQW-I(-Xb0_vf12YPK(f&{raz1_ZvmQ5I)nHF^KDQ$HD2 zuNkZh?iS9X{*4Q;%EN1IAkj7UtHAH^_W7AZ9r*jK8=c2*Q#55xq}=Ab+cB4#EnKVs+x6JjFI zCMYQ1Di^u9bpJvEt%hKt1AQw~9Yp-DK_~!3@J0xy)(+C0(rw0(9>yPmAb?GD5*lRYPWa1FSf zl|(;k5+h2y(|t6YZic(Fd=+;+{weCabP0YF|vjO8Mc7?f2U_A4&HjVUoEa-@x#@a8N^I6xA)5hG&e&?Rt79$4_YgLIMJ;YQRWv;<+QkufLFLOsinI# zsAV@(QyKLZ520FfeUWC(zIaZ}MYO?(;mRZ(P%@r#+**mGs*QhNviO`yKiJsUkIj8K zHo%D&KwmajS>`%Ppy4eGpDUI{y@XG5v2LmQfd0M~bl`}wb(W&cGiOHlQLKSy`q!1j`6p@Pg=~3s_+Pcvj4c%CEwyO77mu2=R=@DehS!Ol1cku*@<6^FTxqqt z-Oj6BV+Ii;atvf31Qz#^I}S}s8^sIx#bF8 z$p%D>m+dw>1vp)FG#vO@WHZ`r)hy!lZn0}OUk!RB>pKyXoP5nn2%?dD4#&&(d7+_y z^6F^VcuLXRRD^!qEY~V-zAq0AZXA^;rI{0HwVTUqyKz#>h}j-UHBlm-(M4#-bl8^D zP#HpG2MLk5k(ryARJ{c#H@ezUPHw90BkrmF;{1z;d}-T=W6_?a!GHt{*L2`~{oAlX zG%uUO%#281zJ|M=|Ng};6XW?QB!OQ`DUt80)R)Z)@x9_H9+s`;6GuGRM^z)6cARQ@ zZM4;I;vEVJcaE3b{-nIsOE^OBg7HE-i_g+Q8ptJ*b`9SM_m4=D*eUuFdZmF(e(Ayl z#spV+Sy@5$V%RGLq?MWjE9b0mX&qJ|ghY({6{dZmk%o9vdxJJvarnRK@$VbbJEr!P z)XItJL%aKo4A=#Gbm+%G9Mg=s>*)iz&xd#Th`w>8QQO>rH!7{k3v^8W`tf3-wE%w( z+0~!+n-Ghq;huVGM>fM)6txic1e3?o3}3%;v)=Wtnov3spCKkLW2p!>_a!t|3+35N zTRwP~Hlr85=iOy!Z&%~e{8#Xr*pdBVbV&e6+?2?75;6mS2sq@pE1t@+yH=NMw**&8 zx7zI$y}k}rak&a-dNfgT*Z3yCJgn>MnDfp4<(v2A;eDu@DdouNjT#}tP;n9_VRH^^ zJvMTvL#@j-@hiE^HP|t{=WH6u4#VmczIFSQ;?bw>&r5MBNX^qz&9&m1S!*;Wr|y#_ zLxV(4=;rXbIp;(HoCtz*+ibajT@fkk&*UiuhBjc?~)-aKGFLGt_J4^+fR z_w{Nt@F42UvHV{xz#ufB3`|;^DC%|-Z(fq9$zLkEE9_;=3TAbU)rpam% zj!Mzzeu_(D%9OK|XQoV7y?QnZ=8T!lYVj&KoXLbMug!I;x4C<*D$OA_U!v|w`EG3u zd=G8U$ms~#merpNlQI^G2p=oU;pkwi+nTBwA6Pe6HivZ0krzdmqa1P3eK$FFmp{~f zHN9N3G^T3SKtab+X?2|~JjezU#eJIWSz{3Jyawy}(G_HFSg>3%#pFWBbH2Lr64L4z zJ^X}+^dS>Sduf}3D>sI_RtcdB?w0flX>bi|P@u-ET;$mWJXdr_V@3yseWmi8)51=nJ9M&D<-@^9BDIDd6BnPCTY>9*$p7C zoSayE8^$3b^1nNfq$Vw}Qvdp7{t+gM1G+Tt+3euH!5>D*fw0Mh_?+n%|74l_(Dh24WTF$Cq0Ff3`vgw zg;TiY(fySgVK|{>t{p5-FNKHU+u-O-C*N2DW4U4KUl~{X7(n{q?kN&y7?5 z1Kv|XJJovGozg}uCUz}Vv7C;6QlQiNw49&)W@{bsT&Q%2((I%WxqHFd?{+NkE+fd< zz2xYu5!rvnSU|RC{aMDQLrr*HscCB64fcE%vu(k8ktNwka5G&)qU~KRhLD%80fB=J zgKFN)R-l?}r6IjFeE8w=rLNo9VyM%$0#cxRjg9E{IbQcujBnGorxZ1;;w!9Ll$IL| z44A7_!Imc{Ee5~pLm2*cdS$w=HCo#9=*yKuNvAF+iGErMN;~f^{ZwTEFm67J_oqwl zmHUda-2Qy+Y)>^mG`>fh@64X_8#7d7Mux{DJHzy`SqlVg@8D_3S=^P*Gt|`sh;)7s z?TA0~Zwvg(G^%pMb~Ev?i3?k`V_bc@Y+ zWYN_L28NeL-(mHw4Zv$**!*^)UY$cglXsMvqbDIeRMiG14xswc=}B@-`w9sWDQcAU zoI#7pmzPj=|M-ke*So@z(6mE6Gbirh6P&yeFhd(S3+X z%T}7>?V0h~x(rSagNccjd)|(B3=<}pk13t>wLW#3!R_FIUO+w}JJ7$Fi{n30l_Nn# z_wgGWtA^oQx0s%GJJo043)^+|qz_m5{f_n;UaISQ4NBtVx=Z52j-8@@$(!3mFeI=- zF4jBJfn~gBZuKn=Cyu=6+!C#lQ9Fx5R7q%#Pn0h^uQxdDXc%h@q`j+b zF<*MvyqiV9)lOxCV=(kyrz@4Bnf-F0vMM{W+g1Nz!t}oa0YZ0e#1@fNE5>!}9XrGi z#)LnqMb0u(yA*Mi(Z?M_q8q(JDfSL84>L1rdg(Jr_*iOuU{q`Kbfft)u-XnzGT!Kh zDX{Tv+6!_%B@U*0wFvpysi^-I_m}$0kE}x{cKXh~jEn8X)j5&_80wc`Ik4BuE+r&$ zp_m*6at!jv9fHTsgJ@PEn|z|pyCM;sH<&fEr9X$}4=E~WpNXQ)$=8r^;oPgLrV;eM zyL{&$Q=oy+FgJqtfeVFwt5p=$+wN-8ux*^eid-tWy=Bs@bs^hCtWxFbr@eenIU!Y? zH?atgP|#e!a19TS?3i0=1OenL0W}NS(0QoV@H_*UN&;o)P?{aZiSstq=$Bp%6#eaD zIF#2+QDIj7uy1M(4qZylkvM@_U_cQ>mHsar4>&CF1Y8)|u-kGzZo~u_Gf)3Ut@3k< zco=+M_W~WfGb*Vv6*ZNN@U7bCxmGbQ)cbnoa|ADUL>w4~e_*2f_*CY%0nH_Jl5U^*~iqIU3LiZGlI^7Lo1T z+@T3qb`^2a0b)h@37Z6K$;>&kG9N8IKjK{)>8JD5R0bw$`ed%#w8MOczS?gW*VjdZ z@&5YBClTo#m>MfUaTDynaSbq9z^k*sV8)b6%+5%V+SvTnyRcI1$CN+o-UGk&lG96p zyIauJ;AndZ>7?k8BU!thVuM1+e=Kq*5!st9psSe+G>YdKJh?T8q#w+uBhOmK(0XKNYAcYHwN|Mvs*k}ZdRhfV@t}Wy?X0|23sA5o}p~VG$%W(EaG{h%4uk8eYzIp zSEqsMmp@{_0s_`=NY4xcchT%H0QzPa=x;IWpT$I9j_9F`{@v!zL|;$$^YY!>9QK=} zQJ%J9&iZ-7x?#3>03v^1742m7b`Q1b)WDkcmLX5+=_gD4mAgL20vE{P4(Um`S7^7O z)e3&}XLEcvqq?<6 z=i*zSr$Y1#-6>e9>7-Z_B%1@7AtiDJ{F>NbEyY0nM09IAQl(|_mXr4J9>}z+=is}B z48YU`B7|ETC*^QSaUPcS^bq5rvv;>S+Ed+Y`X*gje0_hpp}#Jnd3xeC(xg`W9YBWU z?~+l;FBoB`>=1>tzR%YVjOLFK!UW2OY{^~#54Pk#M3F5|w#C#R9|{c%TyF0vFFR&) zb0ix#%i-@of`$po1-X;4Y~`3wy8J)5Q~P0h2*$1)E3=gboADm~t+OOaQa8&kfnj!|+O&*86+XJQBKn zf4H;C49c=d4HT~GONMp^-j?PwlDottjJ$Pn@qi@it=>&MN~Cb#=9L8so?Pv|xhqQ9do2u7bKm zVUd?t_DN<~srRVVjgfkKmTvz2AdAG%b9;Zx1AQeX%85M>2BT!rr+w&ZMSo0;j(oZx zDixz}1S1z&*Gx;pEs%1`nVB~zq{G9z7G|n&4%QdFTP4EhVz2|2AcLV0&laoH%j9yj zfZ1BLCi)wx&v4A%J;Of*TQb}9pl6DDtqxG+>-UnN*XS@N>k5Upn)xt7Cy0oEfB*wi zuHVyLSH~oG@o;UU6K_8p4Fwf0zOHEaJPbB$}mYYlL$s(hTtQCmK zdYCL6(~;3J5g0+l0wyP#&o}3&MN(-GAZFbiuM2{fT|_A*tCMEeWvV-LfDNxu>FRuk zn!w=on(>l7HTIH;j>yb}a{8z2`!9sM1#F@z-RDP!Em9JqF?7l?NhBMG$Iy|8$Xh=? zuq$FI$|Gx46}(}>{W_piEkKF=CwKp+X$UZ2#)fjO|!TY$NUbsz{)gpU( zyV@!@E!~LKEg>q(Z_x(e>{V*`b%3tgfDzjVZ2a_JNt9Yk&I-?KCD;wcHJ}vC`tISO zRIJU7I&g^e;kRtzme}?l`kpY6*QoWhXHCM;jiVT#*A&P%x;<6R%-9nCo;A3K;A|93 zDNoDg9MEennjo2NIA_-=luY!2Fr`9%(-Mv2;ZaWg7eSFkfDzQnKsJRuHLl}_8Q$Gp zy!*KgRl9hhG@9(<{D9Y+NSF84nNdoPP+`b9yOw+$>h8r36rR?Oa2ET*?+Xl50Y$4y zkMWpsWE@al5{D!%PDNj3l$Ym5*Gp+(1yB{(2D$i7%?4e>wfr)T$So=!hFJv3t(Z@Y zKTnGa($*yz!{K_`g}P|Aq*Ba$kAZI5qD*S7xq~XniV}zCcI5Fu6Zi#_?#4Ke@(Z@g zJ0B9I0bBnGxY(!>C{02Pl38OkU$R-JLSwWKY=3h5Q6Cl2XSB^o;dWIc3Ld&y z;mExRzd<)2(KRnTyxIa(vzlZL#&3%lfByRlpqw1c!YK-(NgvilTHaBf?Jr$b(B!5m ziL!7j2==<_&iER-eqco62y>DxcXU@?AKro*LaO5lpH0EeiYMaYlCt=KWltX-9OY`Q z1VQ0inBa|*fDC58ON*Gf#3wK0Bh1*D&2BzQ2T>v-lx{+CBNB&dri!VlqZgpp2qIYx z8X2!(=(N&N%y3uk)Uh1)%ua>q$c{{iz8&)?>}Wr1@()(SUt^@Grs8*`G}%@UlyQUy zvvQ?Jc@%HBv%-g|tme?o=mR$~T%DMhpnLGiIw+;8PJOIO73h|leO!QT zDqaP6{Uxa<5w_o(4dc^7Zz7d7zAKjw5sc~T;xK2F=<_5ubf2P0{3QR#6N@YsR1+Ax zrY{`O%7nvRYLoNd4$Q=xb=RyJ=b8PM^{-|zJ3Gh?`;+LGtSXk6Ct(-5x2N0gUp z-ICf^0NFbv*VZ2^*=S)?29nJ^%Sg#FLS(xa8%e0Aoe2$!_Wte;D1|YsYb-C9s9HR8 z;px&trt28TBusC@VC3N7prJVhYAGt_JLG^mOn)(Dol5eYgkpOV$fs(PA~mkzZRC$C zPN^UvMM52GD|UC>ZtB8<=&F}6I{iC+zt@tjxy(`QA+=TpxA2rm)q z@ckg(g0Slwgb4()M;?Qigdtzo{$IR~dk|V^G50}xkmmox*f)kp)BR5+ugBkmDr z3XL+@+^jO%&g||E>I#U%a{*%Oe0_fG?Cflt2@hHmlN4LZm16I1!-b(p1&X4f8e#<3 zL1P@i!Pn;;r$SdSNgldjw2-AH{S>T{6Qia+K-A<&@(@A_y zY#T(m=>zIE+v2eNf{9gCLT@R>Hz@#yms4MiDQW)gCKlT_`Hqid0(l-5n9(|SDwa9O z1iq(w55FJ09IimtuFDPRG98Hp5qsF_=qCNeE40vtEx7Wb$Oo0$vsMdaX|~92OtCdx zIUyrU3gU2KjW0RC|NYi=Gev_8OC>ACic3x<`woQBRHc6h2_-&3au8g0Yc`Mws1rE> zMU!+Fs|C(u03vL^wZK<|f=^huep!(^v48z~JEf3mcL+YtIZ8;(6GRQrZLtUWa#;I{ zTz1|m5JPKnk*8QHT1q$`)0-T}2qh$pYLe~H{#REP!yUksM?%zMlbYj22@i$al`upH z(7%RTF~<@L<|HQGzMj<-B4!G>DUId^e8T!6J!6;85%7B_Cq>QcqT(zGGqRrA7Yva6 zEU!!*08~i~kn~tegJHzLI!0jy3pquZ|3hg}HU%kW7T>OVwm>z{&yTmg1V=bO_&Ccn znLIRT0;T3%F=6K9K*>%uy%2PVpPD<1$@C&JB;G=%5U>9!U`R|U+Z zW-XLN>e6p_r5+ExB_ku_`{Y6rpj*gCkBE(6M7M?vi~atJ1w;%2L9b|i06R!2sFv^D ziHw1`wUN!gb=er_nrEXI>7}jY1V8Q<3dExf{9nwdfGAY0TJlrdHUJu{p{mwMOA^fS zl2KbgYn=)Kh7gx<$GCc@rxSey$rm=P6NQ1R>wPp1tK;e6U<5iU;;pzF(YF@I0_mWp zo$WC6e$*=P+Gl1`B`ZiVQSm5oRk4XMbYjae%lIFZ`4f4;c_rZ`5;*>#p;b!Zd)^L~ z*g@+00Cg$zyrftB1c)I6>DeO;;7hBj_i`zw>fj!2VFrTTZqkorG$5yy(>C2;YbUf^~3?KX|7^H{w0 z4NT6EdPLqJw$;bSM?UvAKSj`QcKSmik@ORY){~sYvC&vU@RZTIS^gV`MqM`lMjpL{ zC`(Vv_+$HVEoh+F36YGn|JR2Hf=^xN;NNw${a9hnani^j5eiDmJ#{r@Hln#uj6-o&G)82~@t)Vy3X7Q>C?``5rR*?E>jG}L zAd(aky_;}HR6;Z{Gz4=0_Z!K%*da_?__%GooghOlC)$D?IO5&%WN4QBnHNwn3w}PE zP7Xz-TgpjQvr)5=&LyJ!hVlGGCYCS^QY*#6P~i*TGwLl_O9N=|#j>f}$=HIDDCAit zGEdVVA58NdSE}{rZZPYP%a1k2s}dyd+4W-Dal>_8yLJU^=RrJ3yFdTLTYk5RseR*D zl7JUw70GKY;4dmE5xkpZoyz3gYPQ1_=rI?ECmB|Eiiha2tT`1T!)}Shv*Z)Igh3TY zYx%9dq)DC;UM8jFb2#}oSbCxa#B3{!6F6OKC?Qc|!=J0&4wIA`P|wc#hz<-!L6Jx8 z50PXOxo0Vg>kTeB#y-yK)I-AK3cN&S;DEz!DIkm}FQYBJ zXP^5f&ejBZXwUvL^%W|%SFKN{wo0VwdOK`hRgs?^#L1*qE!HB@Y~*W#+>zAjJG>6( ziexM0-Np{-TUy+qhNIryD@&}Un*j;_Hk$2tU5{te47_2_RK(GWGDNyjEF&80op&51 zdTAh&-NPRle-iWk5DiBnsTLu6?+-R?SJE@`Vt1X=I8c8Xy#R^6<_e$=rC3>6=UnRK zkuO1O4eG0k>Pvxpfq^Gn-29%HA$p5B8ch?s-!L&INnRsv6Lgu0sVV4tFUW%Lj=h23 zFyWXZ^Ey#U|ArUy{U*e9sZ~cHxVa2LDReiwR~sz5_WpeL!gvD-bo4ttnUl$^|3>zR z5aR{?r++B8iBiaa7RQokff0ikE&ziMlYgWyAwd-7wEg!C>dY7@%5*oi{un+9Ke!f| z@LgsZ5_>Oz9Tt`>1R~eOp7xx#SpCc0(Ozbc%h5E5k)%yi8trLaCxbzbQV~A5p-uoB zwm+qo!mr3y$mK3V+o*y0rXNRf9F4!q!)wIoBLXEBW0qe zmYlNAMD zV*k?^r5F4$$Kl=1%BX0Y%(I5}$n-JEWjeHf+xC3E-uZg#`SRIMkmRsk-F`noeOv6y z!kBC_G2_vgNT1HhjG8u%7E&jPPe`}{fffNE;+DF0cw%QhYajAWBJbOm$6}oQTiRj> zxjjgnD){w+>|bnb-5(NVWjY69%6xCA)1rabM`;e_QBXEDec{3(Rr(DUoobY&yc`*u zsHO0V+%TrCU0Z!cHL`a(P6F>k1lpKCK-yP8Vk;C+dRKH@To^x=txF(x)wsy;3C=fY zqCoYwRS|BVM_cI8W^uB|-M+;?^wjjS0{}Z5g+mkL6XehhP{46V^Y2nYxF`cC5oFPr z{kA}4-O^Aa(kVZhVRk2MNCVHEkd{qv_(FZ`G9^%!Tsyeo6k-gboap*0`#hY62vZ># zb6U+0N>DG+;FvSkIS`mD);hb-d?ppmCn1(jkB@QVO?qIU4JfU@`A{zVkaZbSi#LmnEcKw}^jyQ);^=D}9N2mL{n?7*53Cv{SV<#DTM47S-%#mJK`FkO*_xF;Ve{Oko^m6voIhL|u-Fps# zE~x-wfS8ATB757F&@T6*DLE{HTx=Y-^4cuyv<`uK2)R>$BmQ@~HM1#Zwveze8@37L zqXTjYD^NkL1y%oaCpb*iWrF%|A)zr6+`cFqTky9>K z_zaR1mnmugpQcv2-|2Ioy35FvPTg5zb0?q6mmE@d_sQy5l2Rl-Z)&Gi>DA!1#)gX9 zL6NfHg4GN}V8* z>*qJC5$AkArGPUZa|C?QUQ*Z*JWDljd|4wdQ)w&x#djN7mZW@|SXh|PEv7K)7 z;98vBMl&Ion>FOzO#l;?Y2bEm zZ!fUJV_;jf#U406KaUp=5mjjbBjqh!Za~h^(}?ub1Kq!(y>5UQ479kGF>pE7%am)! zcV`Qs(8OqqRooASWxS^M@0u33@Dk z)E4Bog}r%ag<-^jhHxm@>x{9|EO6daWi>Umz2O++uR&!TfSj`%6nDU0`i6_u$(k3B zW4@Qi$M{wNj{il9-X~95ipP|%UPsue8`KMwgxP}4-3&hO{YHKik8XWO&c{mKBzR`x zdSZ5w6_ev1liB%ItPvNB%VGCQ-m6aZiIzI5DHEY{JmwMb%UI@F=J5MaTy$D#?d^@) zA=m;T*zNP#A?ZA{lKxPUSJ#47}3EA?*f7ooXJsagfvJ*AG`54 z5XDYmxvnk$S#3~OMOf}f$k-M{1I`)_H2e@~tgAr!Ezm|(%OoJl8rAzyKr0x~cHCAH z8slj`DeI!~?kiA&@Hnl_$}-p?j6S)Es~1H9{Ny(s@@QKb54Y!F&4g&e?$LWY0GZFh zU9>rPD+h0gY8cds+g{!(>BK9s7dASNM{#?lx6o4lwu_VTci759&7=Mwb!P|}9=p31OSm5$1(0evVAxiKDXc?( zkMsly+ts4@^>;2j%Zcl%LRr2)DN0;CIv7h*_fH22J!TFgZQ<^!!h0B@^sJxh4eW3b z$kD^yWZFJO-TgN5EsQa%-c!71qv=eN-{(tts{%Kt+^jnCrHtAmItus>(Elg8xA4*S zRv1)Bc(U4HX*7|sQgdMO?s9pnUasGxT-f`%$)MjY!AS2FfX9C`fgF5B!paI259h)H(*Bl(cS6`(E!O(m{Y$FG z)_Z-+o$M@l6@Gw^f+=!k$Hu@&&dITVQfVvc#+6_-;(-YL($8%j!nIRkq?#p+G;BRY z=4XZpGRSGNL62E;m4nxp5f*-}d(L*?BYNg)_=mY~AVq$3w)_|jbNHg{ zv}qAg#eOWjs$XOTl%{qgWLARVUACEDpz4fPvwEI8A5iTndKFt>T`3MSr zbUA#DwkoKl``JFcOY{2(uD>lkZTk4_Zq!i{pZ+?Zq}F9NBjF7u3|e8#U2ky((eprV zBG;@78n$2LnzZ^e{B7Q!HgSCGPjj2d3fiygI-70ms>5DMPpwXbAL=aPe)Jbd+F#l- zjZQD8xz!o8fgDf$oV15Ao~??WSIVkb4t!p1;s0!~k?aHf0JWQb-aRjK0Rhs)FSxrV zNL@UnqB(!-8yf6dFYC*gSYJRkIlItA&8%%A#Ik2{jnF2WT8(!z^H51kM3MGl{%Y}H zT~f9>!gPzke0T*B%^Vk79)q_Zr83S4aH-*~tWfKfzbpkURVtUIEJ$|6=mh>2$}5Ho zw-1e3dEbQnTl8gxn#I@QD0MH~UUHI_MDj)Tl?58y?KQo?29I{UT!%m>`s;ERK}noN z=_^`*2Yb-#G%|gCr$If{c(woWJmQGkOv0$&t_CZ2{&%q#h)V8~(l$Zx?-4#yeU*G| zzcLDxJW}h`#o1ZqR%hd-Yoz}Z!{wnpx$}LC>GL_s817C9?@-zD z?nYD*b?Q_4o({-~ZXL#uxFy@a%hU#o1Gu{K2iEvTAcXw`(de-dMR{{@P8(QG))#Nc6qyQ_3B zv2ou_42X7%AmTa_>N%10SVY#|i>N_l6c!7F-xUDF#FXIkxb|lCHrW)F2%g9ORfV!{ zm|vK0aF(IaMGU?_7}K#s5|IU;!YU=A)lWe}h5(_y1Xz>E(jCudm~i{i=*+RJWt{98qa*-eB4KtqF#!E9tbpJYyU1qA* zzw}Qryfd>2En=h5(tV>L7q2_V&r_L9M5o1a`QK9>4)5nA>w7l>Z+KnkxUo1!D{dho zE0omx7OU7pCV&8(nQHN3%E8C^;e~84_s!!5VEtHt66wr;De+MYiRCA+uFUHR{8f!+ z&g@u=MJH!m(q!y;!hx;$)jNDTj&YIC?^o^Z{mOx)2A%op_YUE=m|yOrcz|F=NJt** zByrlPemsIqO=SWi9>>ispVjmjgpijBXk!n?UUgR9adud^)*PIy{S!TURO6)QHH5pL z?5wO>sm)0%R#QKHIHNN!xbrg+FXk_lWWvA;2ROSzY8-bb%Swh!K8@X6t{Xi5LYcx2^MKhrE5 z7%-Afn6z2(Hv_Gw(qaoIJNFp=0!Dx7EMKZdxm;*>xDm{QjYlt+z{_u-++yR*ZDsmu ztxePVNVdmw!NGz7o8$JWJM|6w9{7}*p#C5X0_lHi2rU86mB>8OEB**0RLb>=;I)w2 zFJS9cTy3tle%i?qwmOaKdjLba(wKN)5V=5fJv~)k^{Q!L+!HTO({+Vk523t3tH1H$ zUvp9K##>ssH>=CDis>^Mvt8v3Fl)B<4+EZO3kl(c>75ocyN!3z{x%nC!p}EAw{qG7|RwWMtjmtuR1={5p1~Qth*NE71Bi@(je@j8O3PqNIWYZTWBVCtFIYzPbkp zov7=XGv$p2RwzK4Q!rx%7=okJa+qmr&YCaI)J_So4=jgnO#S!=7(< zt5~l8LodmKTEcYEo7@az11z@N*l;KV4&+@;%f{e-Qf3w@G^p!xeht9{yMNvo_T9{7sv9QvB8v@Do`3r$3!~US09%u z@HhP_sI2t83JhE{(rZlG)H~~4-KZX_u1q*BV7pc$y?0_{RqMG^rd3G@DJhXR+&{uIp?=#; zjnFLVacnY=a4(R^4m1gAqY=I05f*k+d%E_9W@ljcf{<_VfQ?Fv)%LZh24k0l4|$Ji zV4B-2_A)jMjD*PUk&yJ*--)Vc$OOB zxj;U)xDL1RyHIXqa~=_01< zYx@l=jQ?R#^|=ng6gxkE+S|V-{s?>Mj-jCk1CCR+v%r=7?`9q$b1nx zvqEU@d&6@( z^9bJeN7Ck(;4jJ#1}tV47N(8x79UZOqKzs_K4}Z4Dz=6p1hu1jPJq zb~(lT>PKcD15T@+>5RU2EMglxoMt%Ke=5aB8a+56uXZEK?5KoHxcC{l(4m5m46v#h zh<)IoY3N$V6nOm4h{3xO5o9nI^t%xJLhHF+tWB~*Mow;Uj-~n+MuVRZ?%5W`bm32`p^U&z|`-NzJKBi__nqag4~IW=Wjs|9_fyj zG5=#dznMoXPiHIR(e{m zx~I(VgTHXk7l}^VB6*dAW7N+PK``lAgIDawtzn3`-|fuFGn0??$JLLo2GwCP^s6iD z+tj!sPmeu}YhGzCB-toM8))1}NLb2$>F1Gwyb(V@a8^cQ;%|>g!q51K;b7pMR)|SW zWO_=WJ>RuvntMp!EU3VnPw)bw0)UwR@XN!#4(!%n=35~)-%ZqRwu6y(t+#f8O1Xu1 zr5#x2l#ZYoI~{sXyEZjm1F|n+n|2LLQ27P-maByw9`l1FVv3MqjwD4ObQ3BJIoO#U z5~Jd??Irc=cctHHqdWWP_VonDqup|~e$qOD~XYYqXfMIGkUf(SdIs4@vWHtL71mnaOwRinHO%XphmboeR}w3rK4 zV_SRCT{e01Vn@x<1n_ z7hOP}6Hf`;4-Zp`zDut$0KNa}uGxSw0CD+yVZ<6i$I+2Bc#4bGV7P9nyk1rOQX?Or z`g%8OtJ;VFEE07Ru<1NOpT2KcYZL_3#L`^&uB|>K;ChTQ?O*S6Ikaa#H4sImk-_tJl3C04c}^h_TEVy0Y3I;ZKN!$V{*(H?J<8}*E$U&Zx(#N7CpdTT(7_Z zOgdj1)T&G?yQGXiOF43~0k`eVgibeG3p0-OmAv+#!;BpBb~e@BbuL=ddo zv1NXW=@m=VL301dng#S;-%DAtjBqq*jhh(a^60pG`z268V z--n%=+IdSr-F`k_t&l4aqs+0m=4qpK6lNOyJ2*J|?mIVjCTj2W5{UEBi0pNn zR*56_$p_>MWDM5kakZJQ)}nzlQX>MHn3S})w|8^mri2r%8$7?(Yl$>IUo=>dA(NtC zZe*|V1L~K(=0T6Pt@=p5AX7ki@JH<;a=G2=Befu`pqo78rq@w62&^sx9Vd`za&Rss z6beeXsbtg8DjXwaQ^r5wAhMLpGCTE!&0H@5+zlFHwQxV!VzSSkn`7{}(RgoYtk@Sm zGL#<5=l-+ixoFwyudm*Vq<3jK)|4TTXpw34@xgF*y0YeJaF;+FJ6`@vUe@24>>eWC zqIDFNc)rzRNR8~yIB-h*eVvKpchZK5iOFTxlfePCPdOtvm*_*=QBK2^F}#E&MqI~S z{~z?YCI3RmOOL2=nx;_6Hn*M(o*sz;V(R!v-6QNm8E3VXpFa3?pFi(nR-2;4{nH)Z zL52vzYh3#1!xBckxbDMVZtf|a6q3JQK}fObEaDzyEK2n#+wxy3WRPIsKiVkRu%?s$ z4}>Vw?`S?APDm`aQKE=&z|pxvNhi90`p(A048OrD-Qo!Nf2t-U;ky>rPXZZkhueN! zM)ZQrshlVvA1%W}bd|hJInX4RwwVl{DzD`YE9y)~OlC0X(7Ap_><*aVWg|{lK-!By z8kv%jkbv7XF45ZO;|AUCQ;6-Em$G1O6LLHMTCUVqD5Z00K^HotvzLH$bj{^r!HsmV zT?lE0EH2BV>3iP?Atd$^Vt}q`EowHqbv8MDE(>kSGdVz)u+v95%(r8H<5fl`CKTNQ zr{iy-8;-m26k2iR1tLz(u_9pK7eJZs5@Eo5o!LZc?08|L-r?oE=QT(OLtn(+rt=9Kr9y< z(Ou67e%XR}YpfL`ul5!NQ(pfW4ZIP7?Zs*-s?->Cb$0SmqH_xUx^&M?9c2H{*|UT= za4)iU1g^u__;^WJ!(gHY{!DIsBrKQZKNC))@$IyJcGz4cLlX1JYfzos+{kL}$%!F&8O^)u%+Pj7Uj^=iMS>yHXIu6TUHF?*il~0IGr6CgC1psdfl{Q5X^7?1Jwn8_xq^( z_GP=+igR^*H4MYYXtg@@NguDn66UWVyU})g&lqdLBHKH!;|BWNshKGMHXql{+YGn1 z5<%U>;=+QfBLp20QTNL?|Fu7zuyJvGB&=@uk-E;sOaJK4Hfwq=sx&$Ah{s<{TvzX( zi*xO^x+?{{_)6beuwC2x&+T%ja+p5eZLS1eDq2X=`Ij)i*=sI6OtmSu9Zh9I^LEv4 z!6$vM)~HH!av&dv5+CUh?dYkHI%Yo@h!swz*}~Rb$-53TT>dMk#kqIWadVta9@bCs zp6~$Z8am-SNDAVUPV>k)X1Kk#U1Yr-xBz~(6@CA3xgbF_c)VogM>Sqg#$2c|Ci)sU z4{qFlOY7jcE9Ow8=b)nLhc5%J272XrWRaD<{&p2{w|(Ix6kpWe-$4{xrjW;Lt(U-Du~_7DC47 zb?6$=?kJ}@-%3#46_VAG6yH<1c5XE)4uvQsAD&KDcuc5#4s2J2)aH$&k6g`I?0bGei6Ve%iBpIi;NV3(k)K~tES0ddEM}y`0a~NJF5#FSCd)Hwl zwhA}!?H`wKJYl8#WnFH+d7lcBmpYIPYg8$}_FFze1w4ofTfq+4gqt8AHIYGs#r?=% zG!5skGTo=B&1OW=gIA!S@6+h8CEd!9z5Zr8s+rzyeG8VpJn#CW`*RyAf$r_OdNjvb zYi5)@tU=sxaubVP4+%$r)O#T3yFk%C;T9h$i#28rvQ}ca;X=gOkz2g#e_$gnAwnz2 zbO7--ek^ehhK5go(RuiFN>+?Q)*T;vSLLaSCITxmQTPiCj8N>qI|9gWL-u#>QpIp& zf*VT^wh&CMq-?9PM2gQ0FF=@imWn*1sk(S}z=K!em+k^#j|Y!(8p9A*V2`NxoQrWN zp}aoDxoi?};cpq@?GcY-VR;us(b^6%JX_()&A_PAi zuOkJgZACj@r!K9x^sqlHuU99foyNwzcne9|Im)~wcxxXwp*KP}(>tiWtO{pF9$@@x znfOnN23QHA(-kK?F70yKIeh8F5g1YuIPQ)kt?sN=0ju^c+3W8jNBOi^Bf}mQKBX=- z1|`&9XD}DX*LB8qu*_fMarR4v`0UHoo&3f_@7lB^CP|9jpR#H-*Y2BR+@hV`2$#&( zleeuY$V=LS?KYM|${B3vi7V3?gmpw50+)YJK)U?yl8sB|UvzfzHHvaJbDir<;on1d zoRH8r;WSu4*Z5&dsQ-5tL6QK-WQ@)B7=tL=d3Qv`Q`f0*Vr-n)L9mCXXnXeH=ohB4 zP@rL%Qi_(ozs75dh+?j{@V8+aOm(_SxJktxm3`F_E&nnuv#mdkUMR>dc5#nSPc@)B z2AUd{B5op_GwjxyD#s}Spr-WoSNUtCYtSi+*c+{dDv#_B4l-9Bf5EQo%%WB z$X2X5try0A2hk@S_w&go{W%!Bvot?mo!*u&6@yphT!Hgvd7LbJ-cH3x`*fcX3g2MY zW~~wzng4_PdO0x1FUpB9y@r1xyY{uUxh5&@mTlvU3;q4a52xsVeS=yyVuc05spx9kB?=LDysPvR)J^Ri#igbm3eBjSi^`OJ^6iu=Doi3` zS9DCl9}2|r@xECszGZoZ4KTs{{X1=ZINA9Y#|mO_^lWZz-c9np`KBnaoqt^3h&~ol zHVg2-WNXt0NPWf%kh>`YCltvgn?Eo1Elh4rS8^k=_}YqJ9!^S?XzJ~DZgL}rr~`DY zfE_~fNfk}#h^*Zn>wGUBE@*M|P2FDzXo~MEgG0MrNwSpexxV^T#_%3293$NLMK+VxXkf2+h%2}`vxUPz9(C61R9$DG&|$%M zQa!88tG56leCfEqz1)DQz&-yxkLD4$0<;DHXvVlk6W2RlW`|y%sg%>DhkMfca^DRQ z*rYt|d4EH<=+5DyI5hAMY>Ips(KV3&Nr&wqs2=y+P}rW@b>ylQf>pw(iHtk@&|U+d z%f2gkw@?==6BZ+l3B1Z`b`Kw1Q`K3}jZ`z; zb>a2DrTFa46hGypknVvLK~VUxKW%=@40y5gvwnn>#7(F(#430xMwD%iP>lXJSQ}0} z&*KxfPO<(q)S+Wsql2006O%&2GoAelJV-w9&ks0w%uu{Nw*e5DcR*05QxO{VoFpMR z!+F;bW0Nj6@NE8?5yfFOU-N>?;RYOfeF$;Q6C2s!Q0SW`p@#&1E>&!R`IB4d&EAMd ziCK&cMnsRlyDcnvPd4+*xYOO6bYg7#ch+ixvmEm#68amXy#yR)4c+wTEz^KTq=3ct z8f7wjYk_XIf+;NXw;n%HR&V1I& zb_ERru5@|t_I?KFwzm6^78}qk^W9cq4`mT*biGb#_K-{`N6S-t)wR<@B<6;aQdJ3uV&-vVRS>EHtCd4|^h{@nGZ%e;(UTWx>!7D7I@v1YRQv`Xb z%xtxB{OYKkDQXrry)+h|C#{Bpa5uENNKNf@>c%-E^RAk=gQEL&nLYyx`PvD(SOZ;+ zH-4q#fH(m#FSc&;CHs%ZGH$1JEZc@(Xg-b8K%yAdP*H0O0G z-te6<9-;}2*|^)rj@i^(hd2%HJ^c3(4L!Eamefqu>92TwwQd&5p=>wX^?a8UzM9UTh){4%EgVgalEVlD=Z$ik{twPk@`DHj>nY|o zT>wBi^B}UjwpW{EoUJA!=LQ?ly3@OD%vbdo(Mg5&g3?^P`?j!IG_FbC9urj*+JpY4 z(ZJrijT&KKw`09a@}of4E_ug515jbvTSR>TzmZ{cRC1J2zoNky;GC|(mh&nfI_F8= z{+eBxaLK~-;5Jp(kpijNttj}x#?P6JDt#e|KoEH**A68=IZLqCZg#vrcTX3ST%Gh!W>uvN#hf_j2I;yrF<3fF4Z#_ctM`tC99heOuOAb4(j+2zRnzuw6r%qHwI zOI6@B-rE3#i-u;F$NSF9`wFHf6_H3Ev1DS^j%Mb?%#TT58w>n$xF!@#Ot(uw8|x$3 z#!ZBzDhH=*oH9a8?;Q=>a2qErsU!hF^&_QvLf3l&8|?(n%0u!FCqa)bDK!sf|G096 z#=u90lCDRN-F}IFHDFulr64TQMKin6DC8f@Qmgsk`t9jBJ@PrtwCC4MD^N20w!dAN zm&OCzOoLv#8(YTjX24CGRwj3?zN6k(_~oZ*(1Z=1h*4)K5`HAMI~Q&wZLhP7OSbB7 zp6NT9(y%A^m<5FFhskr#A}sjs+Lzw(JdE#B4o7CZ4Bu^3#+%h*-(D@dEC~d^catI+ zmaZ`*%4$p}X$-)7V2Be~C0%Zz!SZr+vWZht&}-{vDZBLD-rr1hBu3G=n8%=-m>jHU zR3e{F-YLmjLUlTy9M2V2Rk_a8O3BL)b&2N(2Og;(N3-j$bABsoeA7Ta;K=1~e5!dp zuY|Q*QS1?Lix``$VT-BFDrY7aH|6TK_5P0nW?hmq{R;ED)8~5t*HOP0qQS*YK%|NPL0<=3BuV{b>6N-||2bB}t#bbX~-7Rd<8N zHI4^}_6q};6tngKhbl32 z$GU8YEWh*lWp4e5;o?4-AfISgOX&k0HbgPH0%p zwhb+e;t}V^3dgr#U{I}&RwNkv3(!2R!yU*K}R!a`O(yj;Rbj-o?(W=d?3^>>Dz zisC}S1rOwW+!@}~jOjvsA4lHMY|NK<=t>!2HZ2x^%t~-?<@*uEZES4rDzV%SQ)i;) z6FKQKOBXOM+0m8wzb)Ixg~jjdy0_;8JtrbYno4WI8gad29_;n*g6aLcYA5_#;3N|} z@DLz9yEYn>lRxa|?JGS*JIuls8`>9Bam`KK!l$SDeO(FJ7R@1_(qJKB|9d7h+Ha^d z^lvm0M>L{h9mD|F0VLa!EvC3Nr*9O!kiKGpO&g~1^=F8%!Ee&lE&tmrH;@TO`1PXQ zMKVOfG3~EVJc`l9qdC#oL+GD`GsKt2VyvbV;*!iixRA4ckKIcgp@6Mz;@Y4ZeLyA0a z@Je7gp$G@4;UE;U-gW%n!P6A1-~PWpm@NV_Ae*?aAwsbcTRICORKTmJ0sW5yw=!Xb zlRl>TFnEZpI1jPp8NFl^lxlM)JvKv=FCvkcrO@QOWKqR&5wph4Dy-Z?k}rZ-;e-K6 z3_Y3A$&`BGa_s5S#Ni`cC~^?LTuEJ(c+FFQr$XB^elP;yz{X4pysj7&#wIuc8y_7p zhYL7-`4j0pLKRPg2Z&$xB#SUyo0`-euw;PM@pbtt7-S6wCiEaoz5JU4FLHFHa3)RM zddT*7`*}tcyG}U{IyzeuQxQiO>DLicrldyPP}2CW=WeK$oewMg(%+QL+mmo zQc!WR%YYCU7Z(dx!hv6sAkh{oq@ysOh`C}MHmmN}Q-wBqM@-OOX_2$l{3gyDh&p&V zzG+M&H7QrllVJ6B^^eYJF`2jYES=Q7ndB%%m$t%rH`j#;X5&(a zHKE67AJ3{uXB5xC1*&M6m~6a;Rt>mUK6aJVl)2B#!h*&jGL;YuR)eyJf`R`l3S~H^ zBUd)MZcXfta%mXTg*0^8KfqgWM#2GjoM7IdkJfM9U`3eG!KQUX+GJ>?G})emn3!E-e)QW7ECP7^oV*7kk%JKcYHNIFx|A zsjsivbe1PIvGFYNsp^#d`Eqdt!HY>{D^dz-{C!}z5t#wm!aV__B^z1-xMWI}eW#A58$3mQ5EEq3 zJ}#DUEAiH>lXF)-BU7pp6=&$22!O>9yIB~&W$3{Lx|tA_HBG?MhS$q6t+h+RdU<)7 zWF(}F#zfi6Oku%$FY;vlO}>qJky-a_YeIIw(7SB!8rMa3X#I4(Mt`-zT6(!){I#5^ zbq`vW5yP$w;Nnm)0rF2 zf-c%Z6$hW8ooxC1s~H(hsQGjCzfe!Kl45N{(1nxI>gKVaJlxBPQ4d?X@=_HzoN;nu%CV7-VD5hKn1BX@MOp4bA5rIPMhdxxIu zmavMOLa9|9zF0+FLRO&JV?_cE}an;;nJls|dxmnxhfM zb-^CZMhC60B{mspUA}_+erP~Lzdz>2)d`H4+?55(n&b^gb_t5EPpzxzjrxGO=VN!= z^@#8&P9v~*D(DeUqpu7miec5)cu7jwx+hlI5_ewbv+kRL#H~qsxvi$}B3UhuO@N4b zZ;$>`=wnYU&&pOPMT7MTMMYPP{@ZbSD|Nl_)gK2n+msiFUPbqviO^}J`JzJeaK3$( zvajOv(OlqcNd5Ac99Epv9j9PpB;bX|oUp~pfytyq%7=MbZjQxQ0hZ~+)kolWRU3~Q z^z@oy{U0i98jF9cBTo{2b#)kEnD-{CL+Ch7ifyedTY=6uNrhY&R?&()%-`DbS007n z>>3KD{@kwftGYIC{Jc3SLtlPI-5sWuq#zgkl{1)il#*E6b{S6!s)r@Cqk=_>PS^I* ze=U*6>AESj*rG<0bo_b=4RRJD0cW8SfU5jAuW%tn)3H++S~(deNXu-GIc8I2I@jN5 z>~fKWTP(q8Z`i87pYo)&`D~#r@tV?;|(}7{gY2utgRsDQXHsVsO^^>Nj ztG3qYsSY(k1>QYQFOuqKI5)en6Vs7b5tU0d9|jCpVz|Td?*+9zv;_nnQVI& znPz1T6zM8n2sCOco>MMO9D>7kwR~JoA3Jj=0BU3sY%cV)^}I8QKLB?w;2o z3}QJ$5j|5vmXrFcov7x0GrBRE-bC2{sqEatnSS3mjuuvuL!`9I`8<^{XIXNZJX6T&KTXtg!89Ov{!3G;jA`u+R+)Lal@+L%L>gKKU4wNv-4i|Li`{}q6s#~U$xCTjxeF>OY?fd!3k~ z6zLCLuB|)m5jb*IC{c?HFGH}}vG}JyXJMlHBY!BY>8ShpNf(HBX2Asy!N`j!)Wh>7 z9ryHq+wseA%mS!diQ|Tqx9;~_WX7N&jlO(QP+yzxCzmrXh?nX3)5{Tyr+UQXavlhF zesb0uFG<0z@FPDIYwK?r4Zq7<_Prke+t~c;<4Z4-W+}2I`cX#}>g!lHS)om?UOr+| z#dK4qx)*iHvq*f84uAWoUT9c~fZ6x-DWvjfDMYtoFp95&ra}18qx6EAupheEv@CbJmmkQt zJVI)GPF;`BYu@nILqAS+9*gEQ<0f99VxXmXo{ezMF-3GJdvnG0;u>v+WhXqC`0ip$ z&xym8XD_up(H@{vvx1Tg1%N3tOW@g{M<4S;+d5ZR{kYQR5bu(+T_VfzqiL(tycN!Q1MHUGS?T%q@u*@|W~8ICib)EAL8sk!} z4@m7JnLOfxV!+RFj&-Ar(!WNoePp!E)YdB2xtVPJ`K%B@!W$L(#<3idRn~i!t{bFy zSyLNT7T>DHbszD!n@P>L4?$jc)yIliB-V<}{c5wpKJgyKG53jk@|`h@89{9tr_#K% z?v+J+@2s#u-eAI@oyXjo=qp_fYSvo4<#wNQP^%d|Cj&GO7l(I604Q)3Y8SU;!6RVpSS`tK z;@r#_3Rr-y(7C=-ax5~2`2W0IdT2BF-|9;BY^1W&1RR1NLe(chA?l!#5Apoj<~0g| zD&x)?<^3AyeS1Yp+=g5_VBUPHilCY;=Hrkr60dTk=cAHi-O|*tZ-nRU#~JtbfM+!= zvg78AZ%cveEC|HXaw$LTy5mqnu=m}p7{$!wi|=%tTP(@d8AJoG6%>{xl;Gl}$fp)z zD#RZy`vY3_o!x)n_?GO@u+M2PFE4Rv@uo6MBWxOHNvcnt9X}@cIo#dM{)1GA-Q7g+ z(Q_A8nm$-3lqh-hDCaKCu=dM08tq!O6OBd#GnlbN7ceF}YLc1 zn7ovPsHmufgai!sdSn)Z!E{{iNQF}vQ?R`xllTMx>|$IFp5%qtNCt#75?wT|2w&dE zB8y*G(IvrOsHFV*7vAcem!C)cvrNBX`;|qW#r3I)i_lmp^r#K^OY(`r&M zvC^Ef+OF5<#^UX(67aQ=$V!&!boazQ19%5ewx*!ag|g<~?O_YEso$n4;l5T7w7Nfr zAW2sF6zxij_#VG)ofh;W%IEa>s2S0!5<66k` z_v}1qW&thJp;PSUE%h(+wd1)cQ(y27*5W_^WO2U|%}T9=sXzHDBi-EQ+&Q`#h---6 i>CFYu?i>Frv}rQAx$DeJ;rjPH;Adri{%nPrC;mT~u~Lx$ diff --git a/media/light_pings_combined_publisher.png b/media/light_pings_combined_publisher.png deleted file mode 100644 index 230bae9d3c3b9984f082ee6608da14808cd79151..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 18847 zcmeF2Q*b3;*zR|1+qN^YZD(TJwrx*rO>Eotjx(_)$;39k{J)EHaW2pGsjlwYwW@1% z*Lv4l{k-q<+fhmik_fQ4umAu6L0U>o1poli`~IB?4f=frJM@1901)-8L`9XPMMa5~ zoE^-qY|Q`wPmr2)3#Fg3ZQ(xVhS0xU(8-T;l$~d_ib6@of=K9ygNccS#exs%LBS%( zi6aA{V~MGiQGTL>NIL_-ZtU+5aykWjI|J-BE>100^n1J?{CzrYK!mnWVkO=NK>+@r z1H$I(*5@l6t>@ql0MHz$lt3^?o?>Q8H8eD^@xOh|SBn7mS8I`HHg)MUx=qO!?MV}> zgrnlbKSW<*%lm-h>pP(5P9uPQu9h#rC5)p?AN+mL6D;U<57 z5G7yd6A)i&S7f%d_oZ34SG@v4YmyfLbsQ+b;$_tw4@yW6J|z#>$3aMqm6Z-~o%yoa zV0rtfF?2P-_K=R+*)t@!2JABB#H^MIyl>0dFF3 zLBc=24EnyRUj)gJ6S)%mnZerOgAo&mcJN+em69xXbHHdwaMA{&qJO=@)WGr6h*Bi8 zx%{A;^WtoMJ1*{?1s$0Ig2=tekgOW|8QYPYLaT6 zZlvwewfGn>U3DL}AN@=oT1h3NQn66SGD?ZA%FHh5ii!v-D@~7XYn&4|;1<*h_ygc> zHZD*}#2h7G;~3^=@$sF;fnk?_hygy)%iiPZ?1gTiqU}T%uapv6iZo zu9c%{&rQNj$4t4*+jAKcM04R}qdV7kYz>Ils5QxZ@vHIe0NoZj9Xu#n-jDhfzp&q^ z^EU(5)l4WgpydlJA2%U_vBll(=mAo52C_urPv3CXb9RUJnzq(@1`$h(YU|fI_8Gkw z{$|P6%v#Uq?=q^h3WqugBAcDM&wmy*U|MscP~J|%1@K-*4;fZBdOAKmxbH~d)UV70fqrWrT)oe`s?!!z6hS2+ zOznSjFqSIEPv`1BY-r9f@#yhnv;A~Rc4{4X-x>Nu+wSZ<9P3Veu93F#s|7g&9xg11 zJPGyrig>gIE_rUaxP$I3f_frMP!K#FlCYpvqM)PTqzp@T!d_}tLWZXX1^5`d&0DW^q(Z_kH)v# zd)UTkN~|qLaUmaK*%HkbnHq^6iDK<0-6~C9MJm;&v~9N!sSxlX+hXSf$mFroxoQ23 z1RXi8S?w7;{rXSCyFc!K?6>?^_kbuM7ogVZE{t#G7^_xoAWs|#)^qrE4!dIm`-le~4z(2B ziuirY$v@M51xpUyovgLAt-PfrK69t1Q@ZB0PJCwnP;$$3fO;)?Nj|0DNy25p!Ns6P zAIRFL=rhI8^l780<7oa>ySVS~9DOcyuTjZ$?O{&q+VdqFGGLQGoOzx(V*sn^umee8 z+sNE#;|=GTB9!#_<3`74~%m7Wx(;C3yW7j>o`|1z8m$qhy zz8Qo*y4(a^W}mq)kjK3l$xY*@ve&skvMdIC=?v;i8fJYmH8eE_+mT!6uM)j}4w7~W zR}pgp8_K&Cp8=P>i@YE-U_u>GfR%j!_9jR{B0PW)3{b8GU?zd+7a{Byw*=&vg7-^E z^aorboothWHwU6cf~gt8>H;9i1NoGYya(Xd0{4WEW7wv#j}T--)%srzV;uRom^J}~ z@Jyk7V*Mz$kwRh&#xMy8b0ADa4v6_UJ0N}N0XQ_l@S=|>iD+CXY$&8Kb;zw~%4lK8 z@~EhoBR7zYKos|GqOdH)R@k8;7E~r_onkS7uZVQ$|z4T9lgaE@&zJ z5W!MV6fu}2o?{-t9u^x}nzSAA9aNdIo_;;^rO2k)K=HYN;6*f!XPm9lt=tUVMB@|h z&huq`m-?g$k{M7UAuuxEV^3n7cV)3~a)JpRjy3K1+2~pyTUFhW6W$#OnoU}6JE7!C|^yok&h zPqwj|A7lw>$a5OLd4Q3K!jrC`0d0d?z+XhVG~N6=cRI;2{b$x@8i^r=X`RlB@va8B zTDO|9vZ2nbPG_W*vy`o)?WA?0?S~t^K(~&M_2zBEXy&fF3AN z5A{imX&MAofY%L4w+k+TgckB|VAHUno>Y_5me3vaIP`2Vg!o|$`5Br*jH?KzA&e^Y zI7TC(EsQCMDEtdtI*?5ilY|pG1*Q>N9cCFu7CIp+Cn^u+4wVYUL1^70`8xS92{l=t z>O(r5WP@@n@vEp^SXx3$ib7;r(oV8RHd%N|ctfsCzDVRYMrBu6yEB(*8*jIs?O0h%fJiNOFaASkHLMB8Gq*o&JwwHSqOOwOQ(a}7cFuL-hp%0S&t=60)tORUx)r&(%wNRc)ng>E z-do}S0|X2B8MKA{%kV9+6FB5J6uD4!T>DodW(P61gSU#d}dyPF_cB2C{p zf~tu@_Mg5%y!2(lTMI-v>B4@z%Bpi?bSrHH)Oc37_Lw*Axuc11vO1jAS%l;oV$*DK z?Jd=cVw5-3YceD})W3)o#}6_LCWm;a?$*4ejI?|VPg!;^t1V=xVSP;At2v0xuGiW@?2Zf;o zGm$21H6jP(M$nI;mR)R52wz;`V4#o~2_cF5_3$;&Q{Hpu2IJ=7S~4kCis{eO3ku$}FmCc0RvLK3Eb})L9N!RzfIEdRAduu2AwOj5RMh#yXNGF+9mU za3wiDwl;1%GbpwY>b39g2Lmfs!&(Dt(`+u2sf+2cp+QIBU+81DUDUs&djf|q!!ZXo z`*T?BBqt1}wDfd?w6Iuun0P1-DdTCeX}7;xlUNefl9E%7e-@|>YixG4yIM(DiFpbA ztvEGlv47By!^*m9Zgq`x>$v~@fPkQjU=lYO>qNOT^E^$!aLce`aMXae=Uc_f8T)le8k}VM8AUu!hvBDVGQCKVu*T8k?Zl&v41<~ z(HwkSs8~p%SUO%?O|3mT-60tl?=P45@6P{iCceGD#Dx7B>7Gn!6DZ&=k%*g|5Z4mTK+A#@JNsUkm&76_`gM$i?_Lo0la`&Si2 zSD0uECEyg~B$Aj3Y0l7Htvt&e&3N@eG77puHZp1=%4f*Z=@AKw3=rrzgmTADl17$ivqkSx^{cV&Zb}za+$(Qs6(!1tU=jgOLXN zNGD|rX{F}{rK*U3DittL?1TBsNS7nj1j4Qf3Zqnp|Ey>K8Rcx^1%sMcK$&P6d?>>B z=gZ@XJbC7FJ6qN{c~jS1;Kg>9-{okU+u}GUH#0X=?WY<==5L7q4tPvQY(p3sIH~W$ z5;M_BxE0I_#0sPd!c>=8N9;2VGx2{LznlK=MiQm(y}NCzlv>8#zE+L6`-jL%9Ot&> z469K_qs?k9W%rGRmR9CX+0}J80v_?`e6ge-6DbW|#dpupDR@r@34$Ui3kxb$Lhp<( z&o>7v^g429D>ZgELZsAeRtv*EyVpM-hojKOc>+GWsX(KUaN)+=fzb9PLwiEq<8yOQ z%Ib(Lt;2>8-Rb>CI?+jrf*-EZ(h~@ro4a8W<`5CzkFmsmy7B0H)02^jPGqN|iWnn! z+H^tM_1N}0emTy^>R8qHVMxUGC@=`j`&w_Y;Xb?G8!CY6cG&5SLZiy#^-w@J+HIN> zkd>0^*F2h_$`{ije@8!v|9E>6{CqyZcWrEH8h|Z?ofgK#!HGJJj){qbC;2s7Ob1XB z_tPh!?0r!)ObuIUa!Cm@@dLu<41o)ture`<_X~S_C*bSjxx?*DoekHM z9tu4f*wD~$KHcSUC9$&M&=+?Wi}NE891tO& z-lwG&eBK4C2Q|y)unYWp+;DKp{b7Mv+Yd<41@2Ozrh6YINdm}t9O-v0M}#HIex--E z1;)Z51Rya=2Xk(Fg59H0%I%^EOG%CA@%vQcZwGw&nSuy=7Qxe=PzP*cB zTU*cN@e7AfK=XZpIBJ3z$}E;C5()TnB^JDYTm>KzGcX_o?S^6L17f{o@@4@DJoH8M z31ZuRPkL<|2;@bni~rbAp=Ds$QvQoS_0(#;eja)Tr$Zj~PPNvLvt%ME%D{A38KNK* zG70F(GzJ||Oe67KoPO7k{!OprTzHo_WExUZkwaXXbOs&B_agBa5m8Z=k-&~vg)2*c4DCmh#NB<4Kz7$_j_R#4mb>yz+5jX3KsSUfkBC}z$42kP&Zm5 z)eDjV*G3_9J~s`Rqe5@Oh(~Qu`ZXyaWXgx`;7$aV3T((cW%~QRyBO$utY+X`tP-H> zDinvvHKo(CW7dUm$>4UO1YF&rly)+g^}8hEaoQi!cmF=jlzI=nGYI&2 zz~*v9@7JX~!pe{vg-E8ryDs|uvBB!`A}Q2*hB_$}PXA zt>>ugATunfayY@DLunadnxODz0B*EgkReF7R`&!5=sAGE53jYVKM3Fz=l9~d@dd=_$!hw$W# z(oLU&h}}g32)@Korl+n#wgrO1#Ck{#g4ly>GTElIe=n<>QIOi%IZeJ$mM5RoWStklri;E2QrBDV2a)o35w*HNs}x-(R%~hr#z9H@G%PDzhBiTSlQC}6gvuGs>dcdo_rtB8IeYpici9Xos109Y}4k z8sGe{Bnm?`Lk6>9&losc*50(#RFK`O{vTxTY|i(fKT4?WA(U3qvXv?NS3-k@yerl- zD5&Fn@e!f?Z`F3=O33j|F_}38``E4k4G9KWZDZ~I>LEQ`dflGNfN@ZGx_YF$4lAe06 zpdrxGtw;?nP=}K3ue+snT#y4uADe@Nld$IGh5HWP<2Y1d*V!QT>Mv(FZtq_UA?3W> z>&XkhmePKQqNO6|QasSpy!<9CY^;k!OnxPzu+>Dn*U4mei$AFw-SNH zze1a}A^@)bt~l%t?$=KI(5h;76kNiR1IN3DzeD0`MyCNGLdY2^s775| zd%f0qxY5wNIQ4L)}qWa8@x zq4-26xTyl`kVsM53*~=AVqYZd`Vt#aJhb=aA_o|Q&&A>YHalE^1Yt(3-s)lU(f0kWn?;!^L)DR1YJ**OijrxA1^jIjfW!<33#S6ScX(l z0{%TbA0*&KROeN~vGFY(ztLrR*m(~JmF8l3?T%aS_I?liC+KsQF|7oeK5dhE#l08K zRtZ!XChUw0@UasPc641iMt_xWTBg8VFMKWzeA|c((Gs=_Ldt@Kf&xN#plh16O)`P- z;(^Wg`I=F$^Zi@7*|fZIIqi$NA|tZ`uaJk~`Cbl_H%9;fcy9{Q*M4ZdE_VjTTHlQj z0qBMA93YZZE`ij*_eNY@9W!vlzU$&!ZA&tY|92O&)VEs2VU`+4&Ec*xs#`ho%N&N- z$!;6_1ReW%leh4MrzKHWaW7dEBgTTLT>)h8O|RjnFvnyDsaPmy&5E+H$mBqKVH?Hm zbsR08^B8&=tWRU}+$9^RSexi^;q`g6jls+)riev%c6R3RxP))lX|or6zaE-MrdqAm z3PD!=`I9^&@B)sh+wpvj#WJoMiqNwl;Oq0M_l;3veI}c8r`L}+LriQp%-L(b(G1R; z^t%HH7S#HwbS6n%p&pab*gqv@TU{Q!xwBS_rCV;RdWJrCGn{?jvZ8I%84dtEK#4Q5 zgXjx?cZh?FYgknUgL~cXw!1{D4yXO&-tKI9Ee_pHLtRWk`$1?2nEh7}_kfQcnpmz; z_n|BW>g8HdNrbXX5(VxTc4-SWz>yfFUZZV92?I0dHO}q-{`~&#`^+Ih`YlI1m%v`W z=L;MLFhNL3Xb!ZYSU#I05}H`l-rJj}_J_r+@8cf}2$n#ifOn_CP#Dkir}IB(p9vYH z&hwH0_`}_S5R`EMSt1GQ|B5rOMR`u6Sh7ew{Cd0X_A3NNO@8QIpS#v5xI{%RNTi`% z+GW_9J`YcklAlGTh_41vGgW_NgRJRplK?HEkl!y(oGO!8lQoaLBxal%2H{&>J1}v3 zdke&o7(~MxG_|m}`%(Wbm-#dS3rklgt93+;^*{(e*lEc?Kmz~;1XD=J>%3u1P9`Xi zWzztVnG|?{!W_xkUaQ$a%E6HaW6dmRc6jcgxv4wf?X>fuFAHG3@A29ggHV^wKnnDr zQ0vr`NT>+4x=TZp8Oh1_c=etNBTs}<5$4bnacCn_ztj8ctvWCkUE97NZSH-#(Z#Nk|#|ak4VS{8n|)2?$gt5Eq31l2B&sy`iAJiTU~Y9sjqQ0+8#w z{4ac2V;0^>&3?UaO=vgQ4mmiK%eQC{EdESHR;56VPounhdRDO@C+#d2-4MYGX;sX2*woOEK7Fq8{ zIai?&zVo|iS!G^o!#orgI6y&RuKC__gZOiBw65i1QJC5L!TY=K7i2St!TS|@E$2xe z;|>o^fpVFwBiazm86&$+V>_RZoM<4|67c4vN+x9rxr2j)o~A~p2G~&)_?DRUUPMN) zwC{__o1O&asCf(|*b{W?lSKgeLVin@k%SEp^!_b6=iv-EkiBD8P5}d zBRKi-1cBGcCS>T{3(aP*W79UVal`!z)iQ-VKAaB=cmbhq`z;qyK)bT2V3NO=CM6MVz zM03m=R@5t+>U(S(Lu)io6!dB~3HVYxAX=t?pZ9l$U&_4W4aYB&i5mxDEfC*--`gtz zkTsCt9`D`2u`~z%#TWkxKT%Uh#Wyl5v{)2>C=4Ei7x10LpD<}weJ55A2w|ymhW+4Y zl(pZLfCRx$Y%`WInnqk?&+pwPE~W)n=@+1Gz3el%W~h8UE!1yq`~;}Z!kz_gH3jW( z`zY)mM#woilS@Z-z+6e7BqukNavLM?FvJdX(|yqL zIjF1(|A4?BE^tU9hhpga%@2)WPap-CNdkGuNkC!vQol%EY*SNzZFu`4Q|4=RVG?LLO>vyTWe1 z)QqqHsgMo3mb6LRR$8YaaT-QSS<@dnQcC59yFE3T(6i*=un^iN*XaGj4E1Bx81u(E z-DU&jrGu~HY&60T9;0J?mjskwRVjsia(}9TfST^xi=ke-;%m*!Y0FT|{%TkiGW2eH z@m3z&)Yosl@Cs+vj4KBFp;A~?rF55Y*TKfb;PEJ*ktA^7Ytw%s+yjYDao^%}WL}uo zl-f8zdXD8IXtll={>jH$)l1%1(F0rQx$!IIZPlt6QZ@K6(V#@5Ko;!+ohFv9RzLUs zJXJ$KDl9~kHx|oH6F0Ph`mrQh+6N8orO8PPa0kc55UjW}Ff$Sy<8&|@htG`~0=H3O z94E{BC8IOL1?mJMJg{b<^pDQAHt1H5T1g%RM{mYN+o!2=JMp}VRRuYA|1f4EPUX4aA z-mI2gWde-kZXH3Z#%IHY6zn)k`^WfV&mSt?UY{wUFHJW-Nd6f9JX73$DSA?%oO++k zCq*{D)#kFCsh9kx&|NXVzem+$kV@67{pL!cFxw26uF)&%g{KFg@5Alhx`M?h3U2u# zc6M}Qm7K=`Pv&MOCjKk&EqCT9Zk?p>oBwi|^52!qzMOQ{XI)Cr*Q>e6!jAr;AM&g+ z<+2&7VZLW1zpX8#_X+5EUtdUC__+lHRUZ9L$l|b^SLS3N!l4uQ)4)JKmyc73^<&7t z)j+)LDZY{wFQJ&lVe5QLF5ph?U^M&p@4{zwSPXb`|1*oT!v(@%F<=~tA<#4qAS6$& ziqDq%OAxOP;u`buTh4H~oi2TsFvH<-g3F{2mP=|Wo-nbVCtw7F+UoINZ)!HKtJS*U zNA`MYm>BfyvCBNj?YP_gHD-s;t~Kqk^!$&EEqSe>>`MeO<+tyL`)88~-V`=J!FwL} zK4sKyB&un`4A>)CQ7vW-I+$EN6}E5BM9NRF8FW6Y^plc4u5t_Dvl$ekt@N%F z7_JC;VisufkM)25XtuqoRQ^ylyNOpjQ*A-udYaO4~t{ z)lQsd$KJ0eh}iSFTn5qtjCqEl3M06~*d#MKR=0TU_lJ3F1$nKsz0VNWRRR>s-0NHf zoCLjbwv&tee1a)YSi%)+khOi7s9j1Rg4aL^4}wpa9ItRG`wasvv6Rt1{`N^`M}7t- z6^&&;%+uTyMlXE)bqH5Uxjd*D=jMbB=|&8({PXyakGI@|b$4@y`hFCOGgmrxZT)hko8|I-V$F7UH`e~)H=keJ?nDW31N_yi3+4}QtxXx1;SJ5vAP zF%=ynO-amD%qtZ}X9?UH;|NPt>`jXQ=svfEr{!0af<7aQy@AzyMYl0*+{v0g9wNEn z1#4OTC+{)?E|+7awzGqO108*lU+AnTP;N^_SXY1aGhajl`N3YsK!jISR|upv#7{aZ z6%$$?Zfy+WgsyXulyTS?P>4WkUs1?DNV@hBH!?)Jadv4tjI)~<8Bfq7k8JrH8pddO z9$Qme*z)&6I&c;nOVf|8VOR=I7ZLNCBObXhNO1(e`T+|W3lcI@Pm|0NiajZGrLhUw zlvBI%pbO&s08|$=iXU828L+#ikpQRJa>)B6AyQ$rBuOMGq`HCyz$;8DCmu<`ye|9i zW^2PbL#hD`2lNe_gGk2!KatsdnWgyjT4hft6%i5H&|X&RrP=aY^j{63;^)LZZG@FOL3In-WgV&wwdcI(iIakn&c3^#{z!1a zGQXH*eTjZsnr)Erth&asaUH7XRgj*nR960~(wJolm|N$f=w_H*xB_yZ%ex;tDXL*u z)crJ8kEXncn&uUtqtVvNk*=-g(x1J`?X-8c+XtmZ6&4N+XZ-6laNt~u8ySJ2q?xD5 z4#4_TtqRoIux+dqP9==7^lq_oQHLkhya|VgP08o09rANg6uh1OVd6vBAtLg(v`gSEglkg>{b5!zSQxFZ6ZOf;?JXj=o9)zGA!$@WGf z0yYL~H*Z3LRkg(A)^@f1dPZLU5xolp-zM!-pw)C$*QX+9+D>N+(81fw%oGi47k+e@ zaPY^cn-h4VTzKVqDDHyC?I-cSkcri=J28JpxVD>_#`M zQC7_~RBpz)n@bQ5wS+QN0&D?>3rdpjff@R%4+{(ZEI(F}N=%L)*hy;-Y%I=v7L7}7 zflqmb<2ShzuiH)SFS6zdxxZYOMj)9I$RH1NCOhxiC@CE4Odr>`7@y`T$e;rE0)v{G z=m?W)i*?2x^2D3(Ib%4%G&~)luKZ$TH8b_L>l`iYG>fj>Vls2PlczfFo~DVa_E3MR zH0E@xj27sI1lQI*mZEGu#k4AbAd+Jy(z1+PruF-1poLBHSC>I+t1qc{bT>WEwACs-u=H;4KadNJnpm6meKkR zhd~M$^ZeDK(@Yw2R9T->&;ENaybf3VuT_QFIZ*Bhuh#1K7fgdx@%H|<{lCMI%FHh1 z^KYE@>uF9_+mQrTjDQP8T?;=v^wRn1Mheu31C4s1vf8N5gml(;UB2<~gcE|f5DV5Jxqyka#cAl77V}8H zg(t}A;#c~^WwE_v(fBJ%PuJT#U~<#S#p;F$%0SiCcB{$2=6HD5sM~R68zR%Etqz-w zv$t)FW@__Po@&>*H4q6f8DZT80YCgD)E*K=Tg$ODyUwcO~i z1axmUyB-fpDk2bfCFH)fKsGt-KSLz{8kLT5!HPYTS|W2>Twr|ibN1Dq{gqNk_c)6m zlI#q5sn_GzUm5G*V3#H`pJ^3oXW7*diN~zOb228C};5;d+%ox5LnJ~x9uL!_h%xP-^G5k z`=SF4%Kdi`{{m({J+*j3VPtqMqc=ZD1F?-qSMPcr$s~mg|MgM3z7d<_%jv3$x}WFy z$_gC=<%gSw==aK*?(HMq2Ze&r{ZKPd6A(w=`m&d+j>E;k;xs*%YECVp1s8B=tW>Ei z71Xpj9~!Yh`FxoR*cXK%r4FQUz9Hbe6ki>|Ac|#yyA){QASo4f^}R%^;HJqh!5lMd(rp6(a5w*B0qXDw2rw!`75vQ zT$uQi3$=Q@zA^{lc=qiND>^q17ZHTsQiYVIGB0IaTzy=8=0~!1Rn}I@`U>8sd=`_< z792$EsAoonpeS1{3?YSudhEpKSTq%)s;FHa&>A8R0S7U@Dzbam8g7PRL!LK|b%CHc?!M0MU^ z3(u)1iS8Zu^6D*Vl8aM+twH7MI!`MFKW`G+cKmq-QUW2#xr)VW^?Pu^-BN(};(9zv z-A39=%_+kFB%|GX*;<;~%nFGeRx4!RqYr&ha-&)3zyeY`4+*7Dmgq0?(byZpITM-r3^-Z6Q- z9G(=`K7ksv)V^4T*{@n>tpwH37A0(ynac8q#O8&C;7zc9XJZWV_^nQTmtub#hI@E% zRH5>=`%H7_foCM?E)nK-c*znv!7%CNTgw8B(0TjjIU_d|+O$Mru)*tqLavI!+$iCy zqr$^8N;=hf?T@8 zd#@6W+Ki^-es{Qz4%E5U&7+J?v44dBx@$o~M3)c)mencZalD58Aj!STQlOD-C1iq$ zp`P)ocq*7bb6(e7q{>>Ma2Rgi$nAM)5z00=@mmGG_a>BI&$@E%(hd8=t1drP;3Rle zdM3chK)0jUe!M!AHn`t;**>e+&b=W&!mBYmS@6$8JYV*7%Wu+Vc09hvSn@sL5$Le} zG2ofQmj)YhY*7;N}CoMLSE)3y)vvTPdtOBn87^{&okaAEZ}A!%h{;iShJGf`S$$&P~Iz-v6{o`S8@ z!v-MwtBB1BB3wUWJ><6JbiN=F~7tBcSO3&&_Rvjv)i zCw1IXOa2`9lSW;&nW<`1)INH>HVb`P#Fh%V8=sh^A~Gw{DHc&GN!9o0o?Uweovds^ z11(2qZ-pprZ_~U{dY-0n>N!|fG*_{SN3&E4m8T;sF>!^S$XROd8xTF)>2WpYm9?61 zIk&X#dn}+?ea%XTbYxi+x1V??qrs&$Vmvd)bi^MJ`3{+oA^M8fT%JUZIuYK%P4H@^ ztn{c3ErpwyMI~T|ak+cI!=dlXWAAIvimirI9cA5G$&LVCGVav+WF1K%uAbN&^at7f zFQA6VhD0CCNo;n`a`+iA_x?|Co$^Ru{-me!aNzok zbSp|jd@2o*w#!rWyOevAO71$&0zM*{qtj{|#fcK9DXno+0jl9C_Iqs{RxcXvPLCwX zsN+og;d5iVD0dxZ16u;CQy9bC*Y!_|TQ1M1pOxhu9d9&(gJ-mgW~#ATb(mW)g#CH3 zok2qqX2<2=JD-OXMy8Tr>uhU{sZLlFQGlU74g7D z(z=@G>08kP5ZG$RdpoPAM^3FGWu#_Xwa0FvetBaiWkMh*Cqv*?H5zgFsIW7MyK<#Vx|aGjf-uzeh>K@88WHe%)XHF?9=TnD>6qUL6j{SI z>?;Md=vY*-R_quUB@yuA;Yxb_RT{Qt_aiM@_+nSFGZz65y=`1Rr(i52ZB#e1P!YZ) z>KApbHe@UfUOqj)`Y$yPLl%h- zZ8B$S7WB~xWEMpBS`F~$x0^V#TeU&Rzap!9ic}{lfGv2iv|=(NNm9>fES^foeSZo= zfc_}vH8$27r{l;wUoG?en76Kym11tzRHyi+=ne^+|LgAlFJ1S<3J8J2}FwVt#6_8u&K0Rjjg9=Zd{%QQwqq z#~0y`;R<(IT2?^`$A{R0GeMZ8H4D{i_xJVz?DjA^vr`NLCzf8}G~=9vDD;>1CMavS zCZ6|`)6A)Cd_*?O+~-y}C#hLrUNs7v^+?xvs{?3g8NJTbKh2lcD0qczKM+&jrm-rr z`}!w8Urfekzq2Ws!Px^`hRi-r@!EqfwB}A@RLtIA$~Vs2$p!sqo%rnqHW9|(s(n#b zIFo__c^I=k3ho-p#8@K;##J(Qq+#M!(uRNia4FuaA!=;FB^nmd)|;E=0{P07Qb&xlY8oM3 zq08Iif_wN*x<+C$54V}-ZCM5kdw|2Fo2z>I+7*$)9K#w9sFNI$2_eMt4_7_L&ydLi zz3-B(rdIK5V2?{;#{%ep1<1F@OR)z(N=1bq&VF3SP~N=UM56np`{8^a9p;ovM(Ptc z#p_J`7_lWw^Vx=k^!>*kY%aH1Q|+hTCe5$M>B081^{11K7|ZRUV(*r|%SW8~dy|Td zBi^5{(aO5@P2^^K8IMW1SGhg0Y5w|}wx8Qe7FvI3(ECg!bjQYL5AwWWC@Kjg>lqzR z%7lc>P;kWpud6GjlQ5yR;ns#BZkkPZ3^k0vsM+u(J5c;;7hsqu2S{~i5p0%aIs)aB z^@h9%MR&|y#BKOBuKZJs=j86yUbFSiKX(rwcz>Rs6t3HXIaIRxI?%R=-uM^MHGmq( zk}%MwMc+7NSJjRj15XJ2WR}aB42__&f1!TIZRx+bRWtcOKtYHGfE@E~mt2&SP960* z{|I{^;AcCi2{0Mqo4vDMCOJ)B0gG6evU)8fE))3E8DEOTb_o)kZ}TQhtJ<u`D+G!(8f*{Y}zMERE6XIK*84$tZDDCKly1H{)BDv}sDxE6?O44eI}S`k|> zSci@IS1TMH#Mkv3TAM+;3AW#GZwK-=^Kfu_-x&N%a4xI2a*0M{IC~*Gtd*==zD`Qu z42s5S#kbkGh9AU!XeoLk=~=C3&PE9L`x~YFHa$G(MTV9tRNtPi5*Sc>FB2^Jtk-2v z>poE4r-v~VmB~%a5M}6#T~j}c7Qn-5Im}_OeT>23iNU9)c-056U25v1Gb0><^m-a)r@XHR~I?F8dkV_U+n|jIM(9G0y*HZBwCGmM0 zBIjbrNCYTVaH9Y)l zU?+9tZIaJOY2&&NrPw$oj;q%myb0p(%!;-PCZxZQh+d=1$&y|so zkjD1loc)C}%9X(~45SnlSM7U>3S=W^ciWu~B;xU-oWN%dESD-@^gI)sgzvGqcr@wM zsf8&ty$o>pw?fsmU_jBptfaH~=gMDK&V$tvgSvvaf;ulNh&sOX5Gd$oC zFW$?;#@YjU#4PI{v6^*Z-GGyI6apIH2&yS@tVR4QZWZ`B;1Fb%Yz5d!@@Y| za%nK}`QHGk!*V4?U)kYZR4ge+m?HFy5jC$4W7qYtcEXF6(lX+*ZbWZ|C25P>?EnM zIfw(|T&1(kU2UsKADNx3nh_3v!2;EG)EPI{tbl+sd zWwt}_%Mg;_JvEPjW?Gi_?csz8#)J>`(=b%ieO@E^XJccaqEq3zM7V<|_la8AB?*s? z#9}uQP$~cM|Jdkva2mzTn?DAZBW;DAzX9BS3;N5B61q#V$gnvYFyZFlE z`KaywOa$+NWV*FoZ-$vgk|EchUaiq-yVz(eMq{yAsXnXgBb2HiJcXzK9I>G9d%um6^^i7yhrEWAoYT@x%{9(?%rR&qFvcc>WMklLNqDa4uM?Jle z_pqXsX9Y3DYe#Tgl|eB8r2wiw4v=R)waAm2n34iMCrR^6f&~KKCI;G{QB*|Q?;B>p z>ii9aP}@{Ph!X=$>Q`hBK@;+^nDoKXY&iqrBaN|#>zNhGRMEZE6`ym6On{wA;QK*p zwzl+SnWK|4>TrxI2UT`=M^~!euiHQ4&R`3I)1P~2`W~Wj@EeKpmk5>sKNx^RGF1#2D!2=f9=tQbxs1pFRrd^} zqNLoX%E2K-B!^~p-<^f_I3FO&KfM157b=X|2}z9@?)l4wb1zAf5Cl?iEP*It02Irj z4QhH3InpxtM`X~k5b=0B`dU`|AM1hPTkW#{)WW;aF5M|+KgC240UDzBh;RVKY4oGI z1d`rwAGKGZ5nSp3s%vnIYe|N3IQAm_CH)XRJQ1yAly?T_hj(N+q0j+Ae3&W^mT`-^ zAqzLb*OOxFDFdI2mI7f1BHwr-!T84KS!#~J-OL0K!9=E>dsN6T05UGKMU?h+rUd-6 z{2knA^tETe^#Igf5Ai4;#4G4-6eA3*ai#HO$|OYHCQ83A6eT^tBp58G!{N5dzzT1} z%X(-Wzdkj)2D4Np{dLjRVuYaYr$AhiKD7;Nuv$7Y-DCoGSU8tu#Qy?+3Ssoc;6-QX z-a>_47@due7!~(DGFO%N;e?3&bqMY*G;GVAqaBZK%YsmRhkJ7l-5?jxb1!whudsmL zcK&aWU2Zq~5M|DHbZ8HWfG6~y#Ql5F0HD`mE)U-IbScV;`5tinU2VZ?0Nlskqhc*A zEL<}f5JC$PekZQoyN}Qax|rCI%pH;R{n!GAr|1B4Mr0W-EHn!E{|S8ug7}!Oc%Ne8 z=1B`vLHX0~7O*+537t&-;4dCi=*QyJCOi;EkNPF*=JT3rAcRUKDs5D0jlO3I4A2U1 zQRohZ1`=JbVC3O*(t8|-@R2B${z2MDZg>F?_IEz2(0D~VmiCepZ>)TMT@psxc&mq# zny^|H+w8E%2Ky=56E2ylKMLTx< z8%36WUek{4@B7%iz4aHW?QHmN5V)&C58c7x*5?>2gTz!Hif+DQbF(SKbpHA zRrXes&v}riHm3>M7Kg7I-IZnWy%tkIL2+ON5vUi5|z9h;c_9F?anGP)Q&e}^ZcCL(}CL>6Rr6$*EPL5OI(m}7aDId}a zQg_kC4@ljL(;aCGX@7o5P!ow&78dXW-^+;wtcTGAu7RwyxVe0<`M#G6tUp%+S@_z> z=6mzDi3_kA>K3*GFU0=--`$XP)&APZWGss_wARzb^%}~3Eh)E@eds14G z+L9EE2THI|k<_!KOzMBA3~|B8%`b5DH$5>#ho;b1=nl?o4Zl=znJ~c; z#z5B8wt3^$f7ADyYqGBiWXWqO+jj%L^Syc7#06B(j)7>(K>=1<^w|@b%EmI7vuDrZ z^%54bU>u0oNEoc5)5vqwxQc{P9FJoe5HNls2{Hx_tLhX(J zM{{;tn>X63sWk?^`p^!I-`cz}RU8=_DV&0h;7J`{;{yB#^HOkccrrMGJ0|4V+ks)1 z<}16s=KU3k$&6PNL8iExI6zi$Gf)?PvJQOJ{JY|VanPS(*4B6xk%9?K95`w~1=b6r zYiI{p#syCeC7AG{A#pRnP508gMN@1n7JzoOZ{8l`g64b<2Rw}f58MX512`~hWej%~ z;NBuAz;Nv0!r?hG7$XA16%j-G4`NQt2Qc{X%|KmzGa!k$m%3b9N5+_p5rJXkf|9Q& z3mB}J39i5k)zBso7dSMa2f?9%YXKz-Ag{q>0d5bt#i9*(Z{CedcfT}mo45eJNbFQF zoah(8hk@kaiuY3Ra3r`f`>?n&hFzWgA21X1PrwX_To3>T2QG`-z}x^p6278p!0hKN z8(>Z%5CA|Dxd4z@7r{qxV`6BBSb%212{16o0%tDE1yM?-;III0C=zZiZZU4OkIlOg z>CW2KvU%IY1(-k>4pD$ToE;TEVMp{75EtOd#w<1*$T+cw85K>ehEx-)` zxA;<uAQ}IcNLzGpT;Ec09XrgHA=`xCg!k;_5r;(Aue#Z5loC_CEVC8V7&XHy#a}a z#Ld8a^A3FVjSAMddE3MVXwIx*DPaX+ICK_-lMAy7Hx~4q#a9j=!uh#4ehLi3xLO&a zULg-0RV2t}f*AvP;8}jY3XvEvGUOt-qCprF#|7KsCT{X)W3&L@S=@IaJTTl0d~DvL zV4wm1YTh2>0=&zpvoIX@|JjFe1&uW*h=RuG0GRzB073)*6afFkm6PBAfbSx%?C^YL zmu9Ir%M=cPG%_*5oF%vc;6MPL9AB9^6Br9hI5;f84aTSoFdP>ysd*bY1P<(%=4~Gr zprp}u46|3mlab3;_%L9;da;WjW1q)WgcSxD516?zyP^zHn*a1yZLf?_7wo zwg7YED_R3+L?94=3<|cU3mPQ199DgptL~HT0q8ypuM$HF=>GsTR_Hz8khQt< diff --git a/media/light_pings_cpu.png b/media/light_pings_cpu.png deleted file mode 100644 index 7485ae1524e7ead695554dacffe2b386f7267b29..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 24877 zcmYhhWmFtZ7cGnicXxMpcY?dS4GzH_f;)q|I|O&v;I6^lH3WCL^Ss}8*SbGoP1AHu zRac#}&)IuNsVGS!!Q;b&fq@~(%1Ek#fq{2{KHtMafPTlikVt}oAsgCANT|q4NRX!Tdje zi&?JQUM_RDUP3v7LFB-s1VTFT7qePxVqidy9rZQ;TLklXwH1Hn)RMhm*pzBU*1MADe*Dl5+S~L<*`pJu3_!lp&~%*W>iSL zgPF0%i){K&Fb8;@rbws~mjkT8Mb%!qd|n_$>yaChstCS8_Xy{%%wvVzhCFi*HTnC4 ztN6K`g8R|Bp>n3Z|Cw=rH7p>uC3^v*jfDWSdReg~fDtuBOv#(;<0huX$w~)voBp!f zV0-(hF>wRnddf!a?3qy7g6*>83`UM8*&%oVsw7(P=0MVs;iU~kMJK(&)gTDbNl+zo zx^ghgdh@itT^1)?!yBM&P7CV$?Z1OVv;Qp^`5f|K z;W1Yl->S%I)M}im=4$Dy@2pV%DVi%=GF`A(0?b=+nXs1d6!9E$sB&|0xN@O1$uv(j z()SoxeTh*%zaHJRh{PPz{^!V1r({1H?F_3~P?AY!6ZYp;_Lsm8q1i zRiJCnO~g;fPPxk4a~&1IaOL4-xHNKV4T#gO1?0W_tnurB*cLw@I4D}$k4lPL*l*N7 z%7AyX5KRqe`GU;HkB?w(@o+zW_@*=ctyF5QZz$_IyF+hPPj@|ogsnxr_3IM%g3+6B zvvg~Ewdb>>oaUm!u}+G_Zl~_^%&G=bcUA)CM|etvw{uB*3yu&4Uh%K=TR;lHcr?F{ z-k*rel!uPzyTHQ_d>(aSf|rp)rj?DJj!#d%J2C{Ve-rKaf=WYJ z+K+Ou{#1^g&(?j|(OqB@FcQdT|I{ztsdW^1XX=w^yZhnkRCnrojk1+rEy5G<@YjmO zi`Yo8h+j|mivNa}FX-MXs3!t|hUDd#hy$w@1sjDRb10KO-bAZe!EN1mR&wSHlv3zn z+^l{)!C1pzJ>eVUU231(v=HR*qkNx$01y5yPBG9`bZ;iN--?bqZeBrtCe6;#_;z~_ z-xy7ev&H;f)R$DgRHsF*Myf}uSg*;TN=HDMM*S&m+xMmjBA$92)pv2-|d5=C@y1D>iN5Pu%ggvxIe&|7b~ob?N!Z zeLn+{*6HWy$B+*&fx(YK@)7i-i=^SbPz3=ZFc`o#*QOkAfVNL7W^P?Cv=2SeKexANyf~@KI0Upn} zk-5<(5Y9hIEbY1G&LC*&@3L@rcBbMeZ!GpzW3>l)HT&?*JG_4`drxWe17}4lM~ce` zK2A0MZ+w6c*FC;KA|D>RySJWYxTU3?$Kmv1o1&}czs3^`?BE>%|G5|1-m!YGYnwgS zC$+uws!48!#wyM#ePijB`ioKm=Qqzp1eWr20e;=9HK(}%q$aqO}sYaFLD z2N$q%olJ#V8yTUMW-?Z;5reCrtV%=T}wEBK{U#ZlFApA)xq(v+5}=VI~9XkS*~xz_e37Ak1eBD^e=BF(hbjNSZ2)VE}A%zvbWB5MO@!tPhw z34)xNZ#;MuG2Adx9inIqWvG?6m0#Ql(xVk8Wu&ceH}@t(t$MpQa#HOgBc|&O|3ol+Y_Yq{4J^6`_n1GcUC+l`abaEbwLU zg?WTustV{D*LuIVq_)L&|6M6QdK{1YoOv8Y>00RQ$@}%l`s5eDKmVq^lk0!au?T*1 zqA}YBGa6wV;kZv|Bom7oHx(=FhsSfw=5Q;w$F%}=Hgt7(sd3`Ar*L2WLGaSn?ASMr z)W?t;Z@}t1`vv~EH!Zzs_Ei2lyC%+)5q_ot)ukNAHP zv%(vyyA_`SSG|h@;B=6p9WY?a`(U`6-~|bYV8oDMzjVP^$)NkiiTl4>gXNe*^-D?h z2V9|?Zj(bb2Vz7*YMQ_sfPJG36jVX+`Hi?5xF>cJ!#Ra}j3ghb+5c)1<0Qz-vI$0v z$P(Ho*^hP`DJsci1{aSs3(i8~h@6kN1Kx)jfJYaMDDjAvfWeE#iAD}rhuVsviV=pY zh%S%5L$)n!R6$+*O*e=M&shYcqCJC`>6V>kKx`cQvTh z2Gz`!4RscE`opa}Wt<&tr>)~{9PW(5wSVKT*#2T&l@kRD?GUf`|A;4ySM5g6P|0`6 zm-W9}F&OrHeESnWp6|d^%7jzPU5n(v_*3Ai?Yj2m=``Qst$lE7=LCi@0nCyV3^P!; z9_Eu2+dK%SfS~&u!!DE*3P#A;?@g12dU72edtwiWlhBKS5YmTH)Mr>KN!}v7hA^7Y zlNjyzwlJ0;lJGAm*+5PSY%(6$6u3rMEx08(dD!@r`znK6zY6hMv-RP2`9wKfi)MH|E>R{OAw3G+CY7r1z6MtEp3)?i zPBRI^GDA8D{ImO0w$n6BXj*FNJ=InAX_vfze-i4|5%Svb!gQt-mu*FEE(sM0b@iAE zulH8?bAaQ_eFkmeCYih?bj}Sr4Mr|hozxyl#f%~j@o)1+&MKiQ63R5nZ+8eVsVUv>2A&YlaZE>Bb$E3+-Hb5vJWZ~ zDOM64_G)DAZyP}zgDtzbUeJE{V!?Bwl4QhW9@j(Hb6$#GJ2zN22iMYxKpB=p0E8Tb zW3ZUG(SZ3tU({t(c$7s{)y#Z;mtwFqx`c}YzPyxZn(U0ywnCxwO&EJ#bc}5ze?oYo zW#Dph9I!TaJ2MDa2=m%^$HByo)3DmW-ZYcTV(w~wVq)A8cm#XGxr=^OwkLe}G8A)Q zw?B*1PIk&n-LovC-GpQnhJZkcwBj~kF%ey=rbjPm+9 zX?RRHe+DNx#kyzTquzI)wHy{7z0Ktdl0pfQlmz__p9_-;WBQ&UiEP*uxgIAAJnEds zaP)PhVIzxT>v(N7xApAw_{O|=fAvS`?(%Fi;qCn;CTwlElPbdE0c%E+bE!S6U2n-p z{L&ntx%hy6!aewiKy(-X&prE5MKJf0!5jPD01$};04w`>HO`j%%9ob z=tyWf;$MuTh{$JBSMVo&TWd#R@9-^?@0g-5nBNj4b$f>Kjis_HZBZQ@qj8EW5mhuJp7k zye@vb(|qTW^3Hj@E*P84+=jNMym7p)7yYb!Hh!JIBqTh*W06N0<(Nq;VKFkxG^*zo;9yxfxL{zUV6u{88eZUkdth=jhhM%#JlBxrtxA7!B4GD3(-#G1(bA99QDLLY zV%i5Jt_F{U%SQeZ`&ohZPH@d&Ey;=bVT(x_9IH|k6O9CJBWIP~`0=@YBHT5&*V@zN z>-n_pnvXU+lgn{8C77T2l4CWId2sjkA(cyB080xIEs6+RGK?x+4Eh)d`U@{CEx=Yl z1qu`VJE;~_3LD_N+yUMHZUHNPh@ydR1nHoui~zCdV$1(~JdnMt75w{uH_X0^;&Et| zaOVAQ+=-0!Z=f+m(ITNm*qNR5})j+p?3Evw$adS zc=*JOtu9X#c+aou>T0(y;MUiIJc}wYl|g$XPZB^6@gOOR*OUk5!~HUoD==SEUCpQ= z;oamhoyAqyHW1!yyF_o#8#HIpWI0`=Zd=kU@_r53CMPFH{(a8rJLwf@VIxFp{}2@9 z54k=Hp|D6q$JKACDWdF$d*D!vQZx={!4rO>;N5N0VsKQ4~4WKh~Sc zx{8X(+eD)=6XuCf*hsu~!R4sXu2uZiR0Rb$+8jM;H2TQvQNX2i&M|{jpk5#U$}{M; z*lM2EL`TCrxL+(QI`rI5FubiNPfBx6I@Fqs`fmJaOME;l&-aLkIOg(y_aX?otR_K7 zKRg(Tr8w;R*E{$x&Zc;ej*;=O7IT$|`Sa~xUw&5%4oh186{9$Ugo1l?;Ce>khm3@+ zD3}Bgmp#Q2|K@g*<>cgYt?5k3DO2S~LL@lkH`r+=gZ2ddx}Hb;6#~cZL{UK%ESs%R zs_|?dN9Me`zE6DkrlC=z zQOO!BM!rn`Ug|n(UIwSUsPZh){lcKL_+(nx%TIa@`u61WXolK^8+RX{*P`z+;z!+g zGXk6B-2q>p26)ghFXN3UBE_=+r98ox`axt0{N%hW_SOYr?UFd(uJjjQPG&vqH z0&GxgY-|*-`3^w^@ooVaIpur1Z2B>U&7`;67HT&*JlI@@#P_fJZit0Xt)#nK(07IC zZZCp_`u#Ty$<)}G34Jo(A|#5S3h(-ec04)he*q^S2?_CIqt#u0tpO16X0__vDIo6F z2iy$VADa?YDaghs6zO1K3yIdy)3aSP@>sLDSgsjVpboXhE%`OrnGjn*{Jo#N0BBRF zqHKt|+T+VJu2rpLiovmoTtwqr^+{~XPs_^)2v23wP_+vwna}WRx6WYTFE^dF{4R zF`6=*pr5-xTRg(nk1=P8%%9r_t#O9c;5l)L@|cY(i`^16=@kRCYb|(^5(Ucn!aA-F zqr%cWsX0yqa0AlSd#p)Ewbjs3DxOpIWavR38H|KsSEDJEQ+kc@NwI0L>52u_3z7_O zV?w%wR*Lxs8D&$mvu&y>f8XzBPiTfFxYY=~Z<0lIsT&U}duq7b&8gw`I# zRFd(Sk~lm1yDfpPR%W5yn}zZ( zUkobswyn^$zU>vnlc7QdkIndga7u2U@N|`S6CdwY32s z^TD?`gLvWB)72*PDoa|!^~35B(cexMTc_xJLO%B=0JNlFA zX_U?u%!=|B$i>|Z z@@i7j0m|eQd2;d)ExpAEwhih{z_pJ#8{oI?5+*ESSKq0 z>I!sowu1hvgdKG3{+~xIrq=gL8?Zp|lM2Eag`;)tEzm`Q2PjOIky&DEK%i3r1SMwr zmEQAO&_#;`2oyZLZ0tc;BVz$tt$N3!rYGp)7ZGUSmO*&{0|?|m69Z;WwA6L}ckvfh zWu%(O2wxwBT55Pf_ZnJ8?#if8whv@rN;pahW_E09s36e7tiCVPUQ?qazUitnowSNV zkLQgF7qRz4(tyH;0NoE4)wBqg?q4X9NDe|#So>F;DEjVon5G|EI!51k|ML7C>QstE z)*IT6QE7}8$pV_q&9HiDm{>o1!IAWh6V}O`)$U-jfh@^$%MQ#NBNM#pH^Zay*bu1F z8P=r&u^Um*S(A8}XnG0=h%|6hsl6fFr0T=F*8RF)jPmktmAbEO(^)k?(t2xko7`<| zy8L?go12A%FO>p3EG*)7^3_$HMZdoUVPV0%F!-jVKPla{gwnpq@N2hWY*U7!(>Y50 z!bYkU08Pt%R7qV*tbaPyAuW`4_+=U;Q}>R8J>AmcCo-QD8rD@>UGsfH;{sqp?kzn% zKO-@Z?vG8~@;0V2FC2au>>p^*yXY(^vne7)ok(4x)cuX)!$99=Y1xyTd*`6F44JkIq^nFsJp>s`w>9cyEWXx_PzVK`EKm%TJneUr@s)OAp(psf34-Q_vkzmP;W z5`bxZ6UI3lwFd{N>^U3I?Rfwd7)`yfwmv)%b5t`wH24{HRaLdLj(ILzT#RkE_rLsl z(UYDP5CAjmmIbppha52NVSi4avdsXW7d#{{)7c}1s-svqPg`BSIu_ppyf`BHYsTr= z9x7q~;DMIFFHsKnBmq`*$YT&C4U}s~htby3aIjB&vUj-a5H>EANIeE}x<;{u_)+_c zpt-;9@j&}?Y&aTmmBE6SmI`@bZ6DSNA}t(ZoICic$4>KuS4Ta9&Zesf@4fUEsuSX* z?c%}$m4U8aD-FZjkygzY4---q>!8)lQ)Z&DtIn27RMLc_$IJAj|6Mm*c4VuS=a=F4 zwi2F;^JB$T(15hK=QTQ@lM95Vip4+zmrr-74P|Ed$ZxaZ;pT8PB)yqkm=Y3pHQ^L{ z=sn>n^}h?=5gh+hzLVeKI@(e?tZiXwX=cCf+&N|MQse1BPm1+lcn#~t7tfgKxumkS zBM!>T$+0(m&9`p33LE2H@Yx*u=kp20WlG^3@npXrv-oo)Tl+rd7_=Yc0q_0x6rV^9 zWjXkPK0J(|Gh}Ky-=Bf%6hFj9?_Ap6NK~^9{4u|eA^AL2=Vu9=H6NyAu1$QmbSUkZ z%=mkB^tbf~UiPs7^1{$U^9c1~mRy!|m>^XsDEUZo@q{Lcr+ZLdIZ@SKjy}Hh&CYx- zXK2|Ro96SClQqVvmhISAbGG3(wKuZcT^zr?r&@_;4P-B`YAgWJ6k@6Who`>~ARIa| z7n2gbbYChV`9Fj?Tp>5;7pD+}U7ZXiN4a8mG@hqP-jA{RM1D*j?`WnVO;1b&b8bzZ z{x_4&gMkz_A*0_&g+{c7*f==psdZ<6EHtD>xB+oW905<6k4TB`Tjp9>eXrB%C0pHR z%eMzaycpHpeT%u2r)qv;TN!9I*wYoOSW&S67l%nD*dnpydQXX%M4M3B6s?%y2@A ze2O!I`RVG%#?}0$L7ES;0*AUEHH&FXzNN!WX4S%i+?{~1idOG-rWaBIb$FQ|9D3`a zUj2|5C}BIFlh4bOyU|hT3J}juulH8h^b^{iS>OX74GLA~9Uk(G-;~v@ ze)Dtp_iY4r?zXftC2MM*4=T|Y(BuoylL}#%``r|cul}yS)Y;fj3A;LHy?ke<-AkFb zT7Q``)ld@q?Q-r*5pfN%Z7h3pWumP#v2#s%>t<7e;d9&|Q%YBT1b-3wMn+J#gA5ch=ujZ&Iv{s=;Q%K%}?G_(N@bJP$ z>fdgIGfF6RDD!P>rgAYW0p&Pya-M}~D3J52RvZ}Bwdhs66B$vOByc)eq>#yE-ZpE? z?~uo88puxa{Sc#|=UgkD>!zlD@OAv_&-g`ELiajCD_LBM4+^vjt%H_Dor;^kn*cu8zn^8h9H`GWApf; z58$=}%G>Bnv+xpmkE-=${VXHd3|(BfEv*6~Gi}=NDl&C>1l7q>K^XhTg~%OqKS5Su zGNYp-hJz#X_vI1C#|15qY0`^A=d6K*vtCQ)eYd{o2E&B-<{1SFmHN$RiExpY|co}ib=7zR7+87#y zvSLGwuEXYFAT9>4lH4D3{F`_3?#m&0y|LOz+d+_iWR2P%VND~Rryr@r0D%CM+I#& zoyJ;=+7f=o^2pSL-ek10iLok%pJJOW?A3L0>DKOze(T|Ti z<0i9Qj8x4TE8-m!a5h-yw-?cc!0Pm}^dB+keU{YyORgQO^>x1Xke0eT&dwc=uq`ja zgE0`I5yx9})x<{$3uWsVz+Zw=OU&)zA{B4|?Ofw_{l$Awj7e;*j zO!rrEa#K@L<2fot>7-Y|xftF=266QtpGqiIaJnBE95sS&qNdC zyJF-p>^eW|x$hiW-w@^Aagefm8duHDGlR89;)st2k?=pZv%Iph{iX*TU5Nhr`F^*U z%m^Owr&=bV1B&{%KbSHe~`JvcQ@o<#l6xnG}D+uuNH}YwO7sO-&Vf z-zf?h^)YVn1$2x-iz{Qu83v^>^k4$k`o^zmJ>Fi!39ZC0J zPNmKL^nZR`Uc!)Or*pcE$ycyj`!^lj&_);$>cw|L>7DNw|5K*Gw_CD`aF(^f~q)I79~E=Qbr+4;Gq!KI`mU+40(vkl8wD!fSz03l_) z)bsk~{LFT3Rzhp&Uejlgx=RJ+M!YEBg2!XH>1HF_RIN}(_%y_n9Y|{B(matmUcUpi z?C+7LiAFAQM6cb?HnN|?Vu_2fbJA0+?d@IW%gWp-pXQ?pB`S)io-M`+Rf$;B|J)pe z%Ypd!sG0vyMrn*N3-^W<5Kp+TGLR8r%Y6rUbX0cQLnA%SLlJ%-b&!xF=y4aIt6P>$ zbt5ey{jZc5!Zge7Jg5L)T0&GO#7?*3t}=cHbHomflEQ8$P+xA>y#MP=NV<>zI8q+w z5Xf%1D@wyyTv;gWZ<9Zo`|Bq)%TK1bNnwBWGY(&q(P;Q`SP&y31HyhOajC%&G+KJ} zV0{d~;@Uo6LypCOSOMp4u78@)_nn8czHM8o<_iMN4dI6}eE}tOEbHApyaII+Mh~0i z0zZY`FFwlro~{G~ESh{^=S#MwMe!Ej+zphGEC5I=0|Or5s#OeGX>?WWeFhv%Mzk|XSb+j_4h$EOiVTPtodQ6eP0ZH6?%(G{5|A2UVLpH zm%O5!?hJ7vF7!RgE})f`8KjQ>s%H&zf^mzgqMhApEX|!A-6j!!IG{V>iJ7ySJihu> z;dWM08QaDV>OG|XVB9jQ?!(nv=z$orYkQpl($|;i0Kr0wRCNEQ`3!d|s?4yk-0zC2 zcw0RsW#{NPpeo`3q8KJjXQ3Ggm;K&;W1{hp4Q-^h>WE!56OIJKEiW%EO-MgkEH0{Y zey`@fqK;!Rc>uAmj!nv1LS5P zIK=u1Y%8&E#6k6mk&KUA9BWyIoF8Ynj;MtiYB(rAaHKe-0D7i+Ye^cD8!fM)7_scaKO zQBgl*U#n^no2&z_610#QnsdkBT=%D5PP~K2U6Aa$(n>hJTOmur6>nI;1YtOkQ zGiyK+(vMR4xXFnr^rcYFFlKj+yb`XBf?=%@dlj!_opvfkyi^2$B{X6Ft8QyEPN!y; z2vuFUKSxMM*ucPMyzmrG52<2XCLJtgU9jG5I4DY+$W$I86=)@>A9&3@w>sUwKK=!q zOlR|e*sFhiU;g9!7@mLkO`5+nzO^1x<__fOo;-;tG~jdxObkGih}@1*{70Sw&xlit z{XZV)>FN0ofE=Bk|Abu*WqM5rWp|-*3`n7vR=9tx`(29-+3fedAF%{H50a2aRcby@ zq%s^7S=O*Co{xdxM*Sxtk1S1;iwTH3GKBp~p;M=|E9L@GYr$j^;e@VJY%nB#PVvM- z%$=u20wCI~qC78)&-GYY8$sq9TFkG z=WBH(zN4$If1jZB^?Cf&^OhO1AaPT%|cak1PNf?vD!XZND3i;Ih^D@*V5K8SgI_`C6xB+rZoVsKs`E{>cv`}`28 z`OuH2GF=DYX#C#(wml~j${v$N5C+?orQ%d&J{HcocBUr1S5H&Y8+PGyj0!@BTY zR5v+vo>8AJkY(j;@_^iMdh1h;Ms=KD!0)+|kq12b3?Icmg}(-%M=!VCQKNU~VD+!V z2^@5qtyNEEa+QT1G)^HaE3JZN1@9CT+|dR!z7gAUBq`*{ZYHtlD&-3k1+3H>?lJ03 ze!b6rnfRDRh?id-rgUglX$h*+C}adG%B>Hgh`fU|fmGhXa3l#FPe0-X93w9>3`Wpl z;k+sQmn+~Y{MqhWDKzo`h!^sBzZqpQ>dv4!DvlSHBdurEZLnRc1TlU+@3)hZ9`f>v zee9Ni72kAbL$AO^Tflh6j40=R9dbM9u=LGm@ftR3*BRAEr6kXU6b>Qc=Yfs$rVDim z^uCP1N&dRux!^&jplm<5z)U^nKG^8C)%;wb`lu$SrLsE$QMo-|pKpbHtkNHES6%Va z8o8+xlam))8*5R}kOLMPB#-twHmExw=^&De#uWnhR?<@F{N*H{M))0CTdk5vz@t6l z907;fydDK1|L5Zx`D1O@6*;nC43}K;%K^z3ZVHjObr8?C7XU;A=lfpqy{UxO!64!W z{*Y%10TUS}9N|1xoyPP?$VvIA0A|iJD)RYqb7r1Q;9o|p987R_Uq#3E<2PVk3jvKR}$Ei9Y;Y|aZ5vso3iG_o$xUC+7~ zy8B;wr8e#Zayoz5q0n{AQJssbol@_B>uJh>fvmAGcx zZyp*0$WYLm8n>(K;r0>NNrJ`A7WsOaEo53?pGg>(%TDNe_U=~I!$zkP)_w<_Ogz^_ zbnAl{>AXfkWIEu_{cppG`MLb=1A~4L7M6AztGsl$zkr#jsWWa%AYq9_4|6Jdu3v`C z-ELpy5ERT)tI2$y7L#cW)TAzyIEWXFMI*eWl%_?YJTzrS(aG;eOlLW@k@2AMe3O@#$Fuo-nGLX<2)JBrxF>%yY|9@|(I7;esf1WY(&eBZVlVxQ8O+bS zIjD>H5)cVMne4VXhR%16BXQ6>;lc91gX!}wZCrSIwF4oCyCZBcoY-?11F{~PJVtPW z_f$RbY&rO+%+sbTii-{mV0i6kRnR-|3OpY@e4?D+#QQW)UjxHFGJ;{TOzaM9p$KsCr}(z5qP*i|VuiGUd*zxdaG>|F+v3XAeZo5SBi zl@iu6gF<;bOLqFU~iT3h9Pr>etS|6LPsfZ0e{~%I3YnWo$I}M zEWK|Nz`b#nXpS2ywS)@d`O1Hx7 z=0UpF^p8RR*9*YuwA)|M#q}Bbqd}dO!`VD^aLT--)oz8Ejr;5u?|W#D(?Yrg%PYN5 z?gyLD!W5+NVxQE@P4w>ncv_d^8yw@que%n1;YI8;MBqS`)V>FOav?MF!l5au0H8Al z9#&cSg;F5F3k$v}cO3i4@WB@m+(IE<)7r~@wRGqY0i^B7?!30lV0j&K3&533(H_;x zsn;q#q3oJkn^0lBbt_&QNq?b%Vlk^dzcka=ugr99$WiX&I85#f;}V65LEiT+)=2(y zk)R2|A9DngV{w6syNofBqXNcozY?qF!I;{W?dtQft?#D5tP1e<_}7j}9D@=P#CwdZ z$Uo2?M3DHyYJWZ-#8>|vWAqmaSFl^_+}SwfZUcki{t>5cr? zT#4N^oDRJO{}1OHeSPcDNAPhhupy%_f9N7}& zF7!eFPcM@ZEP?O6Q=jtMlGSR#Vn}X<@M0>3KhSiCzFxJ_R%?+U%syZM97a1j8BPu_ zX@i0I3f?dYYGusL#`O5vCvDzaBLDS#r|+g!e+}YS`Ty5-4^k)hcO}_F9-`uVsB>71 z2<*lhW0EP>I_2|%bZTk-5I5(6jHN!pks-0H_H)S@{XpI^9M%15W}vxq(6q=5bT7s} zM(2zI7AsKCkqBrW!6XGG5cg=*2`DLy++{aGDCqu$l<-cf-+$r+9@j4-aDD zkSdHWq&$NUxZz^pgt3J&cj$FC1L?v`EMyB+CsUW3F>jCXMZj#C;A%i#ouMh}olq0z zuqNsMQVS;m}XBjCRXl?@x8X zGE1#0*|){R$i$pyV}VqvmbWt*2&^we91r6RsU1j_q(H71(nPS6>uhf4F#ZjQcl>^x zN>;7(Q+JF!d5rjfq46>C4dw&XltxhTl_1<5o)*V%|MO7)LJh{~Z7Q+xR<~BYl(RFG zBXu5H1dydBN{ftNOPio_I1Fi&&s+jyn; z4blJ=>fzzE31vc8WLPEYX}|8vMRL9NqxQ_GBr`TvOI8y|?Z>cOQW)H#@P zvUdS(Q+7AJEp7irUEfTFS#{u~SQ^)mQs9QThe6d^oox>Dr45~0hDPlsx|KTg8Cf;W zy;X&ZOmaRdmG+xDIqW$6207Eb!Xzp55e*B%jlq9C?b^Wj=wwDT5`iLQ_J1lnHB?`C z^%-Avpal79s%%>nO9~I!oUPgBzdEE*3Lu@$)@fuSEZji2c$j#M3s%g+Hq{({>b`S~ zoS%p>QsH(wqwc_yIPVIiJ9^(#g}ONC&i(M} z{77RM#-QA0FPkgv8K7QfAtu0pdk#6IoL4rgGhciIwY(WkwO?rTvL#-@I4#RSx}W_u zn%0qT4*PF|k5%}Y$OU{1ZNTNo1+s`YjOoF7wnhTrinIx-a_9Q{cZa+QWfKFj| z#a}uS0mTJ6VXg{lomZxRXHJeQ?!Chm6!4?eR!ZS@C0t5n+&C4;Z|Z`kkRkh&x3hDt zX!z)*?+xr_U3B^)E=+#Q7*tJA-Bc#JW7j$~rAJl=m~WuQ)T$SK42bN$%4?y3@I=L^CFcjdrRW{c+f$Fok~f-AyfE z=uj{KGt#d6Vas!;0fERaSXC!_>S<#+So;0SPG`uT2}&~>2_<`iBgm~8$Jj5?ovfF6 zyxRk~gI^Ky8U$a_DZ`Uq1w~drl2s{D7Mnc8jrGdQcf07}0oSmnI-$-1(ED>82>`16 z-For~-^HaWAL_Q~%I}9UXXm2Uj-ks7r~O)Qv0F0+mB^pTO&ktA4_ZoVHjxJC#+Ehs z%8*On_lqUr*0QPczXb25I5H37-rf+zW9}UU4NA*5KAAm_vM`;XvDEaCwF!j`4dyi3 zH{s<@KXoAi@J_)*{d>&g9amexFb6c^yL`>{fRXK!{zPYIuF9F6=gRR<0n4&_e24bE zZ%UR2fcl%%x&=XC;7{o^O))7N5ake;-nfiDKta&w!aP2ala0sn0!LeZdD+;*k;8%; zlgy0bC`E6}NuCf9RVt5qh<5U$6RNBuljIsX|FZ5F&NRO&5w-fqGl-DMoIJ6M`|}_5 zGz}|%*4T<$=H)j+-c2-gOWNfY&woyv*KS|+ON6?$V)63q(hZzHxa|ymj(vMNaQU*= zx@U`Y)-l*8#K3FWd2(WK{E?GMl1iJoYE1|vPh#d`Eeo`+ zxyLkB_;VGW4L18q`TbM4H3VxuLj*<>Kd6 zP}HF2p0|;w)1^O}Z5FqEE@}?q1ej^#K0$UO*dYIpS5q6|hd=6sMH9aRLHhg%a5Gnk z>#fT|0TlxRF^qYA0>x&C43-A+P6cfnA&8A{B3lZ8q~H{(s@SVGZ5MZ`uwTFGI>SdZ zqJgjYpWVm`hLD0FE&MqL?$UdLu3U1qsIyDJk~%j3GmjiQiHp^g4?&!=ntVNj8~l0? zBIhij4C$$UR0*<}t8-K)U2xSqB-Syx;d|T>QK>viTY|Z2EK+v&&$kQXuUC)*vu`&T zVYLvg=aAEVV{Lc}NW4SfY4NGZFK{lcUHNUK8JMjGl-2*O3&jMRSYXg>J+Et(J6ula z*!yCMPqnih1uAN>f~2GZW7l%7X0qFHbDP!TJYPWWQ;A6v0=|@>;v0Du*x0ik)X5C& zP+IOuOHc}jf?ux zqFboD8^rdjp$y*c!5r`2i}r)z*ZP$<*R3~;Xy<8$E~Vl-q<6G(FLovh*$eyD5`veB z*ciDC-i9z~hhWTk8w}dD-H+>bLf-2M5q5mgngMQAul*y`C(|+1-bO zk~DQF-fBlOa?p`Awj8Ao($NNxfOT`RP1C`i^M?MYh-73PsFOdCQp~_n@8mWR6JxYw z_#j6F<)v$V{-*-C%!eY|d@MvFlibvzRzEqa_OF56lCe<`FCr1)gvbfVK!Nj(9b`PDd-4mLD&8I|lOKqT(kP_Y~1W!c zf`PF!5J6j@Sr0Wdqo@ECM=Ny!Vs)agLzz6(u^89&lN2?}sAtoY*SxlGvnT{s&Rus+ zk{QtT!1y`Voq1tD!2fRld@}Tq4wFhoEoz_w^Ds%eSOvr%h4RNq#9{Kq?J-v0Y-^y7 z_S}pRFsc)JteU!yjR`4RB~yHX+|96E9x%rCYmH&CyynsQG%yuXafEy}3zUyL*NKfl zAR?mCfCS{r0Po(=-n(43Ho5OA)@W_K@Xy!!#B67*cvR{F+;Wa)7bV~9j4=zx=*D@{ z0e*Za7KGbhJD~JasadsJ`2h;IyYKi1|AzYNWd%`b*BhSpb3L~U1I*^@=RHT`h?*%8 zm04)55q+Y_Ie8-Ks@2#(j{s|rwU>V=auPr)!uKqC4lHzVze9aPSi!INI~xvOL6?=k zD2jGZV926BY>BOHbrU!^of-Hj9*MI0YN$ zRCRP@%&%?_6GY#4K?M;e%>(nzxM8SMj9CN{<-p;1^0^&}Qog=7{#l97^gDFW;8 z84uQsNL^>3#~l9Qw_!22W=$EC^W-w(%C@+PD&O!6mTV@2KEb0>ZKpgW8pbh(k!yL( zhfq>${-IIpV2p-5-j2BRltSE$qq1y=eO`Ua`mjI-NeR?=SpM zWpOi8W{;soa^w{dj%-xiT%}z%GS$3r4NKFQNPrNtQag@G1_}q}6mVgkMa-$`Y#Hj* zk6zfJi8hhJZ|F!ir@>I3apzCpKz86KDWQ?d?^;^es=g2B&{4Zly=lWT(@Z!aaru3( zOLg@t=8W;NaLLF-{3+L<7-nM{OI?%lXLo3^sS)A)`>V}qdvKCOog_d9iN*!H#C(YRn;K1a3m8UN$mTe;tmc@Wl>bjHXBE|E z(4b+QP%L<{V8Nxh6^gqTcZcF`#XYzcD_*1&DOxB{+zUmEyE{P(6zP8ayJs)qo=r;X3w*Uzlg^1-ae5Vt}ibNatRz4QCSdZFDVJ#77j zTRE9oE>OmpQBK+fbLOBCN?L41Z2Y(#P(qYS9N1(y8jR<)V4aDo|4qXE79-q)UhZW< zBOwNBdclw!C{#LRzwT{}jgz5YQ6%^%?5Bw1Jg2jH2H;(DTZZ_tBp0Jt?1h=ki{~7! zhvPN{UHhT|P;Fex`d2KBuMdR^@RT!28JL&v6$IyJ!}kx^`^~bszel|W_Z-s{gzhLB zG<|kWw^I?3bmGKRI$`@6w?X=mn7iN13L}454j}M7Ek8WM7=L46bCHK|uQh}77ii~FxT2odGrA31+_BV5QQd-nn8~#O z<$)1d4Qgg-AyV(z>yF-bSA_zKyteRug&$_x(_0oPOQRAK!YeZ05P!2UN7UF2GgPOU z{=#;v{xYbZjN?Ax%nUCMyi0Lb`wN@_?La}}VtD0-mnbvLNu{wp(#Y)4S1YEOYwlxY zj_RSyW^E&H{Q%)l*4B+!swzcze~pGTmifKcUQ%!tQ6*O257IdbyHvJ$b3{V2A|K!q zT=TFK{6O^9jOpi3w#ST)zIp^H5tl1O`wZd83o9Zf$CJ62^1b3=#%MHebQrzqxy=<4 zaR@S?229RHb{L^8%P4X*kvTmX(prUYm-!?;thFE|gk_$ps;YV#A~brko#(QjMF;nX zGTUQ8o~#fud2f;Ih!2(@mbWKM{^|uZ+;i3a5>nmB)HT}u@N0UFwcu`iL8QU&fd@mC zt|Z7#M$2v9rkLL*t$AjE1L35r9m}}+I2?vSlbngd-IIPziX>GWi48SSAFWN8A?B-k z!RwZrK$p+-v3?CaW=-~6rA=ZuJSf!#P=(YBe<-9Id6JftJ;jHGj9JPe%DK#-A`+XV zZkE0k{CM6r+B_>W4zioCwcZP$lb&3M%2MBE=k`^+n>p8hI=(P&%SgDn8;BM)b-YUp z|C?yqWXkeb1UU8+;<|QaG|}$d7wgsdI-SrSZ`=9sE^z05(Mcz~H2UFKIDXSteKxq*q=n-u|AqN zHqyyhdF=7KRGudZ%=6i)zsb7>v*<_xQM5vHJSLMMxxzMhhyGfj;Szqb9xds#p#c0oHx+rEFA$!`{?Gwpjf>#`egrc%e%PfjfA znd0&LrG^cg2af*GkiGud>S(mAaA;t(XiJp*_f0-cS#*?Z%0E-Id&qzKS#7b%McoEI zOhS!xIzQw4-`>GcU2>LPd$B`DuReiFc#-+MOIy zP8JI-AI)1^xLDWn1(_x)4|+^dTW#-lWqg#>;IADA>aoiLc5cmk2h;*mO&+&{XW1X- za%T)j4j#(Z)9Z?nx8@~^*9_?>+X5Dpa8U(6!S`d}LK3HqBRz>)M{fhM`?CVx)%gzc zYmOImu+%oJ(k|gEu}}`aTvy2uIln|P0;em6nzd{u#$xm zmta&uQzwFQHL3VrtC8UDw=j=c$}H#E^eO>5n|9xkNNL}zjp%5SOWqu>$AHU2pDncO zQT}!+i2vMgpzY;$;mb0d$7N|$;@iJ41UV7qTtT;ic+wyKgKcgQT#eLGJC4X7MT68;%g!0=%?6)gQ7pBlf4e&G{Qp7Iue)ovVBPKmpI{g>Mf|+oS%c zV_U*mTlq}4HshnBh;_|l2BI51U(4q8n_XXaPhh(ki@I6qTB-(}r`fUJx9gw1zMLot zRby-4>DdAq{yjDv6ypiLuem4q#!{We^5&~z%`M17p_>K5Q)zaE!G0silh|V1>P^j9 zmrp<2VF#<;oh7Io>la?%*NneggU3~nHYl2{_NOs)PPyFDqzMK#jc3_1F1yuB*cTMz zRN<$ujG1`}lV&U7F4!vIuw$TPdsiQo&`0xM7|1gzT^K9K;%m!1fB4UM-+PQggMywg z-F9Sh;@tnPa&Pn-GAMH_{s=nHAwb8adWvpP3%)uF)F}4y@aWA`ix<3k86TCqeehrML0KiZi9(pke-p*Zj$h-K!xyTm&bXe znjvMWb1=ERma6`1Z}@Bx4}4^UqP5DqpPS{?;zRKP0m#92m35xQCyxKJw5x!M*inLn zs7W|bM}MK|nsryD&1(5N{PQbZ*P2md9S!=yxD?w0zoVNBBI45(L%rJd>iZ~&L7tuQ zlY2h);72zIdIPU>?6#%u;wzdi@mLIA)g_Gkyn@|Bn5`}i)5KhGaq@SeA5 zL0$V2=S1u`p@@*Bo1clvWM<7Zsq5)7Rb>dVCJ(Q|71#va0icyz2+o=e*niq`Ej|8g z$Er5UCpy=@WdDQ~cW8la!?b#E3sK9Bf%fN-Z=GAIi@oo;DRHCT;5QyiX zXu;u+&0czSzN>Vn$LFu!`gZr9zpmAw;X4=zAN}j@xlC-^UZ|AA7JC!?oeLRVhlt|j z9*b|!n+~NkC~F6Oa~!01)qZ|WA?h%SCzW&~R1m>6nr^iG8a{ZJXlj(cQ{c1g zQ6Q4D<|3}z#ZC41?8jQ(vJKq*Q{(800DrkE!KEoqlMp~bg&Hy#IXyn+mNHSP#OsI1 zYN7my5r03f^umO4X>Y2ip<<3zR)h;aJNc=^nAqLu)hN8Cg!*0f}BDW(yo{OSZz0*C?`m} z^~;bq5$$cGjwGe_1diC|QWmeip_;C)`AdW-QFyv%N$j$ArfIG(E4$Q`cUjM#Tjzaw zk|RKP%Ei943#W^)*p(YO=w7(zibyv)3B_w7vEB2U7n@euIrw()(4p8ze|wkpLxspD zn$_Mr@n^)CvchkWwz$onS0YC_nd@UEa4vBZr*2c(`$|J#H>Q-v<#owVDU8k-g?hu~ zvW?UO>K-7-j`EXZsE4&K+YR}RwtkSC{!eB;`TMib=e+W6_&GB_`K-<~l1*L!uZeF0 zGGz95uVQ*l;AABYgu!?w?WISGfw^Lyv*nw!2^q>j1`!|oSx&9QV^0F|kWdcb0>cSY z{EL8qZ}Qv=5MwA{!2KL<2WAyI+7_Ka_IpHr`K;R7`~h$EMWA zd`@7Jh8nkd;~fCRa1JnecI{Q)Hq8LHX%mln!nmUNmf*;H{tLs7$shl)A4@?cC`bWs z^~!-?4E2FfW~uOe*DbtOr8p0X;WWvE-gw}9rd z`()zhPSla2RM{3sM(X-Y6Fsk zsqNG(ZVjP~u$kHmOGB~xx9HMwdDneNrOjKO$Me8h$82;zi_PT6_rUuDo{$P5s_ZM>K$Iec1Du}`4P#t3u;IxFCP4bk9OjEs!XS4Y=` z;p^faz0=0j=Hcy={n|aycnpI+iF4dems^0H z!+8~*yV~wQp3M_|G6CqoSKy4_Hk>)%BRFl9JuQ}B8(1cf*NT&eW zg8%-a3HXW&;Xp5fDByeoHmR?^;!f6ow$U4nMGAzAK2qC7Q+n$GkS7J+dh|6-RXBzb zF`hz8KI!rI6Xc6zV2Vu{sHVJ}iJcv&vw#B{hp(d2J-Pepw-hTshKB;4g6{pow7s1j z2?8M@A$@&)Qc_api!RqWI>-JD8$GnyLXvZysqhHDQGilT%|6 z)NwEWHJPLA6pT(3XI9XA3s2+XPgixv5zbzz0ma{`JlC0*C4C_Ja;b!Yp8(23D6AnmQn~(Of1#f+L0jV3HljHeb-8q4zH@iiA z<_<_m{2swzV)(`*;A1jJ-q3Gm8nHeVkD=4mOJ$KF9AGYE5+h+ZkQNO(?_Q@-A0y&7f6piu%#L0l0gF6r)9Xz;= zLOiPW_qFTfT6n&=LQ$J`>_9mCu>Y0FzkRq9_aX}K*ZSm7NB9X`p=!CXVwo`NYz!GB z(sg_$F*}7x55=ywchUAtk>OnZ)N&G};Zh$ZGm#{bGCJ{M`*Mr7X=hZ}!_jDfGL93| zrwfucHpmy~kI(VL48)|xc0sh9ysp3{Lf)(-06=C76um#KQa`xLZpL5fqlQssb7k?` zO#y;6ZZX#;gwrfU1;#Y=Q9(hH6Ivux#{BPo?carG=UESCc4i~j3S<*qVXH)*&3fQI z{x6mPG1tTJ5Q#Ho@88lqkJ5!WdI`DYCyr~5yvQebnPh%d&7WG|mfA=|lJX_I|@ZJ;N%l7mP4O{#PrBr-HClWG|R@jtH9%j4BLoHTZe zNG=<AqSpX21WGH&4;NjrjKLbHi3S8H;2_$o{dfYXo@AcpqQxp+vJ_mi9!Q4O)?E zL!C#7dm_D`I>xazQu|_-lcm`&gn`oyl^F?-X;XGw_0Q9iZGAX|14yn9_AL39O}wcSSU(TC-Hp1lRX?W3p#ij1ygz z8G-6)18Qo6cw=hs(I3OcIFhi1UpJ@Xgo^8W%WDd^oxsbZ3dDJLzFytPFV0LLb;Vs} zWTkA%s;@UFlQAbnU}x%td4DS8CG6$`bw_ARU=kA}HaXSXG99yH1MtlA4}!KZiG^bD z=hqVpPQjTVjcw>I`-sidT9G^#%MKZ)v2X~8!<>)Mh=M?5y(=y{-V2FJjodjlndwu{ zPnSjUb&o4t5&UCK3CL%0X4T{!4%JNor))kSnZgZl;Xh%i{w^bmyv0ABA~^bJe|qI3 zN>1UP_N@(PmR@o`Pk>R%&GV1^qv*#3X1io())?@xa=sAp8!#c*Y1HZ*MC4AySiZm- zisO!$$wp=;L;yzIk9s@#6~ET8Nq&ZXC3|^LP4I+D%u({Lw85kFv&XkDsY8}TgzXge zSb_q&iyTx6HDnd)7ve7t&XrU}f|t)QbQzc}4Zt$5H6~2xlO3S9A31X~%lz!rR#(bi zDrK;>Tumu07!5EYw0RxrjE9{Ejrr~6k+4L=>v72Wu{PM=ntJ@=^VMq!Iw;MAz9!b* z>36zg)?FnwZF0=!rSTCAnyMFoVT+SHchL-Qg+A-yC$~ zaN!TNKj<#geXEEiBCGb)ZXgKWm}iH0tQVdc)Zz?k`SCyT$Aq6g7X&GG@RO}nyO9;~ z`qmH71u+3XeY+RBZ=r725v2;L#VLk-6$sH`n<)H7EaH}_cS z3rn}avB7Yq^fC>TJZgUY_I!{^4L~KcRr-!?q2ktzu?g|frS=P4s^NY+>ALd{c5q2^ zSM;2Sfh4L|@e23mGpQ5{(!+23n##of?iZg=#o?&UiXcoVorMZ7^xKVu+X9-ZR{QIc zrywPO6}$Ckng%JHBJ_+g{;7w#URehV0!Iv7+t-ARs=oUI-U!iUfKmK6lY~1W`fy5t zZ~2?Ao5>-ACJuyI>UeCxW_W1KGnU*okjkzsD&MGarB@?gY*luxtpN?jwg~c5L5tIR z;y8?~e=_`reMQV0XivbVO@G0oIOd9YU)P@$4Z1x@I7{iXlG=pf(Vcl=>$`=%zD01gS{zb0&F;v${!nd1{;_D55ZwKvF}4MjmI_O`LtB z-ZsC{!d9NoEpCy9OdTb1M9mphTV0*Q?Vm!&=8*2+wi9Z|{&6|=AtN2}MLcf}t5w8>a8V+BhTARMtgL)ej?l<|jxL>1i`k^$uwg>2;VNfU6Il z!-C?KduH^eM$nO&EPg8;tUz2auI*tvUBxQ(m9TIm4k7ujB2s6rZ`20n824V{sB=RVNiD0h!66-E?K?TVh1~7hO6`_)yAGcJ; zHV8Y0A`A5^p$Wr{UW7b_fTbkC!v|O92f(T;dF_t5=bVgL>gW^Tpo0ucCiIl;pp`yL zxvk|1EsqhtMP-UX+ldMMsTOJgGkMTK-InK73O-GRh0#u!Fy}`sLHWr9+tMmKG4NoQ zeF@b;*T9vATU)MdqTuD5TWkGrE>I8|sqXHJ7H(6iH5(3m+~~@NQwcM+L=~dR zN-VD^6)5VXTw5eF-8XaD!*Ox;NUGSexizt75ZCIvfEK+DPXV6BnQtG>XH<+-6 zIr|2~;wfs#nd`CTxS=C@`4RP-(tE*=*Kmdu%eEyZH-?{_TgQyin5042# zJbjB%%3^7tm9r|fQm!P7V)esDZW^o6PQlZLG-OGmL^>I`kjDbj*TXEP3q zp{GNej7T^cjVK`k>A6=aAKo-iW(}PHX)%F^Cv=bXG{pp4g>&;LZ zu@ARKD@Q~rinK^h_#&JzP-7@4>4S*lclP+@Zxo^8?_`j|uU@b+zNdydD=|SXWZpzr z_l7fw`~8^@h(TUULFLIh6^CVsv#GG6{KR38p;w7v;G;E*vQ~bvJ4RnMI$^|HG6{zL z$tZDpaj5VD#VU+#AdO){zDb`mG2`4a&#UC06c>f9x|&dvyu@d--#Rt(M2LvTeey6j z5)I{&*6Y+?OsAI8`;}PZ3yu3Yo|&Pb_?j3nGo6ps`N*)st)&`1i?r1L7Co^5Rfht2 z6X{egvz7Lx!0jG86d*WKg%#X@P}Y?LAfWdRCfck3^>_yYb|5*DcKR1!)GAO}IGuA{ zVE}X}ic0~B{snM(g)%VejNw_QuF{=R1Q^2qnMHlz%BH1Q4z^ETF zK-r?ek@mN@08RRzkgs+&Flt=|n6X{IrXu|rL7)H+#tyCcsReX6x&Q#`;MaTY>Sz6n o20&AeAT8}OV3aRG=s$F4Yf{R_b1_PwmJ&fhMpgQ&q*>U10Y>-ZuK)l5 diff --git a/media/light_pings_naive_pings.png b/media/light_pings_naive_pings.png deleted file mode 100644 index 381fc2f8a04aec1e3ce8b9ddbab634e4d65e151d..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 22994 zcmd3sRa+cg)TVI{?(XgccXx;2+BgK)1b6Mm-JRg>f#B}0!GpWo^!v@s!Tf_cpf3ul zy1Q2Gz2ttLC^Z$?FGz$)5D*YwTf=`^nIa^*VN)MvtGiC=6^2p_2T?GQ2a}VFO9k&ULqSJS zlSc+3#FEpiV`yPR%DX~9UpwCIWp{}F?g((yIX|&pGVcCy@Bg#I9#U-UU#!e)A0&kT z#~*R4HM_GVo|ZEhCkUu)_~bxnXMrMi8*MBs=#hh-rptK<&lfw1r?21SPnkAkpY_K8 zwxGkJ_*Jq`%bAP}W`s<1h;(#|{OhNF#G3ktAlxTE z?bkV8->XgC0r+0>QQJGF)OHYm*|M|GuEg3cp`6{1_V@G8_V>$)AqE5?a$gE1f+Yf8 zC6I%}xjs#LKC7NZsnFy3;(OVl+fag0L1f!R&#`I=Hh;6B87K%+`=X)~Ul6O2g&8Di zlD@ieF-`mMw!EGd#a|&AVr)zb8TjtLK|(bLkN0I$wiH&F=j<{i?rS8@edGLS@H+Uh z&x=FA`pe`-O+l+h>sUSKn}O!`GW9~?OzEQ8oaG{5)|%Uty_mO<_mE4Shnvfd8?8~U zX`+F#+tB)bq;%PHz;Wm!sedVjicZ7&8=hHmbY(_XNoQ0Mm+8i^$O2`@K+&b1|haxaq5SYetS#xu-SGF*yUS5jAQbk_VDu70POI|)}Jv)VI|`IObJzoM_VmQKdetl9E;hJVWJ zL%dP4Il0pPQCvoMTH#bHLuS8S`*Cbt4XrmV3I9DjIl{-KxUCsan2MmNJnaUM3@{na z>tXaK;Wp!C;FT7<|4zuODMIu-w9m4<-rfG;#eYkI{O!_GbjEMxo$vS4U(E^Yahjl# z5Vp31Y@CH(BPY|f@AeF*xJ1lEidlXJCEGPlf^RH6lC8Jjy_{?R{k%fk%&QXR4Y)tI zCi5mW7Ah3b7r79)=Hm~#vkvNx0APIac1plQ(1=2aLYCW?OB-#Z*RJ5PX*e!Ec8Qfy z>So@kdN{&bC0se;AK_bUo7u1w;_{__8-s!jmX@IE>nyx8SJ-XA#2>Y&pgfl4Eo6?^&GOqhDyq{-kHIGJcqJNb7Ori$62;*g?!`z*-aDIQeV=O#nz_f zCH43PepzFjVH`o-!;TGp2vSV9ZL0+m+Z~H@D<|AifBDr%`@88dMd-RvMVdF4vuw5W!}x8rW`QwiJD!uDNVBug!n3-iDmg4NmWwoW3@~ zLq}B0rVQ)RwUoVt@aggiVXB9>25ZsT&}mSTQn^qGQ%o0O7oQZXmk!REm?8kq00L&} zruRa5lROjtBNRhEVN4mX7}Jzw96jlQ1^Hz&+&kC_4zrZ?8rPUnl%r4;636Bln5z=) zLeENJ2GKffFUAe(b6U9H3cjss=BS@)u`NU{H7#o_SuIm6^3NG9XUz{22ys@ikFf*4 zx^QvxXtEzQgI1J}jasyczKXd^ppf>4!ku+NMmVx2a4PI> zrHv@ah4tE#R~gG4E5$L2&Pa|{bxZZxohU6@d0bA`8h>MFJkMPgf-uup5c<@(ZRzg@MG#>7_D=zqdT|!f&I}pKw$P&XFJFLj%yzB z`bcZK6@ECvF2ZS-*jO$O9XJsu;!D7L$l-XSu*1C!b3Aadf2MWhzN2(k^-lEM+T_$T z`K5;`2V}_pbNUnVVP{fy!~C)AWqMVS!$c^J<=cXeWsgENL$%3PKZ5Ru*g{9wYD!cMQgwYwE0;Vd_{Kc=K|zUHQ$W z?-F<_suCt+li=JVFgjmfvi)NhQBsKH?V}H zyK;Rw-{d|Rf)xI!QIMEf?Qkcs&bo70ySN~R4#Zk?Yc;sn#a33eXNPx1LS<1_?CuQS zD2Cr}J)<7fkH2P`79Tzn;(Q*N zJ(6T^JKM(*QlINGaD9&`6GbFn!2s0?KSw-|c44t`Fnuz{GqE~lKY_-Q%(lj4%X(Xl zUS(Lt`m4Uyvesa*g}3x;d+WcJ(N-=GW|5k6;04Dy&P5qXpzt>7TJLudF-W}&GhHpu zHBa9EcG+;y_u+K`G@9qgQo@2)!&CFck=al1vGuCv`SD+#viGybh$EP)DJseIexc!{|>4G*Wzp1odHb zp+_+~pw=+9AhPgJ82P}jlDHJS2+4>I2;UGF5fu?YQQ1+s7`K>o7*1kqUP)I;`w5sy z#&qxU;S}q%!||VmZQ}AWdU7-pi?ZKkyA_kf$Hmu`%9LBh$i~D*XGUzs+J=*-tNwHi zCQko?XD}JJnpPRw@}kI=Ob4VihMm&3egPq{1wXQwAO~aymgRS#XU!B`#mXhwgs0cG zrNTr|E4ixMNxft!wK`N9=J-}f)R?agwkakk;9E8!>2r&*=nCso={2fVO8+#pR`il3 zvvQt_ACw!=MHZOeov@pvW5M{Qk=9*R>5zKHckV~5UrWqq%Lm_)TvWOlxv?l*DBRg? zCbIUs!k-HgZ{{Ot6F<@PHNIn}-?=|>uJWknKqh7wWk6tyFLGK1U71*}L2;{#BuOUK z*foN#kwx*?*aRql0eWqQEvKB@1!^q2Hbl2DM!=6`hU*XiU_5gM_$GZrwmprIT|sS} zDyq4mTT+es0soQ&hXQ{bvE=+tg~R3qgzsv}T}V&O!|_(+<`v1iF}|c4++8@@W&4Ly zUF%>kON4A7xxSL~^XIiFl)oNHIa$>E5*Z>r1XFR3&j8CxkI zv4e^eK(ph$aU5ReWmAiLq(}Q*@%@)ChF<`2W3eu@+mlZdBrG>9+a`zgsLg*?>(__* ze4VvC$6P*w6P@EcvhL9Dx{jOoiw<6A@`T7?gvpA7{)Eqj$%L^;r%Rz4HAb!h0nnbm$35cde?TU=1zmb%J*WxgoH6;}-WdWSzrg>j7ZBj*dHVIU(DIiH+-s>n ztAp`@@MOegjFYJ7M`CC22V-kXd&2L*8xWnemH}=HH(L0+P-1pH8>8U-)C>A*E@ry*N0-e@Ofz7!J*}&#muF zOT8fI6tMr7=TcnOF-y=1Z<~=*-`bcvO3?XikeSCJpnFb6#v6Mm`XHwoGj1&+PGOa5 zeTJ3)3F@iL8WMeedL|hCERfM%07E)Yl2RWVmlZ$@cuL zgzXHIY^H@cf&3Rq&W1K^>Zx6x>4{~&d@mb?P_GynH5&2>$tTFIkeT;P2c9<(o#pi0 zARv&j{`-N1$jruvfFOsEmlD_VhCI)K&(m4^ckSy*JDA6&&pDYOlNTzP^x-|aEz{rTSAZv`f(qyaowArJ|@%Y z{Cesuw1B7nKOyj{0>{Pw&&MfI-yDg4KDQs`HvV$lXj2d0(J^#^{qVUx6na!kjDe=NU;fbw-R{$>%8P>#MWX z#$gim_vk>gwqg|wbeImWOO>>hIx|UfavB;Mp_7&RBB3Ae_sb!kqyx+e&xjjt)4~IO zFUMt@J3&5iWTIP0@j3T^R!qOMmHN;sqfXo&gSqIP)mA4m)so%|=W7tDaAw(fDoc`q z7j96PxQ5XLWqvBa^l>(x9KqBWgArg>`c~8ZpznAzm7_Qv)Do)wUU+{zFN=R3f+q5J zHp}Vv=si&If*c*KO3ILzSN;y}3t{9@=jHE^YUW{%d|DwE7Uf*m=ETdMPZ4>F)na+9 zzE-F0sr%or7kdf_J3`Xo2H6802dM^Ek_i%#603b(A`IR1P%n;7*hhP5M7jQaB?t>_H{3dbIqWaW}WLBvYlaipni$O_4{Ax(lzBBZ_9{ko|)*t@F(z@n+%?@iT z$=Z3wd94VUz(Abxyhxr{VjRWaN;9L;e4am>L#9qRD)Z|Tx* zZw?Hym>w2W7?KTeGBwJY!s_9HiGXBn8-#`H^)FcI=G(vh5H0rY@k*V#u7||x*FxoR z6Z^nH4=dZ{SLo?Vw@x0+;N9|;B&`R@rrNZHL8=N}OAXCRgfZW+AJLmD0R82LZmJUj z%*+1Hn~e<(b+a45_YlXWf2)mUYG{f~DAGQRieD464LEHg5$dKB?z4OSfS6$fG7oeO zK?wtvZZt7;e_{+&%9&Lgf2pu4F<4ny>5FT1zTJ$she@vHMp3ajA|@{qF;(QI%LJzW z`fnSo_+mA2u@~b|VSomsEzOyjPrKM@RiSCBgQAAns2)yNUqL=;DF?iO`S zXw)9~$BY#p52Z>me8v=75t7=JBNCA*8vG*4o}ZsXSMIKznX>$;Ym9Lq(a_tnB42QV z6fp89uM#~@m#XzZ;gMgmP^^S_-Y0;C(CK+j`R8yls}s-jS9(~qG%u7u74YJv8tdFt zW~hLHfkDD~|4&Syp(_7D@~@*|+z~OWrdd7epzj5PnH*Hd#6QpKCm1=8{-HY?5?@mF zwTJeH@Zcd}6b>+O=_@S&Fw|U|)XK|#A@tI68d{#lb{Vs{0S~%0br;)7}6GR&}SRm>glGWdDTs|!F*{6o2f4HrCaVth^ zQymg#NLxCnP{=2xk&p$vU1ye*)|;b4=D5ZFQP4@jft1d7g;{W|BBn|K7la^uDX~!w zI3^?QZ{UM5@R$1kam3&a2daFNojdH=Dv*+4;hJ)R<= z3o;2}rihNH^hR$a?Vy5mENExxkt3ZGw4qO+ z(Hp?`^PT~!Sw>71s+K!6vo`?&Vb}!+6C3WX6E_WeXt)*_^T{gm@%j|Xa(!*EyZi7{ z=-I`^hm={-Nx|0k*K(G=##}>jo00q|M+r?%bWG=<58-u*LxJ2W##R$^1-6gH_kTu{ z|2+VHPr`XLNM4qX)%Z*CnA^Tatcp0Yx(@9D-v~A7XB8DPNhVGWbZ52=eqiQ# z|EA^S7X);#3gXb8-tewMVj%W*~QNNMK@7O9&yQniVUlxy+7K)nH#?SMtI# zA-6vVE2;t8EP(Yf-Hg;t;!7igXy)?SV$csbd7GOz2BTePs0neiPnS*%=t$CL)7f z4!uaZ2vubcsZ}@n-rjs8CS#(rh0|$h3e`Pa)SlBNz=^W-S10Wl5@-bnKYXrk;?J8f z3+HEicGqHhjmx1A=yuIyrJc_$X*l-EyNksD#B%R{a>aiOAuZjYM-r#Ta)wk5i$nxo z;QghHea+-cR-u~NdP98@RduD4q>73F*ixhHj6;s&9evNU;q4z2UtCP(tN1{nQ`${JX8}J8XcwDrwqx9fFbW}E|0!V9~7o} zRc|G${&15r-XDmrvKR!003oE;h)z`f-$g-ziF>nR!V)*hL3Bm797JYAT_HXh)uf;p zrmOVI-3c~IDKzh{_TjfU>CD)PWrgl-1kpllm1hnO#`=%(ihbSBbXggorx?pVy%oT2 zZT$;j)qVQ6-}QDD^pquc>2BFNUP4>3sncRW&bFnL47p!@KiDc00o{_M6a+6{$|;8X z3XQ7udv=*boZ!RvZrlfFeoSnh@hYf(^6=mLji|#f z-i+Mzk>{v0yDmz(>^iiYbeW+ISq_6%ABG-sow(t;+WI0xF`D5bL&%+s?$` zuTaGD!$Z2GI6zt|KLV{S(+r!t@gVyx*moAV4WXABg@Dr(fB#<}*DX#WPcRy|rVm7s zFlhM!54$@tBd0;7t0!FA!|{E7&RktE`)KZKbaWN4GVLE#ubg#j|3;L zXpovb-~hk_9h1gwd@(bR?ja5BXTkYNw$OwSMwjaE!C(O#9;_z)ntWbouwuDpW)LoUlfltVHn z;>ygpwO;j%=S-D1CLr0Qe`RoBi63rR-y{|c}oeP%@`Y`J`-1mdbCSVA|RF*BH-Q( zo>|rgiY^t554nrJ93a~whF%br)?&I!nWz(^OJss*aVx+nRK{*HtZPF8 z2|biVvmZ}hKFe?WSn#^s*N%H%fHcDtx7F5m+h81HP~BwoS}xiAQDv0F^HfC5&7NQ1 zUrFT|k^^*%PfvVIQK)6NhUyP3Wugci10@)@Q!s#UT+TE$QR;03qd`vDV`MfINZgad zvoi0baADT#T6RxmdawhL#^!ZEt@YPQ^n?k$)g69Om5!XLd#PaaC{qfFTcZWLm# zkWh@SS-3i6mlzm2efixHv_+(04dSSM=m(*MU>$If4zvI6516V-U@V2VT54!M;->K- zFPRG!3IYcfy-{HM5^};50T#<92#Rd`BiaZOBb2NnAZFhPzc6;Dz1_|Qi#@>jn+NEQ zh|fM}T4_Mk`D(-CnU-VKqDRDPz*L0m{Fv8#wp5KU!B^yu{T%VR5d3+deg;SKBJqwb zjghL%$Y=fHSfYs0;^VZmWc55)^ zi29PnQ|fBkhvxZ@ydMdskr2=2s%k^T$5D_7p66Hl7+QB!%dCTuEk9D#+<)WR=+0yL ztcMr~mXa|(>{O%><>J{iF`+OKeG&@51Ro$HnN3N7>e-cwTBY*YOWi+iI5i$5O1|vXx-qMZwyhMRtUkP^F+3vOjUbnYLJw@q~$$1B<=K#WJ3|_yLj(o`TEumNgO& zj2D>cc#vMiJ|P14-&IZn{i32f2sKyI>Iq6{0$d;pcX+fiZR$PGJ%hwm1Fa#yY|yvE z27WW0?As_ffW)iY#lJ9MU#z2lGV?v*_pA@FCTEfN3fu)25(ht=S=++UFj1rL zvCgyAbd|a!ZW>P9VrBx`l)j#WE1ojp?-i8uJe)obZXe>mpM{0g>MhKw??nht=m>KP zI0VwYlxkWC!USxUxIE>axdZ$CR95n%qk*4T0-$vMU#IyZ75#C?>&u9W%=Xz>@RrK% zQjMjo0bHS#9LAa_*M~mBD3v*sks&l_KKD*lRN#$v%93yX{&?whhP9$que+G%+3wTw zXw~ZdG8r=l)nWMl@6Tq>G&drFa$ms%*ubg(6R1_kbJzCQ>}K=YReY(heIZf|*i9!gZ4&x#=>L6LbFm_Fenngt z7nj!uOHSmYd;cSD%gQnJ{J#`94cBL@^O%0K3&z*Pm@_>bap26Yq|;;IGaj`Y#OAy; z7cS`4a^<~(^ig8KhxBILh|S{pwjv@TVw{XKh^XZs8~jq;jidl<9%lccQTIk~L9tBM zLKYHkd~196@3_2iGo1w%R{r&&*@de}nmjXE+sN*};xOqP)1qt6)?61)N<{D_|K*p7p72NbFpLyydswHJ8WWX;%Lo~$T)`RsHq*c{SDRC zyOv)wman=)>0OMu(3E+;3z5P~Yc{n^MA9kTX>r?uOF4k0H>Rds0_Z=1;DztB7Ji?T zk6fEUMnd>g8MyqqotXGEnbpx3`!BK)8xg9!;tij~!-$9_nb56@6!Jt>AioAk?YZ8?x9B11%*VsFKRQczW{~+R5YRXs$!N^sc zjM)Ov)55e4U!D~Uw<*%q)E>bEZS(X4faMy~07^|Kb*-Ts@ z_XM@u+k)A8k~NQni72hY+f@dDN%hgk?N(8TV--+q(L?kX5PH0OJ$V4~lY_k7RO8}$MccR-XOO}7bhvPV01dp){~u+Lvm#Mb~z|Kx^U{Za4Ja4vkzN757TW`czw3k#sTQ>NcxYWe!RaH zt!;X3e~~sPA8!Jj>rt_>)h0|&X7k^6KWA{V4wr0TQEEb-Q_L-e*NnaK8o%vPRlU^r|xFo=NmHrC&(l^QPI5L3Oj7w zcXL^e9Sk%y2c1rx-&f~0y#4PoXDKGzr?74_L5kgMH}WUa$UlnY?Cega13qr`8m)}n zXQjb`u663Z|5jf%5Lu~gi_2;#cL$E}{n@G;7z;jC%->)NU9|17<8%356hx3p#CrB| z)6qpJl(E0*zO3dhj8v56j#1g$QZ}0Yff|KcPcpc6J4j10K%)8)WvRgR6AXiW6rR8l zih)plrbrI)2M;+{Sbc2pq7*+L&gv@$Gi68XMeN>A!7)By3wZul1iIMnG08NYG4zq@ znH(D{ywCGF%t$lx)XNj`drH{u^twFC3qY-O?Y{i|ijQV)X#DfM**tXaQ3got118Pe zp6lP)x~}@7ahQT>jZ=ET(3E4sT~UJ+MYqok>&>>p_A@&`TwOhQ`K@T7>mU`yx@Y-} z@g4{sYZO1`{Q?{X-7!1}zuG_?2Y}yA_{Uu!4FPPx=lf%`)_yQDYwuX9)KaYp2p*S- zZ4w$j`||76ZOG5PINmF-e>0Fj#wI4-@;;x*P!y^Z)8|P@DwFf%&n6MEXiaS~F}MO| z^2I5+ys!T9d|zujIGWB2I7rcPTx~c2vsaniB?-4ozFB?)63gdf=|@X22G?r{HA4zo z;FQe%Ld4SrUSC{R6Jjel`byyZaaz=&%C{4mX8gl;u2??B3QqJU$S32o(8&LB)9d*7 zSQqQ_Ww|H6PdST6IY$5|`fc;lU$%8e!Jy19;BHnno)+U6Vvd4olD-^b!*9*DOq}>8 zIVGLds6*&>f=hx1tbTZ-9ya^`{LR(IdN1;qTjdDNZTJXXVN!S~snOqWs6lmF3RWEk zS4=#-n;a!^!nW!Adg?ZQcx#uz6(u}Wr-1D_*;k7zS(S_rW~5Wp)f^78%Cq1q*&F%_WLOq zT~skCK1o$XkGjJAdWFfI*+14s2pbLx7X8h_Y|wnZXdhqZUS&8iN*6jq_$LomvO7)< zdP!%byMtUR=~kDI+rI6jP}l-O#CX0IGeWCxiGP)}!xug;u$+>PuL@ScR_X!A{_dDo z4Vm2b;RSzmv(O`S=H~uMw|Q+JH~MfD4YG*%SKV@lDm2rp<}bYEEqCc_VL!ga-YP2U ztGUiXwS^MQs+_s+Kn*pb@N;C=EoGn+^Ew*Bx($eP9SkGR)O215z(HOdgBK=PNC=Ih zM?{U$wy66HVKRiiz*b7>nJv^88tR5vaN@!>A zmM1$;{uJZ_N(A6@Lu9yFp!mb602aXFZ*LI#SBg4zqqKqJj(Dn2^HC1|ifj9Mwzc}A0**?B$?BbU zZzDV7yG%sq5u)0hMy|3V(Bk+AhKCx`;>Nzs_Y!dW=4!Eg4sK?Mb>Wlt58e2eas)3! zTA%p`9cP#?jqr~gIJ+2(#Zc~`Q<5?sBr3876+|jdjtvyXjcC5<24kl%SS1`qe}Zd} z#g-aWb(i;mkcE0~pRVSts*IySt7BXQBIMWvii29l3Zj;)kbuXRgnEU3n0S+iuRm7p zhH;J_zh0%POvz=6o^LVaSb~NBMu|j zOfBl%Pv4mt0Lzc6;X`lcL5b_SZi*f6oF=2wv3$5W84TgXW(JI#EClYako~a!*aYTS zIYYg~$o5n`xRQq#o1K7+o5*W!-)I3L%R;PE%!pwm12kmjks{Qer0K@gLN-gG^WONv zrr8?z6Ao+G=JR_>tmTyfF!;XLic?n^e$=Tj$0c{``C$bvx7hH!dXP|hqGs3=;V7OZ z><|vK!K#E>U$vzkOOr&O{)WU3WMBYF=1LEbC`fqu=jti2byE^!s4OnGCXUJsz31Zt ztSx-C?cfG8@PtddO$6=(PPu7}Z|Q1%x|<^DCdxT3|0By4rvNaI&6S}#p|8z{z ztUsRJb7+ruJ5f^Xo@$!^8DEI*^PrGTETIuKvlrLz$r@lrlFsqdrMpc(w*=6 zxDV?}*R$T27%#=)gc-_ruAQ6thhd7ED{{t~E9J2G3kRx7FDW=qMaQJwmF5<7N4fHF z8Sp81YgjeWRult%+%+=?HWyb6g5A)TZxa8g`2-NN<(9BRI01#6x6-2wQHF{NZgAUo zc@O80Kf2>~h4+LHt^JP|j##!u>AAg#8msEqKNi!bH*Vgq@ip-kc3})SC<^2RM1gVb zLo)x@3vd#M?3|K%d)~Tjr5qAjX8~61m{MxVAbF&b!qf--`8E7(;JMbwOhtow4V-(S zEE{lMF_;!Xf1nSF_@qWT8kq1TLN9emOBlE)L+bDm%|%~qrE6tk{ril^^WLin_oXij z?f-zn!onQ=si_nbyl;>_O+4;p_4KAt@j=fi!?8E%W3rF_VO8(d%gprGTSwQX_%uB) zH>;gq%@G6?QpEd_WONfFPKYY$7`x?2Tng9Zzx05l*N=!^$X)1<44qA=EBim;ns7a5i`My* zQ2HL4YR^});4$&-v^)`0!Z_BmfQ5E8AHp8yT85`-#6qZ(d{xi9pGlteFURrTfd4>M zZ~HSwBL=*v1Q5GOe*XLNc3YKprH~1yD2OZIF1_L08xk>sw$~o1`*2X>GU=?-Vtne& zhtB_HbaVx;keC=#6I}Z`o55%>q;@}hu8V!FRIZXi!#r{b}iBrf_@cs`uk=~=v zX|U6pZw#kMtAdp}kX@3{P|*q~U6GGWSm15M232AJQ8YTwUVJCW*t)i3f3A6Sl*ZUe zBKrslL~zJKw@`{AzV~C&zcyosyGwN!<*4V067aEc0sG979&zsi07oTu#+;lBiGL}b z;Cq5vMq2Vp#x&auG@4NFLY-f6Zlnx2DutEPJy%_hBMM(%H+6YU^9UajdZgkm!pJyC zT~KPy->BZ`6~CquT%$vI(9)i_@6Xjv@!i62?_$*&7^44gm8I^!tYyl+;Tct_!mD(6 z?@aXb;}!1qD7VW+QqTqi9u0|qtul1oN5-E;Vleg_*0(u!ii~P#&#j}%zkYT^(!ypy z@VJ?-qoy4*tb!UoT{T))ebn0X&f>1Nn690KwWmI`oJvM8jx35K?b?j$zi(@|b|G?9 z%isFgQcS&lO1uR}isl6Kc%RNCTxz-K%9?aT_#hgv;{l`$SWl0`eA)C;#{IqR)Bgg{ z6;BmDp=YJCX^;LxPek-wVG1jgjuBE1rx}-mo8BF<0JZ+hTQ94BW~6(Lo)Nv}zme_x zqE@qM*S{gfKg}`#=cP)EA=nO_RdYE1qZd7kFO; zy(es$H}U6Z0Rqn6aUAFZ4t+%8N_t=gO?24LhlF(FAGgWR?p0FIZ4LEBSsrE@n^Uvz zDu4O~dwpB2;6 z5WJ!dB7le$_WTmL@mL99=q)xER)kQ!f(+ef`BrRfSL{UB#6*a#?I82t;^I1^ z)p2C<=jUrfuqkHs8gK&4h7T{ge0)7SFI(F0KgOF3X%{7dZ{FmOnM$35RH`D4vg3Q2}9}en&_Gg|0r7 zQhpdj%s?mwCym69H0%;~^HM1Wx!E{hIka0qTY zWvpyE$BcKARZ)DVGqDZ_5evUQV<%mAB&+634@X-2<*l0S6G2Xrdx-vk_%@g|KLu>v%FLTk3 zYB?fG7{&>FN4TQJ@pCg(`pZRUciQd#-c$#JRh_RJE{i5;|4}jMk;SRtX|=h?p#!T1B30zsG>;xU;!I@7Yh?x#XVwNGYTgc zuE;>}^hk>4_xC^wev1+GmXC#gf99;_AB^CvT5s-q^2!kLYff^dcf=+phs^!vg;kv8 z2Fr8L?pa+Z75-gFh-QF7+622NJM8bq8~xqUa0*Pc(!gw?fr$wA6xz<+@%*zRVP5c# zpYx;UJsA#I6a*oiiF3Z6HBQ&z^83VwrGeo_5Gt7zJ!Y_}Ks19dosMV?wn|gbi0;wS zbYf9mE_l~ToKhH4pD*UfSv>o|Ctq{JgBnXdrvxu83K$y3$Sg~$G5O~_-xp9(uCWkq z4FnQR5TPaCU`{Sl+0?jNN8qdZxPohG*-fiDyG~dv*CoiscSNoc=w8Cq7!h6YrV~j> z&BS(OAFER+DE+;*N!Mww^PYP1MJW*j71WjGqIWa-- z@bM!FxHgMEU5Ndm$GmRH&xi82PyCx^fH-VYcK#PUm>xahE)@a5uj~576p*!o)bwjD zxC8y#LK?E-MN)d?@a?z#qqskKq#rJ~dw@-i+~xtT8{N4|C8Z92i|QOFlzLtv*W6@B zyUV9ELhO&^`}A@_K#z$`gC3zc_c|C{aSWr;+G z0UC|XT$vQS4#{DC}bo>(234|AUKHK$`6A>~zDLzZYq28Ps@>Kg>NrC{zG4@5ATMsxdtBvh67e+D97Tu@Tg z%46k(E|Cy`ot5Nih{(x;3)*DT>hv^UJcRFFn3_*6plns~wTw!NmkUaNE|_{DbR+a& zX49-YkoB^MJvy{5#8O5hLEtL$J4HpTv*G|?O^wzClVmFqsZiJk&GH9sytpKkc*xUOLbz+>gIE^Gv*uTky?Dt{kd z3l)BC&wh*piWo#`IUCUH?BXM( zAcaw9&CuV$JTd7@H<$I)*<6WYoaTIFw3r%<_i^rWIldv_W~O(Au-)r&D?bqjULh?l zRTVE1!!>kiMk|&=z+r~` z2uj&i1>!OYRsj=CFrNtu{2)@BQpD;QQ8Rd*j2|yH^&HH;PChg>PK$J!`}q9=+pB^A zK>l!5M8CJ|;qf#!Yg%hCfNk1mq-Cwnu~Nl0JiGIHtkXZE5FH4PFS^y-t`zTGhA`HH7G=n8w=uuQ28pzWU&QhOFM5E3l;zE{Xq5g{!jP zSpUU$@K{kW?Su7APPUv+!Cfe9>4_$AcV;d4Z`m5gek3}meT@ujN4AGg-N!xwbF;FX zDo=H{O9L0(XEv;05=X~SeK3--6k!1a$|1<2l*r2WFvFV9Df`QQidFIZrbZr7CDlj* zyhI@s?(zzS?DH3KOL4Ip$KtoQynqk>TDNyFmVaBU^>4OY{Pp7Vx>$<>wwNVHh+S@V zi@y9T8YcZ2JFmni=095~El#spoihX?kd{SYB(MxJN6{-pUfX^jRVPPRheYlwL`lm( z$uA|x!KU@XF2DK@gA=UAbXrXkPSIN?bsLDiM~kJCi($R*#<1~`yMq0~c*fooonyhc z6Axa;H{zCs%<&(rM!$nUNVAC{gZap5mg)Ox$_2o!I}8rFbAR}kl_=l(e4Scju=#Os zKv=|7BeyP`32G-0g2)el=_+Q5Zt9t|zc&aP%<1hJR$>XbYR;m zOz*>X#}v8v`1N_3b8mKKmD^0UNHxHarTe^P{m0$EKdtfkgJ5HHT3nlYQ70qjJ;D{~ zHB0M;#QZ^7j@}K}lkH|mdX$^bcWK{5H>jLN)7fVVc{7nMq+VbLZP-%T9QtT?%|#^p0S=~$P}2L z>bE%PEoa!hM2mG(T!H10*K?C_vS%syh`1#Kf<93ynqjJwNRqn$l!^?4w}*8newN@y zJfFwE2#DS4FqC9LG>WNLiw?Ard}3*{&q$m_c%Jc3_g!r&Pe!!a$0|0uM$mkV|J>h_Oa>x}P2>OfLVzW)V%^rwoAN zh82L8_Y(;*Z{8x$`$-P-W*W3ScA}Zh#XKC5g?jyK$3xjvx5r(PlP}!%ocOWCqZ4Km z**Z>E3#`XBQPuq?4Vn8!c(mp!;HzyaR?+|cF|Grv3b_D!g733#V~PoWDl_rxE>QM9 zeH3U%79KrcGdN4xiFMBKj0X);H|q+1(N~$P#|G*HEmJD#X5m^~x89Cd>Z!8+dJhKA zLudGu2fFBGzdGU2{7rQPqkN~< zeq_7=F`NkM%%Tu%WCSZJw_t{b=HK!~M@_C}%B6)IC>fQnWkx^LvXaY=*EKqjDs|+B zVQ$rsmdioHnN1UtRJKI+m6fMrAcyBW;mu7F*f+za7=}$`e29_t(B7boLr~~U8|i1C z&PlXTayPa^ZKTT($vd(salQr%u2qlL`bX;qaA4xViMT?Db z85{mB9~WXIAF2$?*7L@h$2i#1Ov^G}t3-B-16gH6k5)L)-y(u)64+Lt0=(Vz=y==? z$TNDUmH_IufnCMu0>_P;Aasvt2yh>3$3>49)YSBqnGfCKgTk%oWGVi-w2Ds)Fnj4#2MCS@=)DN3IAtweqpRh3BH0&&1np_ zjg7S!R|I~!)eYmbK_FO?-(S%h>Y9mTN1Z@0b9o4&?knnDu(%@q%Gw22-(tTET)^jU zT#jx?2sZq#;XmB`!ug2cb-B@wrHFfyECxjV^|O}ebF%Q2e;r_2C&N3>hwGG3RFbD#pGzbGjI;3<+NOyS%kx=Poq>=9K z&O;4INtbjt3jPe8Hq zIQ6o8W{LyzehHEaAu#4;{QDR`m1>vEKf6DiLJ)!(r)(Ge zeKh_80X7|<3nkdJD-d@?_4y`Xm-J&Wa{hh|bqA(n4R%ZE4tn5EvYJErIx-!WhBH-} z{VwX3YGv#k`t=9E0C0UmVBL0997bwNGkH|ru>7el%$6ln&tI~0gLvv18I-5I@~xD| z#tlc6)Y7`=>^559(Dm!RW5S|8x1n?V++>XvT8bUE{^0} z5&B^fhR`1j^kH8LMX`p;^`97m=wc5To>m>pSLx+ABG}^N-x3>5X345*Av&iHEbpAq zh5cs}1t0Q$Ue^Z9Km=F_^47OsAOmh75)H^Pk)(RPfgQ{r7D0ky0mFOC6$UL8x0|Tg zll0a0aej|L57DA$j6T*ECPf`P>?0>Q+1bP+21CW+f`X|)IQ}Gg+q*; z*TY4hMVj@)zh_NDGfkQbEkCxzwTb4faldlie$LC0m3BJUOR)hi%}tkn(w;attj3z^ zkE`WceH1TUNV}M-X&j#X6y8q9b4;cqeB+Vtq`T{=TH|foM+LmT=53*e&m!RtwL~`} zd;?%6=#=q-3L# z;id+5i8A6|UZ+6)n4wzLR^6NRx(oL;e)h=e-$+5scWb?~r_I<3P5G4yXgTNKsV;Xm zy9?!QVsBUO?4O7>eNsCbQpi3^7 zf)5@ra<{Iev&}JRT)*Mb40q-9wz~4g6QODEUf_hv>jgNSK{QFQ3!OZEX9ZbiAxE)$ z;`f`*LdM{{*nRuc<(}JP1`dBKX!+_Y-9>J1@9YtT)cgi4D>n&LX}t;kgj73oX_%;- zwr6-}L`r0+_is?$KY_Lid;Ob%jw3N8r`0kNA>)M9MHbJ=1G!)!za<>C`9LBLpQ&1K zTVOL`cH8tXo5XgznN_fsnF^KUJk07+zgtyUhwk;y=cfZtH_HJUr1VlSn$ z$gk*S#n;s^ZcMwyR@khI?L^f*WGT~iZY2vjK3lrmwQ|#J?l^|LEkwA|idy&bYyGgh zTkTv&DCg;@-8c>7Jft@`>TqYRJi>5+_D=KmJ$Wj~st6rrpPqj3lAN;M23FI01xWb5 zO!iMuJT;Zyuv&{s)tUccJ&C=tuFcJ*Xc3G3cILLr(AE5*z^}@JXCE5Bu1$M=wzm** ziDQSKwAnL9FRPoJJ~+x%;*7p5t*^-9Fz3wvQt#cR@?P`T`^93{pvn%p20LHdl6Hxy-c z@>8)stXg~~S^Z78#0Y&XvTio24}ajm`{BwmBDrF*9?^|iW7O8H)ZAj-^7np8)Tg&R zWqHPR>@>u(}+XzHdjdo!U_>o8g+tabEM$wc|LExBWu4Bb3{1Y*aaVkt5O0E3rLPm8`e3i;4$}W4)c(`_4U4IgWCdD zW3~~aBXyr|omIJ)`l2YVhhV6Rn`?HR3*^s>!3rLc2nVuopR>8YLf<+bYXAepH7 z?90{YI?OhKTb(u~VZ5An)H(i_n}lDbXJ*^i)$N{ReYiRjI|l%f%e8P1BHvlPN8dp<`GE2(u6^VxyUVb9;JJ1Bq=6 zlWj=}QEL?5^50Q~SN{EP7&Ob<`SN1n@Lb(;VdoKx7Z#&i!{3Dkws8`E4uvf(vJEYp za;%wmY-~A5oHH_C$qg;dUi}b~k?9qg@xHg8ap5>{7;EE+O?K~lt<5VVvyoQku#Xhm zmFW#L8?BBBpQp9IVElN^nEhT|j*1VEO06__9d$V(rCnFK1Nq zzvDfe;z2uYA2q9>qq`bQJl@pT)-V>6at(LEEZ*A1ne>dN3 zNeE%%*U9lJv&YwQ7f@RfMC?1JeGwpW-hpech_!Z9o;V^*(}a9{0{DU!3A0=N)Z^$- zrw5#2k}Z>8ua+hCGPzC`tVN7Y+#|9UeTvdk2`9&2%xEm+bliKDr{9Jaj41Eh3-2-tN`G#}L4R^*K2@^~BLDe<} z-HO~3&JF3mCJOy%xc<#LoZFQqCdWlcs{P$QvoorWunVm zqc|~Q$VX4PWz`?g`=TbNs=5b!H^E3tUIMovd54up>K8bsV?Iuuz-Q5sDP@f(mGi;v z(w$+%Afj_4@fvNf@n1zA1>8V zM7g@M?-I`=p*%|(nd(_%v}TCY<8+N!l{^b#6You_uYV<;^OG=dC~CC= z0=c?AmS%eWE)my@tsg47g?7ul`B6S5AQabNvXL-(=ZY%*6r?gOF-Mv&JJ4gSic+t% z_&?QrE#h$yFcX!m{3x^21IGb5@Ym7zz@m!`n64a`Q?aK37gEbSCgk*2>2<&&kQ2CU zO<&;sYd~Tb3%OcKkS)E$Xjt*~tT7ukbXyBr{BS9EyvH%vw~hl81Ykb)0(1{3 z=?!w9?g4-jXqv_k@RoDDZ^G1ko%W`8i!$tP0O;%bgXdvFR1xtju_V!S-hT{$d+eY^ z7aLP0qFuUM4IuozzRuZlP~CQ+q;_A;?OM5E5os>+^B(VB3jyk3!1$^xt9wfOaMcf_ zI(B^R(F){uN!oDUz6Hv6%js{@SW}r)(hCrXGohL3>FI)kf}S4fHtC(1v}G7ZTucW5 z`&f(jszU82a?z7NKivPlJ}RQ1yxt3XiwUTdxy6<&7;#}}E)p6VlR-czwd6dT1s`Gs zbozx>Pgj#~&u=sV{ewnJMFR}-!2%BYE=P+(pL#;kF|ipK7`V!2Os(7BYr)SkrR_=l zQYBW?%(ESR8ibjgDvIKplMv~?C5^x{?ZJLL32Kbj|+u=;aIFlkz1yyGmUGu6}3aQS9m68-T5J8!$C7fm{HAHX76p2r~J# zjUmaq0InIXJMm*o{NZcf8F9pO|F-*^{gcne6^5nY*AeNjN8ma)XEE`2BSrQAeAD~k{(am8@ z0kAtc&8;jV!+)t>n}9NI0U~oFWgeF~Gd3+P?06s!Ixc#qEKhs-2WH~5*sSk)!0S0V zy|<6O=1_<9ErYSL4vvolEGp+SI{=dfpb?70`#-ZruJsC@`ubHYXQ3`N=Ho@<6Z!x% z=sVak7TneKw%H<)RiDJ!0=t$F^yH%`i7%SKOFIQITF12>fOJ!mRTKZq+i-=6$;fd^ zuV52PCa&W?P8QtT{<)tZyZS*j`#1A1V0Q4E4vf*%6&9a6FcInA?ETlHV!8wi8P6JA zfX_2OJs`lvR}HBch!ym%fK&152doUBd$6oxOY*|k4>f1j<8 z0THt&u9B=}o2Yf{k9;kjp2w-`6!ZGOy)a5|8Z%gup z-#?6_YGT(t)d-^_zmk&$UoI)j5g4^2OrpbJOa5FbK$PK|&!JybiLei)MpHkp(%M5%H zrW=7@>`wLf#TU3Kg0|=w%@yO~jqeQIHgbod8&_FWfKnfbbTbGEx}y>d3V?d~_%Q{X4Biaa9yOb)!?IcFeeo1rqj z7of1)LRlpU8J%8U<1kZis6Py%)pYJkEiu`$yMFFu6!U;9jxQmY;0TiUVOBI@<@o!u zPfb;Ii+$s$D-YIb;(c^#3*&79ln4#$90&KQIC3kHf?YG28cM*rmqbG# z|?{K(|ae`*`uU$UC5wZM92cviS-64-X5ZAlBtC9 zRqxXYzd@P2n)U74Db?<+Lh-3*izIR&jaQ?+S?MN{uD)VBLj3&}r)aEKBGbCM^6V2U zj%`L1h~cS~CPr%JJ|cDL%o|?JUDP}Js1Sb0MXZzi-MQ=gh*)U+k=eTV_5cqht*T}q zR32=B2L50X8i-cNONko^`5`S*>q{-e*YVs*Jwbw6?TH@<3B!+|OjO6f^lR1}dwy8l zBB4-*)^PNx0z3RkaN}pab|b66DLe;l$g4NV`9iIU`@;6APK{)_Ky_;_v=Moq7(q`E ziF%Y`L3@5Ec}y+NGy~S58w04(Qsb4dd@ocQE=b>^5KE-F-Jc_Y8zTr9_!`n3ZzVgr zaCI$kbV*qqI%G_JLKO>BdrSgU-+j}TQ&hm)er0RuM)bUAvTm0ta6*KBmK;N%HsM}1 z1re}5F<{GnN=#OZxJ}511o2v)NTIhs#e9yDgqFbf9eQGp^}XO_E&)jlCYuv+2yMCJ z0M?Vz==owMs^?h6ZOg5mAq*v{iqg%ZquDgif{~TG7)X&Fl;BRh!-pQabtYb3|DJ*x zsW>-~q~jdKB1PPvT0x#Vug8xxh+;l=bh?U#iqJqFHh*9Whq))5Bb>Dl3XMV}N76yhBbJh8Tny5TK-EEFUe zjTYD+RYXGIL%0`OEiDY(Zyt)KY7q9$6!wOp5?l&wZ!F2So9OUSvfgoWxNh&=V+oV!OSFnHF6>fjiN6mJ6 zqH>VDHDWU#vh<-DZHXH0*OP+@-6{J1I+u6J8s^5%E|Y_e>&5IUhPLeSRVBp zOrzwEgs{}~D!pxFoDhow71qXvOR$4uy;bOE&Z}CpC2rr{)s2*9=ifTJFN~hZucQ#c zwm1wO;KaCi;S1eRyK-NV^3Y>_;-1fyZe`;1#FKAdVf-s2aZ~5yvd?YFhI$c$Y1SlNH87fIR02cEE|CLRF9vL1YbzXU3vrdf8C})ca?6Y%0fPFp44Pv1zcx<8S bc)&z8HipYKFlPYWS!fC}s?rs2js5=z-P?B3 diff --git a/media/light_pings_proxy.png b/media/light_pings_proxy.png deleted file mode 100644 index fd8bc5a10388fa32da8cf1fb1689bf7ba9014514..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 32510 zcmZ^Kbx>T*7c3TB7I$}d_r={cI0Sbm5Zv9}-Q7J%aCZ+5!QJ8Q_p5qU@1M6-TeY=& zcjnIAbEZ%C^h78tN+H4H!GnQ;A<0OKtAc@nSA*WNun?ecrrX}lz`&68t;EEXWyHit zl${;St!#gQfq8=0q**Ad%e94in;XFl6l)js%d>lLV5Gh>8auFhD?t zQILfD!$yC6G_{^axb4I@@^`bj& zY87`>6u(CN^8(&z%+_M27eA7v< z5PJtRVT%*q^c`pN^E^owQz0rdwE!1Ued+r70x43D+>ls>5B;r2C}(93Gw3$xnQN%Y z*B4yb$N2=@hsG7ak@~(k?e?mlPh?H{0!9-90cP>CVvY|ZqK}xIJKM)aM1!4~2Ie~T zWwXKh_EBTxYKr3_6S1>vL}3l~mpME8{92^r2ZW>R@xej<`N2Us0oV{fSng{fFc9eX z21E!DW&bkl`>K8sCI`gx#P_p6wj%~2#}V(~zeFo1SpLn1q$R~o9f*ibe1)q)5Tq5O zOyY21r=RiSZhbp1iob@}L*1Mb`0lg!4i3>0I5Ch-)>>F$lCwvjc%Yg%ugUh==yCY- zfEyE+snYOPSysJP{Zu7K^Sj#43dLgKZ0VBm{EsEmISWoBmSXNg?jv>;E>3nAPLw9; z=E+979zBbX(b5(7A^Sg{NrTHNaz-mI!R)iox0CciyBCs88H~U(Bv>Lr{eY&Y(a9|qVlv`(_~Y_ zk-R=SUqVh}Zdz^${s%ieZZ#qNmp=!LD;qr>pB}t-qzIZwC#gtpoo%W1m>tot=kc-HG=#%2r;rFt^{s zg$1!Ek%2%VpRUj)-wh9Mz`aF4PnanxlBYugHmqs{Yy^Vzfppqf6OBd%mu2H=@u^d^ zqHop?J+EePb+lO=z)SzvV^FDOaNa@U^ zL3-SGd7Ww9DSdogapw{pxCt2Xc_t~l!%f;x&T8sg}> zw7jIgU;aqzbhC7$$om-4fsX-l=~nI5!QvEG8m%^nD(Z6>tOqMHrV$Q*M}F@i?|V4Z zQg$m5^erW+r}+q%9Jo7K>*!kjl#%?*nVd}Sn$tP)o?fHkmFQzuJaxthS<_($ z9>=kfvC+mK$~QqI<+0{QFJSEJJb!n3s_YQq+}y_fU}~XF!A0Y$@faN|aEIS__JyW*wBGaD zYS-mSbvLbQf{VVfilgegq0~zKSqc8PthMh}J7}#%pUCS@TP^DgpG2Wc)Rxq$WJKgn@Oeg=40@KM^h%!dRwA8v(vdnM# z15X-Hh+F8TDxbD-tyiKYr7foWVx{QtaV++8`f&uMYreB5xBQXi$;Xdx?oDea$M>Fn z0sQ7zeWnd&B+NR@VUNH-ItCCs86)I_%YDRZe=EDoxdL@Mba`;De(bs{e_#E9|I*g% z&^LwDN1qd?$KpNn1^&1@CADetRQ5WvCdXB{CGq#B1o`u9WWNsZ~Z``ehEvkY%{2S zNy&b{OO%ssGN@*M^l(TGBX~V9XbOJ;Wt5-45m)_pMUSI6CUK6C8b$t>`M~ zApiw5IkX+pZ6OP<+Mol7F}p;=VuRv4GjlWMQMXYT+Iw09wRIIHwGb6_RqO@nx$gXy z(hnfEq7u+>oMeV&7-vX)cyZiz&}Tq(%6jtk%!e|Ib_3P>;u}A*Ni5TJm0sm$@Fu!| zM0c(a+q?89ZGh}=Wl}<8^Igsara4zu3nwSI;Gt-<9`#1o`sk|aj_lCxaEL6jioM<8 z2RQ^;^zkCP!O9P7v47-v?3whsVSKKgz@KEVx6qZLeS543^ z2eo>-|9hlGR*Pj&WSX{OQc~Hl*Ska};>}&yjut}h{o!i}NinMuFo?5mlolU48{~Kq zo;{jmV>LIx8q|>MG<5R-CmDe+Q$Y*S1~X5vfO2WJc{uZLoNIDz+GY}kF`0Rt-iqn2 z22ib6%~aV?_oMFna4UByM@QR9>sTAR8-q~oMeHT(1?FWLp}*h`(R#mK96_8)H(I)K zo^zgz@7;>tu+QV$V%%7sJ!1(Yb}d&el0CyO{-?I<+Lx!3ydQ7vgIhbtFa+^n<|JSk z{zCOIpCnjj0WkUa-O%)Zp(IhzgHC^M8a33DX>;2WxkDTWpA7_&Jd6OIVJXFV3UM1k zsDqEAwBp)Am;;DIzo2CNImEC?xnYyx8euizmf+-I<07&na#8Qls8Jn6);*H0lMWKl zk_@OnWI{q7$MU@?{EbBE;h&W3!`{Nni77BLt z7z?fUR`{}mW6ypDY~dsty~TIV4mu8o&sQDS9!f@yAP(_u^MubR0u%_O8|AjU36msK z4V=TMn;7Lz4Gd#tF5})>zLk^B@5QRFI5$SN(uKi{W`^pH{G>Z~H1$c+M6fywlUhY? znl7rnrCwHw_zClx1dRxD8n*2CL5|7n5DU}Yn!A{unuqBr$H^^}cWZD(KD@VhyvKZk zSyN|gBZZIfU2J1D$J_fx7{XVFu$(yJW0@F^28_PAPhj>NS3it+0HQKDUq8+>L@enC zrI92Hu{K*ZG8gnl0Q+FeUmVYGK6s*mvm)Z8M5ON5L)WvO3Z6SRm^b^^QVG%0%m=0r zvJeh|qCkTIvw^;d^N7%h9}!j4b9r3~fl_E<&hmJ2k|L=x(~8^j1yVO5Y`Kw9*5Q2d zp$X>x%So}(wK3Zn0nr68uYGsyjBMBqs|{>T(>cs$E@sC@h8_Ngu*V#K(GE*@g$`bZ zqV{d}X0Y2yPZ-VU80ZJ+;IZ|w@KGI-M^mFyZxdS+SmQMkl9G?r^EHOFHoMwgtt73) zy+jTx{+YJeKN!SdXI?e8x`w-T+!sF}A?YER#*9ZhQSD4UPZBcTGVT~2H6XYAUTfGG z;qh@)cOQ593`}&4am%^~+;^Y0926bC&E^S^KnW5T2mB754Ur6Clt>px)^7@5kCll& z?3_b)@OGhQC5>S1cx^Sa_ULqnW?HzvTok-JKi!Ofdw+=vSsU)84EynbIjzC5)SlU{ zyYv%yZf2^n@PKv9HTZ}?co%o&mi4GCkaJG&g>|oI8jb|x-N47k%k^C8UHGHY3Hq(n zm&w-PP;e^jD#}4v_%pF9@RP2swIiW-_?FT8&1}S)+o|rz`#3H&FQt#{vE?xir4mH} z`8ZZDRx{2a$1?lhSDC@9zS>`JTt2aug)fJ@J0#vH8E^@z8xK~t(4W8)+>zi+o7{%3 zwA4%7Eh|T+u$XB4)dP zRekFU5o@6W`v-m!PQr{bW8|(;p6QNmvhpAm0ox!K9x)d51NUJ!7{UPz`#hrWW+_)J;Bd&U_8|&HbO0u6qqSQXy&8*NhBioV8T~bP~V{% zNZ`p{BlJ~7B~&m}81irFX~N;L#J?4X&u87!6+Gp}Z?}CsUG_VzVa&TXdAlEVIAgz!K;+6&peX|=!_q*#V+Mfv*|l4@0Yymj0rlkh(#kQAA^yPrI#gwfla;MH zyt@CcLsK{X@AqpPC=9q)x2LK<^iUWOkx)xG|7!yeTq4kS>too~XQfsj33~8mf8=h& zA_}u^z1b@1D@86mdM#fRGR^TgPP1z1#q{Q5p-ia^@9pV|*%u8{jg$n`Rk`HAFsihI z0%hWu**LMrCA*-{v*V}Mw@~#;^@@H+2;+Xxt5B!0zF8`kU{}N5-rg8hy&ag(0=glr z&}evOEC_IL@OV=o5ZGXXK>E_$KWZl7iOQg3M2Gu)JHc#WVZrUN-5t*JF9nz{^536e zqu?39A&MkpGI^W|Q~%Buh^hX%oGXI)J%2`oup!Xa<7A!onun1X|MlK3}MHP}!-dLa&pkm2Q1*hOxcS zfIJQngHqY@oR+gB@5%)fLNZf{#)J)vVqu`rS~M=xR8Q*t`t*+MecJXeF|pym1I1BR z9~%NT(*fpg4!_4y#4BxxxTeIj_I>u>WLmXM4l5uB6(HgKS{iwHe-9dk$Y&6V8z4Q| zw&ROGQ?1iv)Po}Q3?_^~>kOaB6JDsRTcHekq*vxm86xFg8?AQJsLko)MfjjN_*Y6# z-%ILD=CE3Ctg8VEpW6vnsBu{3M69OtTzrRal_*?X+z7*cWk$W9>12yQ`<@5Q(=}gO^HtVh9bkCqs8NF@RO6Ww)NZpj_?g4(cxd$ZBrabvVW!Wcy zWtQTYNy|4xqyp85!704md@8g0YrsbJC$QUu6HAuPy!Bjxv_SqW+iV~hPAn7=v{uM3 zRcag-6IHcMqeh+{L&2JugXV+cn_B#22A(y-8qKH0OfKahokk@Ob3H~AEap@jK>1(2 z!$X?Z3Kq1uA0iS`inydcFWAT(XqjU6?O6k+=Yh8zFlhEy&KjQL#QWfJ*^X8dy9Bxy zBEkM8Alj7W@hMAzxDgHK8TQAc;(G*Tkkj$cPOJJ*b@sJHvN)6p-rob$^Io04vA4~< zqL#_Bz;LLdR{Gwm_{-~1AST>TG3JvpWXlACfe`pKX2a>E7g00rV|Kd|d%6iW`5E2` zo05shCHy0(3?K2b(!_%?(!K`MkyIw`6j>P9a$ZqF*Fx(+5MC(%gi5B+{&}u03jz!g znEz5)l)93N1_TWyQX&aPrwwYfm=N&bgd`wTfypV)%m+b9G7%^*N=6h*)IsRu>hDkX z|2BsKmrBH+q6$KqS#VIuy3IyZ!oh=wh@65D;{VrCzwc?9bBRcPG1X}OFV#p@b+rHB zYYTKY3`_%fXS)f$FBCmTPGfT9LZ`d5g5nDTOfrj7|6MZ(x~3cUFW$~B?QDWUXqVZ6 zkwDjd*c@N(ZP8I05$#(@r={#@j%@T<*8mT4FW}0N zi3nE|dR+av9FdENrlaL*P^){1`ZA#TmrQgs!X4m(t9IOB)tBc z*e^}kc3e>Fp9uAme(^cQ!r>?*Qs=|pYfixfz6XhELVt5Wg6FekN&iyta?1N{5-~kt zV?1u-z~zS4`Wm0_ibpD2p`4gsI1oi%X+i@v4hMP^?j-srO3rycnT#0&0Ae&gVGh@p zx%9vOggu;=$Icrpk2o1|rsjEY>q^dGj4MXM@+sR1_^!>8{BG*zNEGk!W z?emZF^#8(w7F3X+xnhCMjQxtw%lVu~0XUFmGKBWpEeFd*Oq_DKHrQJgS<@rBQr zGjTFFwzb21@^Z)A1u`X!;`;j?ALc|vC zEnEJW+DxpR^t3uu#&uIRWj;D(mzwY>Y;1#oVyzyo9fx;D$3x}%uuCmjJ_Wd&Ye|NT=qCMafVKSLF%QP zMXxTPZJw_?4e|N?wHGsk6Y)Y-e$Ab`$|ho`!2QbS(nRd!k!?3 z3zLb;_$7kh-QJS?-s~RA&woj&^2G%J7{q75ZVIz3z@pfHPHHv`QyH|aJsy~G%gOli zvE+vwh?XlerHs-J>>ZTs{kQaBOY|E`11`nT#1SN+gTXJRU6(E2d#qcSkwR%mFA)Gr zcu@S{J->Bo$hN5@;TnYatDKzY5&raJoecAg1<5i$hAOJM%_2ek*nBv`=aH6J%>Z|C zQG<9j3<1G&@`oy2^v5=Y{$j51q3g(%L@Z~rx{jmL2fYTOuG;Y(DK zP)}mW@d8U&KpNiA1oU9ZF6st(QQzp8!ipzAF%7=gFIIQSIz)t*EZ+|;7^Z~G)(~!N zszn=FQtAr>Es;z-4eTb6+v@jA7iLeo*mxZjv}R=ZDhA$bRg)@%O#JepQYr9%X+fTE zftCzk#146sF%1>QREg1qjL!nTr^Bp`&}*rL3n^|BZak_MkNizLTw1kKXT4jOc6%SEi z0EiMAGUKKaX;q{eDHl^CTMn3|hLdFlxX%vt3#eJ=JGsbDN|NFk8jlZEaUL2S;A zjb1lnQFpiHp!J}CA-dc!3eqp?rztF3a$>@x zu_5%^i`wvHX-<^~`{lDm^)SukQIIwQnxn+XQ<1`8j2j-P_7bznG`f>2u3hj zoSbC0Y31Ae zWT=|u=)dt$q-4Cz=Wq;yy3nOR@Svd&@PZU&whXh-p}^xb#W70(*G^FPVu7mY!3f3n zmTA$pYow%Oz+m_{BGVjRJPme|SqwAzWb{B)v}6(*qD38xs-t#HaQ%e*QUp1oX3@X` zcQjXmW*YwJR5kvi9{&1|CKn!`J;&vHLIi50^VuKM;0&0ZJh&Z$O)kjo-85-&&@fFf z&`00CQCk()-57OX6tJnlKEpxqk%}rn%zFY}M$ISS;AF7Lg4G5O=W{fhSbo6%X1qAg z(FsS)Vw|z%CBDA$^FDare7<^PdyR*x`UagD6sVR%DVoV#Kx2AI*8%MJ15F>?IC9dC zp8|QSjsinLV>F5QOHCvcjyMZ0Up8s~XzdR!YV(}6`;~iR;`eW-I!%glez7WMr34>N zi>88n_hW$P27%OPOiQb$%l@@4ZmjXKykp5>p!Et$Q?0;8H6l} z*BD5LSPa}U$c1TFJl3|aio+tQzIsyE+r&@1i6Wu{aJW!B#8!WQfr@VvnsU$}Kvg8E zvVDgD#S_UErB{5J8C1~kz=4y$2poIPj`dc`dj;fvJwiuUE)!EACJEla`7O-@dOR%1 zna~&VpJNMG42;sRmu*d6xR@F%-u<$3#nTw{Ho2&#!haKYYN0LvEmb~-j=QV3ypH3>u zZ`fYK%~^r6-ax>U^?5p;BjsNAZaN^h6Lmr&&2qQ6i?m->Etu+P`7)m;oKEO!s5ae| zk`&}{LE-r%h$Q@SkaW6GX6Q1-Ig!eEw%V|tqGiDA^L!0bJLu`p1ccMn66o+l{FzW^ zm$LKaP}Xe0snnFUaRTv6n^^|6G)I^v0e-)~jv##!pvAQ1W4LmuOS3DF4@nMuqaMoZ2>rL45r7^3CS;^q%x zrQv9W_fBVa3>7i;ELnBVf)mJVo2vbr2V9$({!^{_8=33;$g%qm;A_3bhIFW|_tpCP z@9%mFU3S}1bX|3z$#2+7*kj}+S3 zbooNCrL7(*CROYe^t}EHn!Nns6$5X(yQ3*2JdXI_(f{Z%H=Y|O9XyoyH##T|sC%wW zPDxl;*m@l?_W8BcHns2%-JplPvE~TKNl$YNO=LvGSzU#*Ys2Q4dZJo~o!%ic?2EVNmwfIk+&(6m^kbye6=0SgbFCn+LKQH~mLFA}KvUEJE5Gm4U$&=YXRUGp?@!R&`VEn*)T#xZvOKpA9^@oFHZQA z$Mr;6sMT&mQ?h@d*-8zbj!*1Cll1R**po1*-}g;DMk)(CGXn_~89)09vz2QBbMJM9DQo*g^Ni=PT5Mdw;jL zcXU=oS`S~)WyGzI7B~^W*x%b*jfhDKfDQfLY8!y1RjW7lIV9-)NP;iR+o0d&elo|P z#7_-UM*N@1K???yO$-br=QT%Gp<-U8i_RS+*G-$k{mO8NOE#=beMAfInsG$LLr}fx zzT})J7j0G9g|Oa^>AQ+)qfaa zz2irVE{Y)Uw#!nOlC4M1$jHO@8V=xZFP^HJW!Ctie9@LJk2^LN)5KP#QDNdx`X>kv zGnMWbjoM^Rhb>or3~xgC>wPep>~h1QZ+NHO$rM*~JYtC1370Ma*gpk(5)35@N3@8e zoCt9az`#h(`hGf^u%2d^Yl%+p=6F-8Kmp&t#?F5JeDl-&lYhn^52aHBjo~MUD(-ao zUn1XUV-sgq0q4SlA?Ch!HX)&2ohI|+;i1P##(91Ti}GzcC;@+eMa5`;j4;V~@#j4! zRWf$=Br)=eiV7JSnTiSv6FP_Xk~d&b!7u;kO%fA9u&Ry7(Wb~@&5b1LSS_8#b`MW& z!Rg4Mp&@Z8siN{iZ!+uO41mH7I_1~sxtzH)O6pqy$G>2&w|<{@#Ig4`)w(SN)10Zj z&U7Wjpr<1fub3>$dP~CKuMR<2?;de++`O16g{)Pl^_8wL3F5H7+PZjO$%eYC8TJzf z9~h3tIRF-E&@qy<-{hdWn*snFFzSwtKM5T5E*#ORz<;4_kd~*RJp*va44l^T5CO3GCi+Vwk8D%_qS_ELAEGngZqWei=!WJSqn_rwp0|b zR}-yo<17;PhYako@TQN^a6_Qrb((y+XxouA@4oCjTdf%U-tv7zi*M26tRgR_ZrUWj zi2_y)2QeW6t|gZEIQ_yP>v>Jedx9z!?ncbL_3&g)&biTshv%9AZr*@^;$$k(2(@0# zrIn!Zd)6Vw;=$oWn#%x+jZt_E5nRXE;$2K0eT+s=r-Nt4%K}1A8|s<|ucofAzLJ!jPD%f=`(1-ClRpxt@E+ zd47^;K6g{xUXPbsUG5j_aYC;r*}N{vyV_5rSHiq!kx-m6fClNr{2;K4L=qz@QJ|0!e;1xAcr+!=^1Nn|r{8Qj zmq0G{pOVf++Su*`+Q9gH+;Cv1#7O^dWrr6NX``UA7|(~JprV1?>u->8{OYCpI`6N& zWvY6HU0@5@-Q(OfuUfT6-&a)&;j|ByWV?d+Ea>QsS8nq8L02}S?s)oc{ z(d+6X8@PU7oEx0Av)>bE8BIv<_4aUjTv~p6nuE;+F^vubwtV8m{AHKT#sLOWYqn!m zp5#DOmeiCTuj3rGvU>|9Et}@sWE2QK3Q_-r&VnWuno~&V2-rAzxthCUVmo#=mT7?z zI-#bux}rOvMbkR>eYXwQl~BE~{qSwoz(8Tc99abcn)ql+6`3mbqXo3JA7u}@m)hmKl?E_lA(n+V=$CBh^jOqEC z$w~QgHSW(?gDfDB4u41_2TK2J&Wkg$q3fD#_xs=J#^l5sI2Fl(7 zPJCSh23(0ict1U*VISd82pIKa)(} zw563k?myw04C-DcP=rJVKqRi5s7hK51If2KQy6j{>5!X4=qfc+laRn(y(j)Z@k%b( zs6%qPIa1hm?^hGA@l|f+op0Z~S>@f?(=SjY9h522|3cORCvrklj7uf z19Af2FD1{AJpa3!_9GoZn3x{$ato#D<Dg+t3(-OkccBs#F$rs7#|Z$VOCbke4`)+7stG`vPc_}&>X0%sD~WFA>wDk4sgkinA%w?<<~oaM zT(@tEoa1`CX=!w5m-v)#j4-S*sUKd3=`zsKDaD+y`P#9_;jVVT#8X}CU;`0tlYDka z;2IAlG~ZKWli$~Q+fTtab`N&!z4>zNquSiqJLw~gqFz^Qjz z3m(`0NLU?!3Rxl3ebTp1>FLh{O2%cmR{u%?L7YY?SG(yP8EOg$)$&bHXZt8%b!TmAHaQB>g$!whaH80yCf0QI!G>{zwWu8Jk!_n=Gp)m^)~w;UEpKxEObVQ8c1Yt zz3djJ_@(tex%RMJG+6c}U|`PW`tQIjj*)=j?uiQ>76YT@ad|i3-R>3@;BcWhS+# z!D7-251U|0oLFOjjM5bVPh2P~92 z;nxgYKacb!r%4G%o~)!q`)Sm*Q7>NpWBFXlPQfJ>O$vtI$Hq&I?d%3S;KLPhU+Gc{ zuSILGr%=&7?L!^$*43Teo4vI5&FRAyaR;59Q_i~FrJvp9EPrk!<|)E9enas-88t1l z&Hm6FIn`r!i``CD)lOIM+Yi!>`AhDL*XM_LRPx}{^XV(e=u2Mn<(;TklrGkCN_{3f6M(GmxPyL$%K%K%hha4xg{hX*;tr$iuFMM5}*=u0vh*}>>3AA{?3 zCTG+ky8TsfW&0(Ju*KEw?SLXd6rWFh?63(u+*GXweTU>!bi1|AQss}4p@ZNM9Uzdw z#k`E$25Ylk#Zobrm3%Ng9VgY1>izySJc+t+Cc6T|s2*R0az-{~T0z0&8S1-dm&esn zxv*K-uUVmAuOyJx_flqw{S%AIR=*|uP!t(_5mMJJ&KP??W78!F0uUpxHVitcUMb7o zp=Uao6m7pu-nnj$ZdQJpT3^i5vP-U9H62~Mtde=O=iA>|*x7ohO=vrjRkZ-z(Z2{^ z z?)UWxBIW;94E-qe@Q#9iv8aS;pds(_O9M0~_gUDcZDR%8IUYxiog2Sf$J0*>pb|Cw zT?8?vnD1jcw_55HFF8%mC@s7357x`oV{4ycVaUAE0%m?sAghAU9g>G)ERkTRXb`kx zo?y&^F3VcyFY#wfaNaJ1PTyc0uEA!%g+|V%p;l-)?u&nml{)I8kOc774@d8Pxt7%D zulCD-Xq7ztPWM|(uVC9|R$|J3h(PflBj-#BDFu?zTb=#27HrG$UO;C;uybEvA@$w# zEc|iJyfIX7Ka~w7N;)szmbE^_TR7tG-M*oPoTF7L`DwdUP*AO_Y>D}sUai*h!4ba$ zhO}9f8EVnxTZNy!RDM3|-XoB{9ZVZ;pb%|Z-3?S%i)jP0HF*oSK&5;`L&G#h`3=ct z7!|!teAy(xS}fy-A-E(b~a zEsC3$FDZE4k{ZD~Q0h)yxU5;e9PM9TpmCS}+IWO8c;!|}kzLv|p%jb2zwG?peNS0z zJ}$_l8^hmpb2Dq}6901luSH6?HIlD$Aa~ry(|F`fDmsI>?^d_me!qEp^}%9tfN0CdwgIrx zaa1bQg#hlSgX8oYMKM6f5r8xl{JqH>Nr@2;wf!J^jZYe&^#TloQ^NiG9yyFOiiGA` zOv4e8niL({2{I1-I(E*$+HAGMPnnZeX3Y;(D#)EpHMDK9+p@+UZ)%G{H_^+Sn)c_F z!s_FFKO@Jkc5FW~u3oCn(spLp(mRf{H`&ng`$H`y5%I8t+}`^JV=*(rX+gbf=V?_# zV>)oo4a0y+#=eznRh1hTr9*D;swlACwDi(`{At>7_Nmn;$C9N~{Sg4wv$5h7@%Npz z68UM$@99*@X2B)VBF;!wnRkZtZ(L%&xYjMn4z3I<$b<2E-ZTSp1~G()njhx+zFKL< zpnhC$aPHo9){7Cg;up;Yi_*f~iZ=!gpq|Q{&3DGRN2;^yS!b5|qgM^O(E^jdHePegDuxMX{C}S+n9M&wZ1Kv(l1( z!MPQSQjW#ZpKG>SU9h5WLRFXgc>ej(u=MWKMqv2q^<=~6Ya6#UMI^(kM4GSU9Y_g8 zAqwtWuGNo%+fyl$6nxrr$;imi``7OK@$*?xHTPb+FXwBTokT!dH(MW~VXYmZ2BhQY z5g>oa5Cu;-Drfn~5+y5@1E@b}_CcDDsA#T$*KHJY?`oTaq5R;T?3`glXQLk3F$Fb6 zLF%7BhgnJ-)YRFm`1B*gq3|w>oohIlk%&$v?FGwgxNp5DTPK0@F6VT2tLMX0P3ZFy zmU_0N)*Y!-$JghEt*xI|gb&&PMT5D{TTTZ;?k%T?uW=eY7NTpKfnMr9q~|( zp02UR#U_U!-3k?E@`Q;AaSIZo*veD*`3w$q+@Yf9+&bg3*s729EvIUks&@-<@9;x9 zps`=qR&D1qo^$&qx0_A1CTOD)i8>XTFtG6qduW8A-t`HOAg=y%x1pXlPB0~vuP^CR z!<@-b;{y7Qek+N;42e0bpHAoSe?9emg-jGDb^k$!`H+c=0;z`p;y9o2%y*CxZW5D> zqA^D~w7l#;I&=wp@C8TzMApqM_E=ia`4gn}jQ-MPr1X+e-G>vDDNQ0PxbK=J4&ZSX z`DNY_)PkA;N1C|RTy~Uz>WM}c^`~x0^k+NH$yMK%ISl8B)~ebRU5p&mgUWxEIX{H2 zY~V>Q1Ju=e3j(y+jI1vKCFM=>IkW~Z=#&eL)ejn?H(4oV03NIF{NA;6ri(9{0n}51 zxJwKkr^zt19U&!QucYX*0qy^Y8x!m^Ih^y-roPA4aHtRkL$1U=O+<8=nHZT(@-YD! zd&1qXNyPCuHb!4Y^fUl&%?WiOrMCyjyy!K-*cOe$x;I9h$H3S7v+6%55-fP%2E(s| z(FDaDK2C@2caV9oiw2TU49-s`3_xx1)J%!|Mprk83e3LCJE!lPx00DY-mQG$!&c8H zUN&g6Cp=p@-wzlWr!WN z{_WS}`5KDAHJBPxF0D$6sx{Pm2-MnpG#C%a0&CDyKfAjTOI2?zU^QRtebvKFPCnR% zU$nDcnwN2_cdUR=sk|7b7nx2E6AGJU1?IuHVu2?$dBY8j7`;UoKw~O_ZhMQS2loUa+6tRx~d{49E}pgP8CLvx%^^cYc4Ca_Vj9mV*1`MZO}-d|fdOvl=|TW?5+>Ubk^G{~NN zWZ|)GWl9Yg3ne*__vih%Tw@W?Nik4$-uNdJ2|pF&fO8T&-{Eu{T$A zwj&vyLR1Gy5f?ObE310XARllJed)VFAlSs~sti7x8SLGnfhwg2l77P9cBg#=>lN@vnX&TA;}9Q zw$KOjawuS0MyT5&f$E5+?5kwwD|N)S+D3vJM#E(Nr*4lbMb$$iBU-i!>Zc^idT3@7 ztiLpeGFS{m!KaaXq9NL6(nQ)!6y~Y}i~z5GY6cQwx z1T21M1#F6)4!}qYy^G(W^OTC=XEG&mO6xhSUN+Q=CN%{G%iN!p)50Cc$07Rg!+9nF6se=iHntE!xB?io=lpVVUcp2z0%tK@%INNb%`oKK;>?%dV?h!#<&= zK0PvI(!^AW4QvBXa3{1%gQ)t4qKjU}_3K{e!R{ACcJ` z6D|<#C+mU|0oG=xTNQNXttSeElHdad$ih`V?XP821{##jQsp;eQ0`Row1^{8;N7fM zMGuMyXfE-z$&tLRv`+=qQ3k@PZmc$#!X2Dr|Lgx91jGCJ@bR>hHVTEGMqKdCw99U} zT4z4p#mV|)nP*!vkRvsZ@;uZjh0p?KYu!D?>lDzhY!BKIO#pkAVAe;b)4)ZgIW~2v z_OZgW-suIP_2NqXAGce@E`0Ih-kkwf)>N{-qfLI;t2Y7f4wNZcTe0 z3Lm}CI|@~c%InwX@88CCLiY%4P`S?T@@y4kWN5$bRR^=|h67`6UR5cc zW+)hzi`IAXKgcQeP4OFk}^!~~~I(WT<*l&mOy&a=w@Gzm- zk<$d~RUS`KNNb?7#`7cxD5V+P<;H1Ch#8H1;zvbptI>a~K+#qg5|F`lS$L{~(*g^b zu~l%}<4UYk)gr^y8tPUbIn5{2BWuLwO75zHz@|AxB&5_F=mFr!LJj?+r5W(mL57(6 zvNH90z69}E07%}$P|0Z6F>7bky9m(PgFzC?BW|XSgG6WAEy4`X4hrd{46Fkp4=@j@ zJB{4KKrl5df@k9|5_xqd+)DXK$$T=I_{_tD0}??ea%?`lsUJ| zPqFr=Bodk%LN)FsuR%-NLS)z=+m2rsEh~}XMFuI@5ZlhnEhmqTZlp;%(b0uP8qXWX zgP|%)xtIn?h4lWS)TNp^+-_KehCL4g5D^g(IASL5-|WWjO5QXg4!b4(5dNR8&M`WY zH`@A1Cg|9j*!IM>F|mz_Z9AFR*2LDtwr$(S1d~j1>;Jy%ez_let#oyz`l+sS&ffd? ztk#GAv`+Nd-%V4L3VK96QCmwXk(wnKXzIKN1TNaBp{;h;fp3EFlt(Gm<5YqWm{mw8 zwehl}_1N_aBt51WMpLZ*eh+$7RwE^=O6e42RB`byQO)46{=v*F?@2I65`@* zO#Ug(ucW=MIZ2fA#!m6oY)4s*<5RNI4uIPuee9m3Z~R08?QJH3$){%hL)QpPdX;%1 zEr^cd9XH&`z9TJ>*qjpeOV^0DRoj9799EpAV*GfX^cT9FOEr%E2Pj(R55$z>KEGkN)oty`g^}1CSWvvLI}zzymZ_NN zW=!k7hHXHc?HK>?22i2wf&;1B>XV{$;jCZgi)GI!E!=@+muig6fjw7;Eu*ihr>RA& zD;m)44K(v_k7vPRwNSK*<*2t3Xr`aq0Bu8NrHJg}xbyEW|5k0s+pD{Ov|x(%Eu_wYbml5wEh^aw@7x7zM_L`5~tpJ~o$IeM z7FJuG!;^?-Y073lt?u4lHU*StdwIY0uV6S2GFU%g591{Zcft3Uf=pW?pWhdO zH(~A`M)&hy#-PU3kLis%9%5i8nr(KP=mh*8ewG?@#^B$NRa{YJXN>W8S!+GteqQ_d zPyc08C}pRIr8~L2WN|sK^R}zN)7#I<8a6bdHsW+*%}a6)Wk-<+hGE$P{o7lWYxI44 z>L=AGR}Rf8v|g#1I>KoMWHOYb6yI2?LOYe8omH5HZT|0fFjPc!@V%Ygx;v)Z!579{ z-Tl+ZKMy|Cs*@WnW)$)Sa^P1zpz59YxuX%fI4tKw2%NXYXn9^tZ6&9rx(k?>N(~*7wiI z972>&M(5MQ=Wj2YbD|D5hT|=NKi_AwKV)J9+cUoPe>@V`%-N`J-uH*LT`MIvKTe(P z`S?xm^YCH^nQ)$te>Zg~-f=wN=AHb5D&p^Udoroc90bkX4pUj!aeeLCU7%yCoQi1s zj46Mckz!lVkQMZ85Wm8it6SLUv6YkJX7PW2n6lEK=&MxG$d;KZ2(t`d>E>-!o5FD% zx>EdT*i#CF)!DS9EA4Ug95~n5^!UuzIe+r7-9Ik0e8tl?94(R0`pRjiyGw@)QgKjD zp<-*yR^HuS1e$kDoIJb!Vc4C4mluzs3Ba8p#Dnh^g3h8kpohEKcQs!Ozu~BPwvQC! zcrXkUjR7s2yb-A}F;d@nMTmLtg?}x|^!afGPWmGf@}>V%PEQ;>W*qVbI_<$hBpg2x zW+uo2bi^PsNW*%rNF$l~eQw8nNKZ7Pup5fOe|hguL$;XS_sspKAZ)5YPeu+D|zzXdBh zTKG%4I8h7;{qUDubP)Qf#E!QUKv6MvNNf|-s-fvq6LY-p@QNj}Ct*oXE5br=*no>C zjEr@#h&|^)XU6g*NK#8;BchCgvJt>N05jx}z1D^SDe4At;9eY0p=%2Zgm2DgCKtwn ztgF6%f0!Zr*SFZR?M3%MMIK(x>vDPvOk#~H-)lOqjmRweXD67rFrr>zFcdJdN4cwD+z*Ni?xx%V>T2r z+M+I$J_GYIren%v`VEEoE5sNH*(u@S*$FdrGoOK6J_6cTOTT}pQ9KH3df~keFOYM` zhwaE|3P?f&8OE`AS#vHK$S%@JHzzKfm}4mu6nr-O*?e&6bcMZM3WV6IkWOikWrioY zj!fW!ksAbT0#B=~os!judaJ{?v93P;_uGNf4aRzWn5Q zVscpE-QM=#VPO8&i!$3}?xBm5jH!RKOu45<8p5{M8|a4efaZ22OZN+J^G$B2r`x;I z>`Dfefbg%;)f`{t5PcO#lDKBhJuyNtuf}R!swt-ZroVI3txzz@bziYH(z?lfh`pD4 zC6N_#$YQJ8>&|C3Pf{HX=L!xkj?M3=HnodpSe9X3C90DW{ZoSuH(S6dcj;(!3zavE zn2<|e?eLxI1708d6`UiaQ7Nzh0VlknRUxg(58`{Erz~*;&Vv?pX#oB606K1YT|_jh zr+T%v`2FUlZrKxHATm!n00tQ_8EDgU*sTGFC^bd2F8U=%YlzeIMX79K6c^I8E{xL@ zoKk}RbSQ*5Ngi=T#f0^G)zxY3lAQ^Vueg#LwBkt$wV5uT=!NTB&wuwqi1aUaYMeX@ z#{EiA3hLENXfra4}4*; zXrOO1SJ$ME%z8dCGw0D%JnT~pF)Jp|xHyiKAt`uWP)F`868&V)dd}tfeXvq`{=w(8 z{tI!W0baX2A%;DRt-9HZ=%bUCgqxp=&i3YbDG%XHzeBmCx^LIuQy@7pAt}Yj_+LfS z%%9G7Z82iwXi!~}p`BAEMQ!T}zjFr&KB`U;_4Ym$w&TAsVMA}Qaa2&G>geW<_?0)A zrZBY=D^l2BprL&Ga{=>4T;1zST{?^2TreB;eMj?JXiWUrSUpNP8(Si~GJJQqifAFo z0Y7;}l^C0Wc!u;l>2iTQ+b8uwBTjz>JRj(LB14u`omix}ev!g4o#5Y7GE>C{r)hk_ z!Sh7Cd9x37hqG{55vJFOcX%(&Y?J#%*@{D*C7>`H)RqY3>@YxBdrV0xrR3;-7W}kK zayy=Vy2|1lA(9yz|7+2=qGDdllj_pvlSD?B8Z?8N$c_A+o|?Jtc!^&`0OfQ9s=0M-U}<&zzcuhWHvqHp)-t~9E0 zqe=JgjpmO(yLx&8xn1;i+Ks?%MN3KfHFPrGPF6m!CH_uV&*LgpZvZWgVZ(uZAkouh zDL5F~uinEMC20F>3GZ_)i)_*xyX$Q<*q(96`g)%6al`X z{m?qvM>WKbj&5-BE1Nu-M6{5cNkUp%C$ivsJcV~EJBQ8cuCk?k=0gAXc&#yU@6h9X z^0tgGUFm0?t*u-opPH?Pv?yL8-30wA|LX;)|94(l8x$Norp7tJdo)E@7Q} zNsTKv8Lx6_Sq7P{*L5m(ZEpr`CI9eZdYHvXMD6*4D=oUosyxebBm04U0IgWJ{B^%DpoJ5=!*E4Axo*%0) znM=uQIXbA@{BKuo@)evuF8f~9GEYnA!V4#M3hWz+?$aNN8 zzM7R`YG%8#=>Gf}sTK;WT<7P@>*Xy9GxD2$o8^I_kJSAH6HTF=E{GCDVq_&ux&|0G zY-0(d@ms%7U&f{=L?b3CGO>1sMCHUd8kYLav;m16+j#c49 z9V2~N76JzG>mX@Ln(A{`)YbP%<`;JFEO?BrSu0TKo6}p8HdflWot%cpvI$ z!)YN=kt$nydfK^0D$< z0n)oz6u<~WaFNHuRAE2wx1`4C^?}WS2pXtVZ^S;n3@S9PII2{U%eMY@LeA)SJ4k4O z3L~z&|F$WK5c_Kwi+}6PIfnLo==b*wd{cBT6-1uvQ#2#x>`{HM8|KQNa(&EQQ}oJ? znS142sb4OZi`2V*JLXsc@QP{%j|zby1{jLuAw){ZwO8HEZ?w7gqye6xdjsLl^9eCx z-D?nvE9McgeUQ%^q834-cxL&w+F{3P`I|9r?YTN(Qx7iJ=8GHd7?!TlJx{^qM;X?GYMiYef=@ofIAW9X3 z(MrSvG$u%eCF+<98xAyMJnZiNO`**wBDByxyUM{`i`Jh>42;bDGR5d5zP+_RV*75J zTUg67xfQTkHYiVqO_OHsQPi#$9rOP&-C%y$9}V~k-ev0H(fu_dFdM_P9;a|8muX8w z=FtreQgRaV&iA9|^G)z(WU*2Tg(3phX?o04(5@ovS`W~S^a+@PIQX?lHiHdua(^U7P4B}v<3Ik4&Zo92^(i$N;`nHY% zx@^d{y@(6ydi9&@)QWdsRB)VlUbI#2h(Bv+dISeiF${h=zS2O-W`7#)I<_~FOWi+e zM`32LN)v6cgffZ*Cptl+)w5)*0%J!c;H|pVJC_Mnqx(gDYD+_BhfKI`cUjw}xL$Q% zKvyQsc_@*%QUYi3ab0#!2Bus_?Hc63ggJ6{2&H+H+s0&mnnVs-sap)KW?;9r~`|+WTjSfL)vS90t^5JK3+_AY(>_ruOG-kkj%uC??ro^4P?rx_t7F3;6J8<%0hKaEv?9-0F$INb;G#~eSXX!O6B75G zWEaBiGIy__nlx~}PJlL=q)Q6{!5qBftk z>OUG8bU^S3_&y09sr*|Tl|F&2s*_M6@42$FGIRP~l!mS21)s)Y{yN#Jm5Hh+285k> zK;N+1(B$ z!A%EwPlkex%?aQ|!gd0`z})vN$w&0W6B9rq16DX|0NZli(YHkaJRb1XTh?$3vsg;M z?u&vP!a^2co@uPOpIwKWBn{#8f{^F- z=u~dS0wDX=WeXeVI}TwMGbSx<0Mi$f9fJuHR@OxH?(Dl+5t+k1^-CZ-H{o4_#_;_} z&6I$wmybQ|H6O$MbT)7SCfWxfIV2?H#Vv_nu3cYq6BsP8jQ9fvgN8-Kg~Ms{Yh0|e zv$Ns}V96@c@;1t(=@u)4fY>e)!8btsMg=5) z{+;q^%Oc8rQTvaOHEIOP0~9b*NlMu-As;R}}8v^0O_zWulWU{|K2Gi0gbEO)hL`aZ}b*?^f({`#L& zDqU2b?vUz#Cxs>92P9j@0vd>?iL?2=n->LN?W%2A*jC!eHGQ=H0wNlPQ;*-jpLv56 zl$?HbxOkgdct-cDN4Aavzkcxjdt7+`EiyP1$#j6xSgQ6-P`KCgkU3PN8>w)?^S20;YYg|rZ#4c zJtWTRdR-dfRpC3<=rK0`M-(!u`&KkATUZjgO`6e5eKk7=NAt^A6j9P-B)w$o<0$xy zir4QxgLghX53y`Wiqb4auN=v|1w2}!qM6X_TOj*=%`eZ5DrEbZ03PM_EN zsNqQ>@Gq&rG??LUNXhb!2M)NC&My<@cV6P#qZ!@MQ#|lAmYD#H+lf++dtosD*L{b} z)q3Fi)#pUX>&a21*dJ@#F%IbCy-pt(49_Jdj~3FQxtR06>)7(l8hdAhXoa!rn`MxXpF9`7CC}}$63fI#{X9Pa{XhU+NLy@} z!~0Wy`(Yvtt%570Nul0^eI*)l;s(ENY}oU#4QnhK+cTB%*)^kfxZRG5bwDSmz? zVsM_BSZEtto#&fu9_<+IN0}}ubWxS5=y`hpgWQxMdulTq@eBXpK;t9(cN$+ra4+4D zceeX_sHsuxQt?@d89lKDX_tFu^DtA<-gdB)sNiwd`#%yviQvL8X;k;8S=K{KvV(HS z?#hu-bZwONs#VvNUWGuwvw^D|HQDT2a_c&+us9j9|BENI?fu%FL_3E5zsb?s2u=l*4xTmoQH6YZD;b zq%!F6q)iJHMS$Kym`sMbJJbDAg;{DefO`_?53Ijs1~_AVAs{c41iux*ug0P?a6DC< z4&yZ+y6Uio#}CA&bp2OEREHnDxA|lDc~&7Px7~RQQx(}SHIeu#^!b&tHvkQ0Mm6vP zuC7Z#i+NWZnc#Z6E2}ce5r>5=g*SQ~Yt^cXG&u5suG#$-wJQ6I@1o+u4^ZrOT01j& zgxVJ(TZOyIDa{jjg`^C~{8zN_eJc0Zaw4=Mwb(wxC36X|(YEsT#|2Yc>L28%^{EO# zO=l%qg2(H2iEZHX{V|T&n~Fs@tOLlUp%jv%v$)k;%Zd!r9m;4qbI76v9msKRghdQk zie&p#zQW7Nnwe@xhoc)1_6-w535^|&jg0~K=m3*DS^ZEB7r9Yfsjqb39<_-1FBW#< z7R!Y&q5BiVxaebk#r)Y2;fit9_~*qbdG^4!*Q?Trae+(MVk9;UoC~LKtD%KpJ;cH^ z(5VwYsLwp)<>hVHf76uL&2<4WJWBaYjD#=qzf?t7RtHF|FW1pB*f<>EHm11frPT39 zCFA?#&{t&pQdphaQ%trJze)dkeJBl0NMIR@LH{tF2g2d@J^z}4ST>vaq>z20>p(Q) zi6_@>udhxWR7k`L;00>GAEzVvL7n(;0DR%%y2am3MQ9nqCP8eSG$5rCvEjJ0v90EhhA<4_QsRLxL(X-=>Fycvl#VHRE3Zq-{-4_*V=H z0yv78nbF{hnzrMwWq~FfC|J(^;->w_&fJb<#cY#Yq@f7|K;2=rR6$V++M_3LU9Q#{ z;8i+rwhg_$qi4PXCQYVL>n--km?Am=ppWwK??vqjEi|5!Gd$7QCooRy55|H2_Z`b6 zS{aCs`fH-WQKGk|n3WHy$=zCMdB#b``kaEDb`6*2D(7^RA6iyn3KvoB)W zVGsvGNKj(|j0PUhO+oDHli@#JMG=)ZmPB;aWlAB8ISl>8RF)Z%Eo_nBL9K8Tsp#X-xMaRc&1%JhXx4|2^9=B!pulOEs#7;IV}%sS=eWi z5^kN&tJCI0LD7&LXuMIXNc0{IjVO{kZh&Z21|>5*NR3WXmJQOHe5{Y2&?OwsOkWY* zpy*aLH={*zSt!LI=Pv90Oov z-MW#>jJ(vdm~a8S1)w5DW7IHDXK|VC^L}>%Q?dG}3u$728s=q|1364}!h791z)f`X$VT1SXndqi_omUQ z%epvrURT8T3W*)5z%8uG$koA;PdK%u0g zAMhuiYI5F^J05l(Yk}W1bj-LdClvA9VXrZxPf<#qAcKT0upXc>C=oZ&GN23~a%j^3 zqEJ5=2_G+M7>HLaIhE*cD`RE+cWv1opI5ioQkm9Rz{N+G)4%^39Maw{_5^=F5QmHt$FYTTC zWM*Ug*#<{Um6r^z(>v9EGss_BI7;g#^)k=y>+4is2VBdLPV9@|?!H4Rsm@6l5fN4Q zR5U9R=ZB>!x~N3bjm=*zma809-%==CvcsaxrjtHqo|pYRMF-!i82EcxWBl6+a0vs1 zPl*6hJHTdw&7`jzEk^qjpuGG?b4}{DaE6^|u+cV80B2ER3_H%VUXZp{W5a+r3J)Od zyB}!ScQRJQ&m^nNsIuf)F$Th=;-*z7bJjU=v!K=D*qn`krUt`&LZYl(Es;hM_4E!|K>5J zq8xBw??MA4(sppwl;Zzh@c#FqIo-=S@*v(OR6MF z3ZPZ`Xh&mWWMPk4@cITR18 zoq5CVo*w3@3t5vUI(~nD%=TJlHPdG=minG#c+cnPuXjO}I7Jo$`E|a~0QT3_*tond zHu@47UEP$^F!_z1Z?1|m!XtFmXF6EZIEzPX9w&SH{o2~|ag%wE`X_cfS6eJMTY&_* zInMbZxE`eKq{2pHQ_LaZTWo%Q@7rCxE%xspP2eK}UjMcgQ!#~tbv1|o36idA`89{n zsel*6tnb{9zc>b5ZJYuY{KM-O!ccmvobjLQAh)qK2}}HK{G}+ z^PBbNOT)y5{=&hs05V6*C0Db>RzLCwr_EXxXPJ=4G2w`6t zYQMIfgXVuR{Cf;Mt3|Xiji_39tZ{VaFk5SgyVQK#Mvv>ce^)`qB>$dTq@$)AD%1x$ zG%Kc{pwh5()=0x@qEq{6y-|5n$rfgyGvRVR*gdo`;`5ZIr#!(E^Z9S)gU1+yhI_>S z?NRHE+II1N`$mHRl|$uYFDJ=oKQ1oU-kLdIoS(=1xPT2-Ck=?JS`)?iy!v0&_}MMx z@>ez!vEzxGkIxZF@-G)QlGNxw6rg{~i2eP2oW0(5dL)p8n82R-?D?G%v>yLp!}C+9!#iq9zpZ`aCSi*Y>|ipvt0=37_xJd%GmNLW!|CkXIdPlYX@0YB zFoOKzGncb~^}+1a+czW0&+L3~=Zhym_-ER^@k=hzHox~xZeF*94+`mli{W~Pg6Oe= z$8oH9p}{Ge?N+3%fA{C9C_IEWefFDL53O}B?yC1$BtF9xJlTg%HG;^GyAI9rAEdq1 z_X@TdP6k;t&(fR5+P`m}*H$Zokl&{jLwx5~dz+&B_eK=#|HR7Y{k0wZvczDi7A;&G zoBr_}NEc+9E#!?as-UobMo#iIY~)+3#qH>Yy+9^5>C>>}Z%enW#W}^_7*s(j%Ib>R zJq!XKE15|xJ$L_tTiB(0ezi*p@VY)7Z(L(GG2M9Fob(``sdl~Sl^N4Q{)`invgy(x z`r1_`6QxM0;9Yj|18v!M?qg}jud_6PMP%?B#x3E%s^-`=XMcoRjm^hq^s{|Ao(Cxh zvB^qAo(93W-`=gl6koI3%#%b*_uIQKCv>qsmJXTST|ItM#E-4B*s%veYXS$Gy}0lf zeaL(y4eJGu+r_jS+mxi))y&j~JBvznB<_FV<$D%H0vmtObkKDa#uME?b=_MhUVq!_ z*()&k(aB;ZoxgT8W{NvBO}zQGy{wLzgd-91c)6@(s^z)Z;+*wDeKaD&`_WCqnkN(t zhp}IFnJ|ZZjbXn$o?uE>MT)E3_|vns9@@E9|Gh~&O`qH9iO~5+8A=LSH0L)EwtChm zdsZkr4L{A^jUb2LW(SS7vrBbqu%H&%ui(qS!e#Xm@`|qAJ zSrrL*7Czc3eT0K(m%1B9$VA@^aLI$B!%n5%G)_9%qSl*dx2G<9uKQ5u>JhCD(^qoF zQ9i5m{A{aHy5;_K{K@TK85m3>Hdue~Y(48C73QrI9*(bIX|h@>Q>*psT5qb{ct#Mi zGdF5pVMECCYZ!;J!avzzr z$ff8d4*HC-03m=7Y-jh!pVROsrzRAn6;^wE{=$6G4*!msC7;e@sK)8qIljz<%1mU? zWccF^&+g4Kju|pUOx^Z1Psi)=Cc$DmJKNk5LD}z`VNF`AbS3gf2U>EX^?G7_*hpqZ zvWwxCU)04d;ltegK%knujzTfYSaxom^V+3lV@t+;ur#BAa;%ON&#zI$gF=b%4H1wd%aT*utWUNNU^pf-A8QWM zP{(<_sP_iOCY~q>H<}OAG9*d8U2Q!24)vDHT?M=RP4Wuh?)&*kqAYuEDZ1~$PA+`HB0}*7*TC|n=CIMthHr? zyVvME9dyp_PP3bQVN<01V6zwsM3+>rO6T|MiEyA6f%K3|8SclW$2i1tMkz|pU!c^jzHIgzbGf=8U@(OZ!>%M1a1K7{FZGv3&nQ~Hi@F%p*CXo zPn&PGW9u{>XD(kjNk}w)PC;elW9{~^Nj?_?b!vU<&)j2Q)0b!arc&mRh~D$CfN|IL zrJKJmzqh*%N>DVrTt}!V5v$Yc96Nseh&yzU5EU~0Q$ld_xAz{fsRLGMQMen)cv-@^9(n!?1sotQMSWK?5`Puhzi;cnR=Va>D z!?thP++zAUDx%$`k3Qe{YNPo*L6bh_5?+hv{Z{$En(_z5b*KUF`_UR#)b|x{$`&EY|#2DY^8Ui zGgs}6?$*bYl^izw9*c(^S(5*nwmcYZJ)1kqIuUd=)fT;pJV(sFQYO(*QH9gFx4F@= zv$Jz^dy4P2e_v5-RoCqjo21v{tul9Z^9mco!ACz5OX7%%yn51Vt{Y8v=opXR(Qlh zsRM;{Cpdtl-kyc8K>Cj(9ZHffRo9=d0rlUm7Tf<7-1etXYA^sJJii}+?`s;(RtEi7 zv)c;+H9O~HP(`pv{vb%RdKnPtfZ=N4AdOlOJgU;jG2@`9uQKQb1Odb^ysz6%xXASz z&8L7l3IJ;$=!sk0>Zm9u7rr@1R>KPwxz=tu6Ct9JlFPN&HVb6D(W zUhq#?i1X5cwD7>aLp#TYw9}&rTP0T}7|47PCoMp20j7Tqjg6l@U2L%Rq!axP>TWd6 zTUM$0w&e^+$;$9l_*nZ&5kW3=#$-Q#l5W+we1{ho#$UhA`BI}>PHp#fi%WzKP7O)^ zpzgayyJIgnCVZ0=GyFu=O;^vo7zz{H1orE8)Y+!E!@+Qj^UUiFk^g2Zr+%mZ^=%d_9IBh#4rblAdNFi+vW--{jKoy zXHd)7Aq3E>*nf#Pxj$d)iTDGwM1V%+v6{K7LaR&_JE)!p>H6d+2EK>dg*}x@GLcxC7_rg&&Rs{!FH+1+dPyuJ(|Lk% zBT@ioqyr$7c-$XKKmMx30bUJ95qOy%w-}u60vm$>y9M~&?Tdd1c>+7TWdD~mmx$iwe$tcz)&sUld_E6m?M@)x30xrLuiro< zSu7^de>_u6f#Ja^S=@Z7LQcEy8%LqWWfE6AkVXruuWG-q83O`))PU+iF|Y)P$#+db zfCR&!(~J<#+a!@QPTf!FB@hF0Xq*z>7nsq3xV;AsKKnQvg9msXR^85amM>OP%PrPi{}e=W+n^12o4sAkzZEeXa2k zGU(TUNO6q50{*Kbl9E*ltcn6LT5?5hS1vt@L0OWXgjq(N!$h>hxX$-ElEoya=5%p> zVA!e1&1W>Blx*RwHsD+_7Ljp;@eOD#X;rlg$=>_dxgTkxYZ1Qx*e^AYw035J}WqkzI86{%C^l{M_;m zSWr3Zz*M-J1}gbzc?b&)i1unBXW?NKVpDXu}Ph6|r4Mlw@$3M#}K4mfPG3DSZ#!(g4Gy$_A7@5*B%B+B&$3!7Z-pK*V1)h!8mC?VDAuP368@g&W z2~_UlCNNqdkBC`vb9> zZM5CRopLb91NHI@9J}k{fDw-Nskwjna`4l%p9D(v!GuDtBszBKH z(y@tEGo?;yiUzoOEwITlg-rLLcBuCvad@kgDqVBaa9c<-fm_C;Ak3=DUJ3C?JXCFJ zxQ!>YFlCvxQ0b`M?k+?Oy|1}bXGJ23bG!Z=ON?Np6u$-uk6PR?=ugM5<}EQ+1Zdo; zyUVfQig%-LBk>IT2u!nLGOOZ?>G-ByIH()H+>CxNPnW22;CsfitThK(s*i6|epN`PyQ3XvYF zfWH2P*e9WrT86bG)Py$ zrKGWC;?$1R`fsv6KD8ERa}AS^onhNBENPb4QAnrymIpYObza~s`RO?)&C{QHSU=s5 zHa?&ENKT$OL&fCl$l>$k_$HlMsebgqW1opkjC`2r|64;kVtNRF?jd>`kdojrLY*{7 zca4cC7d2sHtc{7Q>*pSl5b#YP+CCXSx=!+w&A z5nb5C58>UJH0bB%Di{xWOnQ-fBJy=OTHozgV}!-8{y#;~CknU<&T2-noKULj12bdX zXLRIHzze(PzNr704gc1QNElEQkT?XX7c=Lg2}yAsk?*23xpGB>BE@p)EaNAJ0zzQo zA?#edOa77+BKkZq$q!#?jY&{I!xK>xLfju#2O2gPZKQ4_vB#PyxNq$qAq8`A771V7n-O1KB0v1Eq*Es} zRO#gch=iYrZnARAiuPRzpk(qoQONI*Dm-QVH8jMNCrZbJ0U_k|tF8p*0>3TNCIaCC zgv@L!hXkoeHAzKaFu{g+vP8Co`r*pn3YN;T8pO`i4&d!x=7mv3RA(7bIdDkO?iTQD z`5=aUxQNvUz_;G^pbJH|-nfevJ&?WUf2AvO$qa(7hJ2cT@rQefyk$oaQ%AwMIBP-% zN|c=`fJiR=q^5Eo<%4H1F{7^^c^pHNuET#pEPcJqZ_7s8)KhZR{RmxZ>1D1j|o-1>4 z>GX;+G(Z!)#VF{09$pNkc_StduBa&c5)cr*7lg|g@6)sl)|J9BYE#}L@`>Z&lEG=t zprj%p+i`!w;1)v=$mv2BGvFpl<@4!45yrv!sY{^dFWdo!AJc%>eZCFmD>g~LLYMR> zW54PjpIXO4XSwCeJLhi^PiH@#vF3eLU9jRd^}(~zL*gF{5sysE_FXIQ}ZEmmT~5M*p~ z5Uxq957sA{=TanrDw6nYUEOslc_BibCO!II$hfx@1lx6n4>5{)xA>xE0fD@837wa_ zn!YW)Csv{dAhQtqqAl)U^>{WPUNGR0VDK~CzzKk(I-t@UmU@o@ z??oZrCB-q^;|5NEni%*bs7n{*HQ>Dvkh+jx==n~76Mz!i#ZD4d6LWOs;sEv;1d|q5 K5UUX}4Ei6t(LbXA diff --git a/media/light_pings_proxy_bandwidth.png b/media/light_pings_proxy_bandwidth.png deleted file mode 100644 index 2f226bc0138d9b57577eec875dc23a1416c89ed8..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 34641 zcmeFY(|0A^8#Nl+HaoWMj+2hfj&0kvJGPzd9a|kI9ox2@e0hK0I2Y#+ICtlw#;CD& z)v8*xp7qSR<}-Js;x9==I6OEI5D-LZsh`RqAfQvS~jy_uzrDF}!MXid7gqN;35n75fBOp-IkkE3iQrzx$%5YmxAQaX|#5)zT0LHqPz z;Nd?=A_8DyNT`)iRWU%Noj|~E?C$rn+l9K@{p~a^PR$qfySyI!yxXlog*T65B;NW# zLHs`ZM9fyL&KEg>=MeTFVA;?q0pJe2Ma&jz=;+{o4|HoFb+~RAy`rDy;m{;q?M8T#wX{RD}-(*(I2>G>aL08~n^U z*yQI2s_5f%4C+Jeg2JBmK0oF9s+Uh>Mfw6l9Sa6x{<36-4=t>Rkdiyo!%0MqotX~e zGWlh_#`5-2W9VXx<1QV!wPX0h3S^rpJNx`vxXl#I!R2UwKmUAxznlPMkPjsHwNNxj z)c;KsK2U`1%b@40`bCHwC4oDkml?bjAqXj+cnkj}MlsQ1I~$ya6gRCuGAij6wgz5+ zMvNkv-I_#TV z{o8HSImm!>F%?er2Yi9&;l+nD0^D2=AD}cRp-LoHdImF}v)Z(mwY63=h*#e%a6Z0Byt!Xi6+pv^yPsid`0JZ=*Zc%yqt#OL6 z!AM>Ytsf!BZ!Q`xalQvzJT4VM{FmW;95)`M)!`O3ei({&%#G-p`&^!Tz_zB(mawf21P3_W5kced^hb;sV<$QyapLR|h2 z7v{tsMEd-NyxM}7yf@rDf%oQtUE#*4h#vNd*f7eGFp=<5`%>wnP1I@?oED8I#V3w2 z5^`Pi>(!4(=qq^3M?8PI7g}f5P5Ie;e!P!?fd+|-lJ|EM-W$p60?}|rO)AJvBw5)S z-)`^W8lxz&HyFi*y-8$CGyyU-5?vBS+D*DuntTdWDo<&ft{+mt5Cb+vPJ2+vBc;<5 z`Wf*$a#~Z`lY08~pN4lUZYy>heoH$usGt{MR_V@+Z{?UvmMx%9obguE1a&{IsEK3h z(({sgd;<_yX=iBvBJE+s1U&}IW>~gbh5Y<+r3SP{P*R=6VA)@iHjcF49_iaf+H<$B zrRY>3=vhcsP4^Kh*>`ia($co{l9u?)nV3lFnAJM=o?4;gk!b_-ocEM`O23nY&xD7M zMvK~$wM)@wil*t&MpehvJW#v1?`AvDh$N$^U>EGSSiK4x%fyh^l`40Hy^aGS?Mh8 z2@ZX@IHmZDcz-XBdpy2G9$Z#ePi?a>Gc#+q{mHo&d1tk&#v^pBpe;VXnHTErzx5v1 zmOIW*$~);*;+$c5@eX)wL&H!A&8#ZoU&Us1_XI#Xquk63J8QeHG$B3_f3Ad0cKcZCTb>xyxk^-oT%F5>p zh7KI*J}O;GdJ3AZzOwE?{W1s5v9K{TRYau};%53G)J$DX-^p7@c}wcTI4>a(Q5!H7 zdcWL?ALz(<9wk36C25YczB3+T-rcd5o$7;}T9Y}D zBb)ZdcD47h^Bxv--XB30ZnS`Qsa*JPvN7^@Dk^ELm{#r~6}p|H5P6h{aRIncvdCv_ ziYJ99$R+qvl~2>S(k%{1ZHeu?SSmVr9F6;&dK^LS_}AW*TmH!W^54c)5SBdgQVrcVGR1|I*TI z-!qBWLzfe;%j`Y<1^T!%DYHbkxW)iBzDpPOkN zgb0Btq~~WZ>TQJZPX;5{c*JQ?CSrS}JlrkN9t?k6nji$RN7Mv#Zd7(uGT1s4Ai5HI zD2hCqEZP?7rl7fJZSX$WsBMx#v3~KLiJ1x0U)R6TH1{<6DyvG2Dxpf~%Gh&Kvz_^X z(hpJWUkaiIVX6iEqxo9%EUGS0fNm^(Vch787-bg4GF)W=j+w`GTQMu26JRqXBz zJ;=h#ppO;N4pe?viJg+;v1QU}hx59$i+Yj0-a=J|4NJrg7f}8w)og;j1DDmOs~V?S z3n%cj1ffYHuW+H$s^CAcBiaq#8=Rw5E#x`GC*1^OSs9P*{f`oZ++80W;wl=TEMLkiO>oh9R4 z4NA3cHDhH%ooSuU5Rj{sy{+XKINHMIN-tP@5qHUQfq7X*7$C4kwAyPMPY|!viI$<5 z=aeVycekWF? zS)b}dI*fFUawOrauvJ7_LQ9H5bV1TqvP(8uWL#uTu1vl~n0QQhbmp(cSnEj2bah|n zP||cIG>yTy+4QgBO?T34u?*wXrqDCW7Q}cMrl2PV19<<;fU^8{l&qP8>lmqIi?EEk z)-;IlA97AgRzF|=$hFv1>E`%Uh}Igd4zL+`vgPd`oDb8E_bg_*ZpQdms@#f-uOt$sIBM3q_tls!?{clQ3B# zP2VY;s)<4NMBgAz`ZE3v09j7cdLIzKD0Z3w99mi zSyN|YEr}1WBeu4jqjSWX=Iu}BO{4MJDk!#@Mb*$e$M5J3@?w-@IbEROVp z!cc;lSd+CHi4$rqkZl04jpG67gC`O+Bm9$;h}7+R@Os8W-ecer@Rf#gjnYi?AuRRnKB zSfW|LVsczeZS3Zsz?cH)*Pc5z23G8bN1^^R5-O9{)L zp27zer^W!g2mM&=%&TUgON49NeenY#qAsFw>{yH=<<{i$1R=vM!ZrN+L{n%Szo z;3ax)VyrgzfOW(<@CZ+M7k}lN^{B|7b57@pb+2n2fe7v0z{|_S`CRE;XjA&i!Ya{ zE^#|}t&j5@i_6+)aXX+b|Kv2ZH06%scD(3h=CSZ|#}On<$kT>yYUP=3=tfHql94bCvJsJ^!C#=k^Fc`sDo`%PE}DJ^FZ z5P0Ws8%frb7vEpUaRbgHPGMhjqz!PzXEBJkR(2X9WMkQnw4l!pj{T9UI&Mrelv&IecCAFZY%!jU@{H{5vZW zv3P2eL#aa>0Bh`)I07DJEs#BX6d17YyMsZTz$eLQY2o0eCMO@7KKoY%!ILpQ)f^h8 zHFrI)x}LDGuyP%Tan(XtTE0gw(W_{ik7_q_@^!%Euhr^M5Jo~rCyRijq34QuyJp|> zaa80F%k?&1kQGbZoXq1U^XXypx5taWj|sduqJDmY?j^l$ z{)u1rWkQbbd&9A}bGf1JzhNx1MSAf;ix#|kw1&&Qep6j-Ub~kksXylfE~b%#6H#STY#!&17LA+}>)o zRB0Pm3)cl$VM?Pms#U2!`+t2r>6Xd;>Bl5~ZS<=d`*0<#RBWy59d)7|pmV6RwA$KRo!X z1*qZV;CN`B`$diurq`?r@!JXlnaggyRhFp>LqSyVent$&($do5Y%g9YZh|>8BMdfJ zyJjy6b~nd;lZJ+-FBv&t?xY!dhBVd?<@!4qYPcwe%Pvt-z|Wd3=Uo2DXR_ZcD%_-i zpyVN)lsT-Jrk^BCW^qX_%GG>`_qtU1`hA=kMAP#q7e7CH_%0DSO=a^u3q5ZKv#_va zSU14uIgQbXUh;OLB7mj-H#k<482=6OnRZue??R!^=c11?h2$Us;e|#VT>kzD)PaGy zU!~Wj>!}Gu;=Eq><#FB{u1gmyP0&LG#6bmMDuhszE+FJM5S7B;VT-w)q2n6XJ1z7j zr~T*8A6{{KaH7sq`X!SFt9|-Wg%;=;ES|}n?mE=I}lyz`=mo5Ws*G`XBFUIKV_NihfTnq_3Z_pKR#peDuSFs?m%iO`jHK>MOY13iiM|v2V z5INjpU%d4(8v{M-4@ecM1`v_8Y(^64zZ4-(#^F=X?*9;xxMMSDhm=iJrM7iFj@D-w zw2hxb!piOP63Q^%k3le9Vqs$L6wOI)m&w5=w;o!dl!JjnKb_Z%{Dle>CJ|;cW(!GH z5d6afRbOTiR2~)cEau~P_?MoJOh(r`2PpJjXTd>%efVhHLut7(uOXBf;jvBh97V^(>47OQ%NsNJ**sKD6&9T+NknhORl9 zjlYV8B}nKyZ$Cg&pdbE34ah1sp4z8fffBI+q}D77%)VP;8mw87TEoF!Bq4+$4O9Yx z=6>=bfrs;4E7A2<d2H8qTvl4rqi>RIBZDDn1BG_vaDs(%NE8(nX9~rm8THzIo;KVC z(ThbS#KpTF7Im=oT$H4xN52!A&lJxQ3M&)SG~auJ@kn7&QH%Z7W|z17RR_nz%QpnY z5eckTsFY<&uz?^WkruJ7XtEIK8-)jUiM5U|$uxN4oQ=Z1SC>j5%y)P7bQ>|ktc{B*uDS0Dxr z%E!m|mZI_tm)&9}%f1`7#@y62afv*h|8`D6Xfm58nH~1=`)eu3d=nV~Dk^B(^y__( z&zGZQ4tJ&U*=`DeLyrvpVI^cm;v?(`+-X_SmLS8ttZU&J#S-)6{3c2XrWJ8sY?35h z+-q8N8dj;m07m#KCVq{>PJbv!$-^M+KWQ16#;uRnv$_}0y;!bqn)dWhmPtJ9;j-t; zuUtK7XkBp-8yPbn%>)`_kBd@Gf>952U1q>8`1e` z5Fls1k+6JtcdpgZI9}&{u#zMf4dJr;s{3tF5}%^eI5ZJi;b&_q9rs>+jJ4LKjB%PZ zj#}(e?7uNt$${Qk`JE^&1Ne2Bs^Fp%okzgrRbXzH)Fdh(R$37<;R^}QYzH16*1l>wrG_h_htvV8&nD;05pD4cB?gsQr-&gazg2gL}I zq@@2cx1E~qIu+8065(V4UdKF*OhG#0OTD>O! zAW80dI$G2`G}IV)=&g=A5|E((tGv3wS1szHBKOxW*o@li-MopM$s z8vt*VJ4gre;9v&6^ux&4JI8>;6U}2(B z@sFd3j5ci4Xivw)e)JPPfYl7mW&13@Gz0=?s{$A_6dJUrZVxx=a2+*I`zuXt7XL9Xnh<#>~|$PeK;1U3Rh zwSugxwYA7y*r3MCldX}lafjzWQ>2ot@aI&%3m#~~NQ?Q)DAOgih_PJ^?9qr@C?~2H zisB62e-OqkSYB9|Sm%OKjR!%5l`JZB9sLm^v-gvITKOzPjpb2;-oaigxM@L#99%K` znqD3;S}nO1Tf3zIJ05>m(V1{;gkA1w14N&|Dna?Gbv{KRcClI7XM3cxK|HiY@fS^# z2|;U}9SEIS5)uW3#V-u#TujNg5j7QId)t;wnBPuo0&Jj_m~w*_(F8C>wgZLQJM@2} zC7`Bd$mw{Makh3N(`q)ADig&v@Js9}M$Ev5xRj^UwHMbUwJC}ZB`>}zw&Rs;^k@fw zcu}+v!bR~D0rBC+cIbjWx(BX}2Ga6=LClYQ2%f7fVp8LBm~ewtn&Nt=?`b6#DRm{ zmBtmB>xBnvapj$2p8jranR9q9yolMho)H2I?>8JIl_kGVfT4opW!3fN^``wcT+_e^Wq88V_k4j3E4HBf2JG}oM~rE; zSBKAn6Cx!%u(kezt<;VjKKI5rVNJ|jQ-~Mro@YpBVC$|Xy>}lZ_I1-Y*R;q zaZ^T{tcQ6w$(M`L(5NXdP^__2E}Yip*U?<2|6EC9SZYk+l{GR44#M;RAs{#K(#$eBH=4B6%vA_~Mo zujGCWGy{4++5Ot>Bdy<>kn zr$sAM#YtId_G;|i^Y-%7a=C$Fj`n*iKb%&#dXpRu_5f3o>$Ymy^SV&?Q$nc5b-Z>f z!Uwh(ZgZ%&8}!BRTUlFcu{ZCzqmWG_$tOqOob1BH#^FIRz}SQ&U<&0<>>6Kj@To`g zWTyG6=&R4@*|T3OnUT4R{-O$Rby;eP7;2fz;A(5Pc6k+WkZZ$SUs?{y)+vTqoWSU+ zVYGJibbji(|99o}=I*>=0~Qz%um~xDBonI6-e3eOjB8?TyT08Q{B<2JbpOqT>gJ zM<_ge4b=Dbi4rVGi+UyDT-#CF@+F48zlvqhU$^L4jfB*^xZma|BRQPc?Lp2d;I_4% zY$YZfu#CvjX{!6IL=E3w6C2hqklYjZ3{1Ik-XTryB^@ zOsP`sj+21l!Ia=UKf(F7vkOPZ6(kM{nbaH*97csar?ko!Mvj*H`hm+Ff9uWalJgW& z9g6FP8oHshUm#*?njq{gx5;`9|Gm?o%;j$gy#ab!ys8}k70{d$3u*#9M3{85fvE(1 zA!Dk8%x^geWWnyuES#D>)7Ep`0j~=W7F8BNR0{5qhK03uzo5d~U96f;4ItB%gMJ)2 z;Uq^;qqVkwoD>hYHw?%vbqF$pXivWXSb54k`)3+luQCCB#3d1repk;OFGxi!u`iyUH4^neqYkaGmFQljHniU2NYyuU$xgs}aal!O$ZbD&jL> zx^hrZggXBwRTtd*EH>*8!3Oh@_auDgyz^-&W6|}zY&&u?>v$kUjNjSG-$neHfh3Fo zjwc6Jk}dU^C=Cb*0w-h!qtU`&tbV!8$N(#O5CvzsxwGq;b;e}SQCG%%JI2Z)E%b>^4NAd0HYWfMY zs3tcMB^xY6gV80_H9gTCg0jzxq%LD5`cR>Z?2fSM&Sph-l{}o!)l>{ub@k?R8*S`& zxoAb^GH_!p&FIXn8Jv^I6em*))a8q%W|u?@Dt}gYTg6O^Wp^TLxUC*wK~WGBMw9gg z;{b+&Gzo634bHPa?C;Pi2DfnQBt4RdEr|et*^LO=CY&u(fKaZ{DPqt8_J&K9dUDui z5@EL(RMgV4bEe$9Fuy;VC}h_PeRUe|^uINAJJ;XCB!xQ7DmXfvaV+VQgMrWZm05!Q zCykAe_HM#tn%C^qJEf{ae9S2TV}&ar8D_0Q&4;{Z1RVuFksdlK6_=1~y6MQf!=4=-&p<}7UAf0`P{||gn}s0 zZsyO9iOiW_gvCM{ikbiGh{Q2b!U?q4dH;P?qMAH*JAcp@93Ygp^0%*l{>MDZb#5NM z6-Bk4=Xz7*9|#E>eU@wsz-Ol;YWV`(UjD9#Ft?xxgO0DUNYU#O(&kJI#e(I^sdWXV z>e-@o4QxPxmZ1u5u&@b9ZxphUjd;(EN>wa%WyutGtAtcIohEmopT#P>0u5)}87{6u zdncA^nYiw{2(87D7H9!~%!~E6d^yhoCJMOycj9LP@cfCfpsYiR_gkl4c+Yy#CJR5* zneZ5Zy1%}_lMXjDq$L|LsN_gM@>5Y+= zlp^*3Q!}E5U6LrHB+^a&2yKtC)-JqM{2S#uHekbRyT=S&N!41zawrT0bZF?p8GLbw z%Vy`oS}h7rS>BfI=4&O~ec`O|UK~;!ldo=GJgD+gg`RYjmnKuXxE4jYDRC**J(m6B z{HFxoLX-@h1`Ld1Cg(ULQaIpO^)KDN=mElDY@14{DvLRXaN|BKH;rpIG>_<~Sl*jN znIVqJhC7@33ZTi+ZrM>YVz_s(7#Rg$i_LQ5+#cvb z7k9UUZgeXZr{PFl!`kirwxF}EtuPw(3NK~t&{+1^N{7W+^^LQ;sw(eQP1_zcGLhh6 zZCOi7dZEcxn3gfr(+Qi$Vl;6(_@TfmnO)yv6gLNBRixq)j4(a7JjahKmo=|9Abdv>2{6*U|5I={XSD$SL(3g6gjxwv(-ZF)?Qd*49!m!PMWj8nseX@qg zEN;3>kInnG{QBdt`8g_GbJcjT%-2%Bh1iAIGu zSJ0IAawpuLXt}NN*~g_lceBjf9SiMSsdT^AbG}raVrpV=tudL~)$*ked0ht>)_`ax zb?kKSq-{O7!5_vEH+fhGhNZx8u1KyE(qSP0m7VW#@9r1D0IoO9u!DbAuewWg#>ds` z?{h~jWhPs#cXg=$i1QhAj(>!_#>{GaZZ2Z(ZB!r-#gEa%BT~#OPeRAH+4otWtq!J9 z9e(OGKGlG#;>rmxs$Isd*=#5V`&wRpt@`KG|NUl!Ytw_A z>f^gOIeOyq`Mej;A=?;M@bu0kRuYS6(_jRt^ePvO{I7uc>9^P5!GYb!Q(>9v7$l+5 zLR?A96F$dYTJwDj2YOy6v&lpdgUm(ttXr=Q2kpk6&5u1;73}WDFNa7%Wrnv1o#qqZ zZ}g-&)<$4m&u;2y7bW9|_*a#LN`4B@lKyf*r{T?!E{ASKv1ilga+z&kkbygH2k;E9 zjLkL$k0XEJUk(MW`vpZ;n60e-?u4$8;o5$&Z0=vR!VumgCIg{^LU4r|6^1ws8+f;Y zy}K}%xG=mr+)A_Jbs#C%(?f+A77-4wm&4KWCfA(>T+ZEw9!V8OsE~G9Pm(~Dbf15wgXV2>&{ST- z)erVn%Bl%bO*hBmOg-Z- ztTwv_5=>GBY&5qXG2gOXiBqzxH#?7)z}Ia39s79!CU56`8^&r^JZxp%w_{Nga|?67 zIM}>j0T-#f9Im71jO2nVp0=+xN6j2Odo^WT4lj$LD)C%o7cX0IsV-goAAu^$WelgR z`3#3S#m&`Ul4QGM^w75hjUvS#x|)m3($(@dH)#iFN#R23>SH)nEiT9P4;MhP+7C(v z#0O?KpKqZui_5-t*Yl-Q{41Ts#SNx7M{}zy2+SS6O=HZo7F3j^upBGKLdOkyPm?ml zVwEf#tkiO>W6^!xQAPZcOH=AaNsfvh(EySPtVZu=7MuQl^pT;_*A2g$GZo5!kWluyob zj0zl{n$3_~fDMR}XEr-&WmDqVTN2Z2tc#nts@>@fR{QmOR84-;_Sxv%7g>Kbn}*%Q zy@+3_nnKaPd0U<$h%k?eOHdkNJ*SVi%byudE~b8ISb0=6K9z_~o4A&DvI~B?4fC^l zFRMt;<#yr;v?!;qSHDwsdgoJ@8ut{thSMT_?y}{~&x#hDt%#+nq=wf>#TDUyJ@tIO z_@sP?exy)M=#CLVP3U3YCZILyXRInASU+<}ql&z1q7Q$!RZ)l}NNoRXQS64QtZ^lN zrR&nx<0cl?olHtc}2VZFGBn^oT9Nbx;wblk{?a%@|5iNp0;cVK?47K$p6jJe`12k!DioTG?lMLWEp5 z-3kfap?ib9H0a6KVz2-7uURQL_tb#DDM}erM}f&w{xMACW{85tYHj!n%bgd%&47O< z`fGS_xj!i*$(PuEdEu?v%sxp*4tIlaiYGsgi=_2L_o&JJbG__&C;Q`G8=>X6PoI$z ziU8@I`jJxYdXm@mB6vgFcR@n_`G$F9fP$m{!iLB% zvb@=WPAAy;hvX0q0`V*65=12jSfW`KB#e9`nL}C0Nmy+)(<$1Zyb)|9WQN+j*db-$QpQUX_J_ikl%v%bJ; zH=wE2dHQoS7z!mdS>{-WfIEd8+>WRuO6Z{wmQ zzKZp3S=)DS+&CP;`(601c8RKLbWR0VoNl?nXceJsq+WBR35vR`L|~6oK)`XhJ>~xV z!a3<**g7!ZhbVoWzGL|D{eb;|!0Bq2U#$oaxZf^cA^jduPrKP2HOd}^`c(~ww)y3s93oCg}Y;|UfXS4(i}6>RxhC2;*rNUOd2B@lbfq7Pkrx<3GUu@eTm9S z=KV!gR?0B?qXXe7Sh^9rf;o633PPzZK33o6|Mzl)lQR zN6j|PBWLeL_CcCk_8#q2qadO?pK)O5<+e zbc}4-zqE0K6j5uZv3T^Jf1KPzk)=tAi48_WQSrfwq6A>SG2~*@- z$dcrG=X%#mxLWk0?L%-cBQD_?r}J~Qyi(t0u(;#ML0#0X6LMPlbI4#+xR!E4mI}&7 zyKhju$YNoM@osL%-!?ZN`#hfKNBXg~4kiPDg}FiliThRG0K%DT+M#lzv!z_R2J7wC zxsGHhRUTBx+hxxZZNbxFcq*Z&zKZ|W12UI^d(GF~C7f66cN*M17u4tCY0pM2sH9Vw zyr?7(f7XkDaz9qYcjsveQeHg{`AM9{!#&9PsuvE~K&z(cfVS|{L8IkdIo$I(QPsw% zkjU(byfvO=`|uA~e%lB#ywl>q9%`Ba!XJx~Z zV1v)kwNZSDTGQQ-9!AarU-S5+%ICdXYA@g0h?Mz>_FXN1c(eWm4zTatpxdy>)U-XK z1>?b-i{_F86qi8yszlh!i|x4@k{xPLg3fyVf#s0t-1q4QtVtp_J73WaXxJs~{5HB& z4ZW4)wDd_uuy?M9C}rrYILU3r<949RI*R|Ha;?;=Wa24xs>njQp)P$^-_mEu>#J?h z!U55S_wm9)C~WH6#T(M2>XbsW#f>j?hdErH1uvza06B^!8_Lg~VE27h+1k+XH4KdU zfK+jnG$b66xYKv3g(x@$wA_+QZQ;25%*;w0h<>8Lh(c{|A#D#y7((r$k{}1wOax#PNqnS@FM*QmP@RiWLGK z-ZF#_&`^E#wm&GW(uaQoP7%3@-)mD8*;^G#^XdZr<@C(q2x^{m6 zlbwcCL!JgCIasZ%tbU_JAV84CT8WqKotCb!R@$z&-aOh@pRh7MFg^A9dI<4V z3X7Ky#MySaa9p(4?5te-^_JczMhF+nKL(lpEIELC>-|}Hf3fQ7<@XuRpv`R6qh3M! z`;)q&AJ`-4YqF9w&F8Yb)#iL;_niT+Hb3T76jIy6Jul>L5W!HtyHR3@mrAZa)M{SM zIBuQhq(mgTm9Eg9p`NHnqg9;5Vt94C$n2%`IDf1+o5TYO{%7&j%ozUDYPGZU!p$h;~>!;c0(+ zAJcJ#qDP4!9ledNs>kR-`uAoQe9>t9658f+Xv$-&W5e#d#o|$Qy}=k7f5wHuow+XJ zxPK7Q3sElYA*?r>$9dV2`&&5ljhN!Q;y1Q{J4}wC{??sLqnRK&9s;^FsxLJB;uOA$ z-EX&JlphRJyp~YIydTQu%-` zuUGzG<4li2b ztSmGy65mu+y^@;0s$x;T$uxcP>nwf#=#0}A*fuYV^x(af5K_-HG%VwNZP@92*H)vg zol2{*vhvw!1Qq0txa=QsN6;1TVsh8y1oe4&R@YMk)% zm4do0D;FGSazJqK?Vq;5CI$**6%fH3BuNUdkR@9I+OWnk7+_^Y<%|6FG?#52#z2?0 z>f7fZQU-45!W-2SL!+H5Y}^|bGS#rzE!VU0cFHp+?t`o>prezwi32N=Px*xA? zBu8aoj-n37-S)`pIjDxAGc>Zxd;cShNr9 zbN9a}Q#K=QGPCCEEDEe;_WB&%r>E*h!_qb_7b+A6yAiY-0M>v6NQU#SgJ514k0P}y zdB%rgu?>|n4=7res4)>*AtI}GFH=^v-W5+Q<$(p*X>}z~r}G0hqTd568&CT_?v=Vy65r zhp<5!4WW+iR($ihKw&xR98`=ysK)WnQAmGLB#ezjz4ve~{@~g7Yk-!_l(_>ri8uxx*m?O^ngX(`REHWF|;{R0a z<=H2NvHUGhiK`PVU;5Y{>Jd-+onof?9A(b`3FaHYzSy`v9&}{;mz|B-{A2IM`mOQ7 zZ&SzlO8!rK0(w|!i6GnFVW5`mmG|x1T)RE)+l?n~yz7g}#_V8VStXX$M#uCd9-n8J z3dN+fx9!-%B3Wr?4c%o9w+$(@Nn94!RbpfpdST1z?&sO6QC;URg5XAsZfA8#=toSmk?d-5Z` zxc`941kTcFpAa*hPUz(wCT~})=KKHFIROTrx9PXZ?MoLe;hbV_&Hg+{bTA;pk9fU- zHZ-1Ap4xRM_T6&bkXesq45}215RPg-t#WS3v+XP4M`e5?zRbQe35-_W zH|L1xJm!9WW{)LXoenxOJ+f?YT-ZV%Ybh1bSS5TNSANdD5h6Kn2L>M7RiP^8RkLh! zjHel2J9PfMtQKKb2$9nn*$qDgieADX2b8@46WrY0dq?T_c#CF-Xh+T$`Z?UxCrO3b zlPXbkyOf{aMpW^gufvPDQr}!92+D=*&FpI`T(HV5X>3g>TpeT1Pp~j)1qH9( zv-u9{LN@p#t8gC8@neID=-$4z*Gk9>+zA$5c6XkhxTiJFGImuyBvcB?Cm%t+k50+FKm4xrWngdWTYmtC{H5#v zSEJe1J4&J4qTvu88gyy(T4nt|%$;RZTwS!Sk;WZ@6WrY)xLf1y?gV#&ySuvwcemid zEjR>%2Mr!1z}>u6x9Z+Hf8g+y?!C6Go_no1$9U$^!52lkHFlemE}O|_>3hfer-E#5 z*V%zx@_6z_MFl@^f!nU*A?{ucGxmwYf74R|1{)ljcLASYk&p`XUVer#6?jx-t^KIC zuV1XJ1Y3IIUyaYat+WE!Yp8^tlhlu=oNPR)MNSwCJ8~3Ky~P>RdIK~c!$(Bh$ZLH6 z1eZ@oKi#hBoe*FjJVb~eL(7X7VV2Q;G44v2u1OYoimWu7xXJ zP&Lw*`OvEwR*1u%yvM-}=T>~ba1=Ijiw!*j*mueUTw;s`tVtI{9#ezj^_3gl4L$Jj z4g{1R^6tEVn<|i1GNJUeSF6{4Xp7q*{r7aG-hQKPuvS~^0sSPFAho|U1IF2pTJZ6@ zltvB7rJ1L%+jwlX5lx@_k}b#7HP@NDvf5n;o0+=2`i|y4JFK!E1#iP_2Q;bA`ZoS$ z#u_Ffe??Pj#JH4ChGLM~_X&%0!Qsg3g|YCQe{r22Bupj!Oz zj;nm{k5-sJl5FWDsFx7&S{&^gvD?C&Mv6qpoD{y88Ou*~am0QL})-Sb0fXgKoWpiJTkVO>k8hXGA}pG=6qZyTDg_L{#dZ; zeL2mcW|aN1-~Rm5Pe#$CSzq)5js6(d;?AYGI67v${T1h+ohVaNUq89|<>qe&GCo)7 z&Dtr`A9f$+N2dWSZ`^HaXnP^+@S2P?y?b}82AZ4CdvEC@fH|6gf7 z#ULv~+{1)F=aRqpyimd-%XGb6y{uYHW7tIT+F~7ks>d9C!!dGMT6z=w^Y6^8POq4V zqh#@qZKTOhI2MgJdiQB3UOAx+uZiwI$gz%F3pBH)gh3eO`Q~<^EP)O3_*x~})J}ou zzuiaNxV(q$U7rPnk5{g$j5nTHIL_@3Lw>5WrA(HW+Y|72owmO@j(zTWyMSWlvbc^d z8zSy)n|%68Q?Is{uf!+7Q~tg05#KTX5C88bBi$;SAH+Q66^%dC>b<;8W9;jZvsvBq zZ_tD))5o{y)Nswe#%tlfk^k^c$XmZUGC%M&(Ktk*`0_pA;dYfQMb8{(L!&ykvp0UW zT2VAgy9zs%RG)uCtW~UooV4VAcVVlCRybfU5&X@)@>y<)2K6pcd}&ryGUI8y?839M zy%AJn@Z%-q@AG$_gca05>=8LVG=fMuy|4CLlsE#Q;%=i;eRd8T3Ay#fCi(Bvdag$z zhZOq!0k`{&FYECd^q(F(t_8TrkLe~U=(x;u{{9Z_UMRnlJ3i|7|J8P5_~Us$^yr7M z4S%6@%=km;lsw@EzmQ#?yVj=jA^cG&Dx2oi{LQk`+2p6uzl;SbY>buXw4QT|vAOy4 zwqPBBSGT_t)idh4s#e`+h^`uv}RUx6)&2hx;rGAI91NdE&Y@`=W{8YU!d~qTU*CUPK&S7f28}&@B{5kx3>3< zaNjiNY!C@@l->)*`f;^`Enrf4|6NG3GWG6L4=T)2#nX z1SrT{@=ktyb}&@=>|2Z)C4E0I#HOIv?x}>|Tug8Gn3d3R@#P+D=-_}*9upd^ALX5R zvxkK#*p#N-cimKWB(*2}r>>uKR#U-rZqMR_T0T=Q8ryZNEnrLXyM}XGw zYi?b^N@ykKvNZdu*d53|cRiOF>A%gR=Fp$sJe6Jy~r{4jOPpWI*AIqqG3hRm6b!K$?~>1iu!-(nSHYK)cY zQyBz$nn}wozSRytPE;osa^1!|Rbg|IQkdv1itrDSV-@Ds)UXP_e7M`>7!P57-EEp| zHZ|R%b+3(eiS?{tL&c`uC;)$SsmuTyAQ8nEfaQvpYcASeLz+!<3a8TXQRl2Av%+i% ze_3mzY&0V{pu?+x$O~*uR2w3s4iMmbZ7nnf!eS6YVuXlZ=AZlv?9Y7fE}5(fdbi8+ zjmtDs_h2IkPL(x$QSJT(8rar@%hJ0HEwUjkHhVr@owt+@4%wS0L;7LO+h929mMuLo zN~TpU@tR>3nNSqEBiRUFH=BrK#;!{XEd>{I(shgzsyOVhgn-$#M9Y;v3T;}?gPB&o zee)c%*q9Z#DFpW_pFBkj&2Jagc~qFt6z_K}tsXGnrBAj7aTzC`Wf-*?c0Vl&cJmju zw0*WwfXDVpV-R*Oo;~40QZ>Fw_7Ya!Q)7ab5`8m%*=Glkn>a;IyqOKW1jR*A*%X3U>;Qqws-1mV~vUF&qNa1UiA36PWEhdQH85xdz``HlHrRzWN@XKf-qJeu?+RuG?EZ8f`E6Hg8J0*Dbboj= zXD7vZu0vf)+UrZTJ$#j>7VdsK=w5Uv>od!4n`v)Rx3Hu(_g#LSWLfW)%V}Jt&-+`$i0M8q=7(DM1E#WAG`+>LO?X~EyXG>*zwvWk?=V5gD$)TUmp94W z9g9GzI<0%jh#`tyg~DG5rE9Es+j;UC8G*d?H`<`}hadBQyxV`Y*)uh8bl7}|yEDk} zSt@(IP`%lFLw|T=o?wK8m-_YAvyl}k@%H@&H|YaH^2Z#e#;#O--dmfOr@IgG6UHQn zSXFU&`7pEl`{wrFBV)0-X#4ZJ&#BOg{z7_JwvnUvwid=1WkPO4~j>)P$Ad|7L)}3U{}|jhh2<{O0T_ z-@l3AmJO6{2e#;XmoJQYxmue)T&nq&PCFmi>$H7d6MlPC0v+z$pRJ|fX8y!YnryGK z>H4De&vP5dD1P!=Gdn9z%zSVaI~`KUZkQfyL=#$VwL6+Mb2!sbU;I6m^t&fS!PPYf zn>e1rVrN48bQN^^8J>t};$#-^#y08+9e)FCKJ|T1^n@Su~zQM04mhG3$3E3fko=9-X&uUx>DTuDSaaf);!qi9td79Y{pv!wqQR zFy+L)0>Z}zD{i4P%YJ4!U&1ZGw(GeW@B4`+yc>Q$CpA?9+o59z7Pa}8iD+TzKcMn# zm-o{6ojAl>Q1ux&V2_>XQt+jD8NxBF4cGU~%z~WP#WSZD#tj6qG;y*Rc%wmO{NWxn zUicMqaC=F>ge4UaPo|Jqdit3(`OtC0{`Ngz@ZT+}dC#_{)Y_7o5~&DMpA_#E8ln&j zXcM#;cm}dLbK31Fcbb-2Pz*>DdrP=bsull22$^%f*y`o459O6jw6jPN8``d&%$;m^82H!{xVLM$LGwcOF(Gn z@$d_hVjBB15?UEQIsX`SjA5rn4^IVvJSK z$Y1&l z_MmOMyasC5J$}y~<61%x|Aw<=8F%GWKVW~I#OVu0CzmTwCX6)jyIT^f)I9lZVqz?S z62Pet2hl@HQ2miaI|RZfV$XR^J}A5)}0Q5*$n_c&)%Yh)mE65(fiUn!i>_HF6`S zln{ohVZLCFBHAM*B%D=N31WCfj0j%#Lz~m++(0QO13QoTrzE<3Ub*T?oMkBNph-9E zhe4Y)5=drJynj>%h>P-;?3Y-SWbgtAf%76w=u#8{(%0(g9S|{4U^fDY*w|Pn;3@A8 zDb4H+%8|~8$tI1IPLd7tS-iW7>O*81|1A10i$TFX$@$r+a5538Bh4<{HyF$zpiAdS z_e-B({=Vi+yd`8_x(+OxMo5}J^Rn6DB`6U1a$y>nLM^kmr+~wbT@}U?#up}@RI6sB zt%65_w$$aA4%0A+iJMGCN2asRnHtT6Ir;Ii7=K4;+a7SqeV`kZ(fp=fk+Ld#d^{xj zE}`D(6 z{=S67E?xVvFdRxH0PbFT3guKR`WcvBDoVBWD}1DWkoz4Fi#53xv4dS+(4(wY5UZ~J9%)^Lx(>RoN8f;1=fHv%|7{W^0|}>AO!dmjD0Oy6O;z>vq6_SNCnQP z%UFfV1f>GMpp#?C7nqC-k-zfvif7(#eeCtr8w%{pdmFOo+l$Dl$H(Cxpa~ZmaT5O8 zwGi|5j^p#oI8A|5B=H|?#}D=CJ;pArZ^P0=jl-fb)+TsFw3zigb+L9o12`M6k#vkO z8aP-#$$mcpY!*H~d_wXDVr7^&g9w@&i^Y>PUp>m8wEwUq&VqVFG}23Wj`h|J9y0=u zz!G&H$!Vo$1N2~`fIr4Ub}EvH?(Q-7QcP}fwBchdvby!DYIOnKEs~GA{*}TYE}0HtbJVp5A|h}2WV)U7cwuB2hm`9+Da*H;!&0ev3-|tcA1i07n3c z69~f>Q&`5bjclT)%ZN(C`$3wpS*>==>-zi%aRZau`XDwlmVkMQy@Qd1T&qS~)U4_( z%9c1(K8Y$5y}EBVim_cLni^b^T9B>xcuW?P0IGhP2&SSQZw^JKU!{}I>9j+y zz=15%U8jWV<*eh)%z!;R+}N9fzg@Ck(8dh4ul6#knrPqj5yKhh@7dF^JfOLM0lW(TM}1sOaF&pNw2!PswzodQJ3}|2&bfNr?Fa zi!JQ}=bF-Fao>mxG~*HPn5{ zzhT2vh(7q8i6zXjv!(Pmr82{##XZ#JtfGa55k!o?)Lso} zXbw!sX#jw%Vux`~E$h@RyfzjB!g|cUDvF+2^4VmW)3s5WZnW;FVl)5 z|IE4T{D=W=#DeXiKWiLFhZrS6yG_)%mT6n~nw-4NYq#kS-q9`tnNCuYb67h%szWK)$}mq<$^t^{2)Owp1qG}19qbn@LHNor zkg612v^fuOi;y24Hr(OOyP?SVK+#Og&_wO<=yT+f=DR4UO=aK=_92YvT?wzY=yH*v z)@pT)(3+o2h6aYZTk@k59)SO-TOybUsmq)K@18l(NZUt5NemI8Cb_Iwl9s!zHCElVn>sYpXG?V{im1VMIsRN!jw&DAg1hNWZ z9=oMxk@BhdY*dXwqfA*CFdWz3zd9QPQSzr2()g~il!}aZbS_lwR&~6VL*x#aU{7J0(pb-Osj zpSm9cnYVUFVvZ%u~sx6v0 zQUuqeM-6p(V?Y*)6_!>|4e}8C$KOuFkeiN!F3vrU7hqlp_@oj+BPS@*SX#a^ny$qU ziD722&A@j!_%_>!`InDkrO$L^w{ja2+;=)*5IT1=Y=GReMAC@MFzj~ z$Mp~xMI3kRHYy|&L(o-f@kDEJSWX#=zi@20SnKMscGPfHsgm$ZDnhgWp4whu%Sd#% z_TDO2WdAF2W=?(Yy)I7Y6+)4oR>;@@3ca4m6})z85Vv&DIEmcSmyRA_|3cf-r99Wj zxD;k}_3xy*-rOJ^6o|vcaY8EuGXNsSy&y%FfK7nT3&q`S_@l-8<^J=$o_jDW7e&R> z*F_jU9CnMa#{J?)6|ra+KVU&{8o3pmw|h`m6L5oyPedXrP6+o9HH9q=*&=c?>bG&T z;h@(I^VK*h2^_*oIyW+8-Ty!r!U1`pW0S-={EHLSl6tOlG!}xbQQFptz1DykPpXL0 z3+F)bgUEttH;5rs2)RRmLKc4m-UxLSg~rnYdTspx%sBmVtbtxC3b4zqsr}Gp&38K= zU%a3V7i49xmGMeX#xlI{sbMo=g$QU9`gKy2t7=z+@{q!UFYDIXWFCVMxr$<4_mG(M z;!tQordCHf`W+zxAF_;?hQe|&`%}`c=60*cMecXvj)2k9x9*$2W{$lM!++{}c2D-f z;h?U>ogDvtH73D{_mT-RJL{XiCJyMpYPz z9Gp1c-6&GYzUJ`id%8)w<}cZVPL8D`^VLIV=z~OR5i5wXDwcLIYSoHLG<+WYtR$v^ z&=tF3&+do~Cit9=)d3xezaIHQmbrK-I#~YE;!`Xh{;Ey>WtZwA!E-_;SD>UExt2C^ zaLBrOJ4bJQxuCp=g^6B;W-}9s%*0S8Uc4i0d`6^;Ei`j5?>}cqCPQr+;vMxE3lvn- zAJnko)`Fs5>Z0Ykl^BjJ(ubv`rDInDq7{~LO~x-UK0Ii_v&4$wzhp%t5r*;L2Q>?2 z?H{iXLdhtH;qaHT?ZcKEbrW%+i}dGd>5!r5hMr?rcFY{{Jl3i36xB-qnWrFP%vog> zjkv)d3hzMsaeR>am^8k-^6ixiD(ET|gY_jYNf(LB6^w?7nZM{%0dvjvD`*$roaXZ+ zwl-d4=#z<_ies2PB&aIwimlF<1Ft`|-~q0)#U#~$a>I5TkW&FvfFe$lIplSUO5Cb4 zkK35Wpe8HQ4ILAwmLJk{Cl?$PcqjxTj4>A!kS%v=&3L}wVGXqD*A(J1aG)@26EEEs zB)xC5yjt^D8Dyd(#AMpq0+F1ig3+fxDDj=$ORyrAxUBn~vAc_M;gG~rV?rtkVP67T zkYD1v4fLoS@LZTmYgb5Vi4dxGzoS${FLnX1CbjG_n>d6C0hh_J@Pn3UtgnSXy!-G~ z3Pbxov(}F3Z*8wn4+qF4L?P=NDAdfzhDrrOFL69u#;WS9Hg0dNh*EV-=x;3hTl>piyk+ zSlerz1~9%DoNs z8opMjVkCaWj;oIr*>R7Nnq8i`{Fo<^Wsfy=eWR)pXnbfr8-p!`CzYi*EC=_wB#0Qg z#p+`dyV7uuDwza7O}^L8xMZs47ghJ1FhPJbq^^*vNzm3}pCHBjI@c(TOO_di{L%xc zSG>2}K4mSAB(pA4hrL2q++Y@W&+p~)I1(SK;H0fZtegt4q!^2fK$wo$U$){g!w(0@r`{rWN%iKvBiJX-gqPaBR?#S zS_)W#TqI?=Jir9sUydKwFTI)@SSv#jrxic#LJaI_VhdA5*qUflb1Z~d3iV9U*B7q` zbyF#@Ivqb3TpM`)410;ZB3brvX$pD6P>=};goA3a9fMHF14-;_T8TSRXAQZHs1k=n#1Zy&I9aytx!=!_#X;x|KU?JgB zBtywak--~Mzp$9k^;dDyH0@fuXV#aFkxp}`W!#@jfme~@sB zitP%Qn$lBM9&}eGB{<>d03AiRU4wGekhV0Tc%y~?p!5%+nOQ*VnevFo>uYSXxHUH~ z{LeRjF_i^T4aup8mlwyHwf%dx9MO+xJ>J^m=ah0IbtLVn4oes$HJIu`-ElO&^vA$V z;8jID`q6WfY|`={owC9Z>tyJNF_G@jmI_xKVdP~O6D;}Fdf9l0G0bHJ_^yck_8 zsEJ)W$WmqT2f6p73bxHSlVWaK&sssM%~p+{xgBr1`;Q=t)bKRn-}zHEN6g(P7zaR> z%WNJMilZg-_l&8x?Dql&JzBQ49FTaZ6&;5=+5j4_8ap2AKVVsAH1f|k0D{K^8HxZh zyUVTE;;PQNo|WZw4t*bKcChC`ypQZb^>_5chf)u937pBI66>}y+Xj1)igZQVc=wc5 zNMD@E3)%W0_MMwSBo-%&HF9-uL@;(bD;;V#*{Q{vW>%Sk05Uh0Nf64>;6xp{0Jd;k z?Ioj`5c(~^hdYC*F#5zIXw6IFtfGYfK5+~hJfT#4p8>Dxs z<*_)~%$f!J0WzCULcF_pAclh9S7IEP`vc8`-$3xzCMN>UwlvtGN|hL>ZIT6HR$;bR zMHgbNuYkc^9SLE=){`zvnoOIXS*WQQgX3HUJR+^h<`eq&F~#qk`P)C2v*x1F=G64> zSWUIjan)0EJJwzg_c^Em05F)n(aI_sGc1S`tr81n`ETSK~ASq5@8fpZV0c6@ikzkQhMmgXnJv{Zb#B5W)P@I z6W#5`kSpHm>=-#<)I>|%)~>5Dv77@~By#?-<9+nNrP&^YDQy&PeVG(DVCAbcEq*wT z5thW$yOS>+=<_D~Q@qner3diCM?=$TUx+$ZZ0)eaz#D=d*jDF_` z|0Gwc5u$;Aw}`<5U2BP|D%XxanNHncGv)&E%2$1G6^xKnFKe2Qn*9>~jc7wgNTu0X zK25VT8yzdh!0Y}QnItu9HMa6Zk7HOQ+7jB8W>{x>EtI#fDLER(raapq2Bi1eK^`_i zF#fR0N6-tiHJN@@r8lyu7P@Gzm&?ebPKnPUj3$Y>rDf9!{m9QI3#6|MnpZMgzBdYI z%{komrX0$`)wutR88mA|?Dq-&)x69m{rr|m{MA$XPPiDs2K`b*#8A6#D?ZUn&Wp)Q z0&T4zTU@e%cWF|^>)*c`F{V~sVYPa0ymCG2r6yclI9?8#py_0W7$^!?ScGoB2=-Z3 zuR^pJ&5`!FPu|G!jZY=){c+z!`$<5dc5clpaoc*AG_A@=C0UE&bHXnyPJ(Lo8O#Qm zjs50I_vsc*wM5b<20k@snYdQd*(1)RTb|+*((Rpz^l6?Z+QMQi0|1SYee|mbJpA)w zaENV&!RkmAtIdkm{2FDDS+@3wI{vIGt4tfP3#9#ar!h7*nPEVoS*MTheaFrPI9I8m z?rN5vpb;57*G>t*b;3cXg7O{Ktu@mn!UHx@WDbdyf8lHqjnONxKqp4kwQU4v>4P;* zP9~vFMY^!6U+&Mw5qoW~cpw4TTo9Ht>0)KNx53$~Cy@Hg^U?@O5$jN9vUcJdy7<{0 z0v$6xLOR!v0dE5hwV@%O$Cu`(Iyknx^(`Pk>T$4G1HdcAF?|^wN z&jhJ`7_>{xeFzd= zF5E1z&17wThek4qaHt?dwThFvMa6P;5C!XX>t<=clJo=p+Tl0kR!POuhPGRTTA`jkSQDs=Bf|X6fN@ zkmFg2CfBSB5k?NY>jU+Zqs53RDzw^_08#gm22LMhz&)vDlm|BC6jO-E137xJ`sAVy z_38@ha&aEX3;~Dl<*xy=3%v%ediE1~ZGpa7XVARW!w&|JMdt6>qx9n&jV3=(6OzyM z*%+wnBsb4cxD=*8_8E(keBV^?e*OM(`$OsZ?o>B`|C0@BfEhN+GqWZ} z=1qdm;j=+!b@l)Q_rzB6?|X!d)s1ep?nB{*3HBpWBIi9{Y+VyAkiJ* zwpwVR0{SL23z}J$yN*{pj1T$rwEhTzm=s?*-xi#Nz18#ZRiq-somT#lj;r{`sJbS8 z!|7+i2Y_WX`iQF$>ih22bJ!f)ItL(_XalQ0wbA{#!ozK%tG>e+nD(CgV@bYKn3$M- zkB5X&F_Q3H_)5tZ?c7%qDI;({@oSeu>_1iJce}*&*MEEEBXb5yXSu^=>OiGyEiyYb ziYmWr>T_XH2vFqO(GxTN7sYTBBdAJ&RM47OGrdHr%mK2NC;NRkmE{V6Z# zTsMWo0v$rKm5(#NM#uZJN}A(0xovuiQQZX%49IQ zj^|xKAYOZRMswgyyGhG*xxQvMv4-hXdUhT4QpFjj<}-~j&&U=WDtd3`dVlueW+|!J za%qodX#Ncl{KhQ@G(vZfc`jTmT)`8t=TFFtZBX%2mi#bcyA5xcm@^03DC!2NGo*a^ zlwtkp`=362a>+1m(jz>gO@Z?4TzAEo6%BzcV*UnT1wq;XhL$QRF_}wGjT zmx>u`P1Y+oiG^Kf%wU4LaypNHg`caSwE=f_3>NYYqaoV>p0Dk?3wWd3sxc9Fq}acy8hFkgYG>>yAuX-7P~OVmoMw`3`t6^%?pgCM0x3b1{sV2 z&n_`z(zCL&d>wvKX(K)FPR$z()kA)=0J-Yq3;jJe#66aAdJk-?t{8TEg(sg!#0RC; z-2KRjW3-+@g%8j(*Z79bgeJqHdV>ziIT8aTwpbomBavGFam9Ds>qm+~4#Vv( zdtM!VB{G14QG@j&;!7VC`OAlB9&NVgeU+ppK}RerI=xG0(xY~xgA`?22OE_A->;RK z{qIx|HC9Ry+PixSzr_YXi6A;+WQGCS z21@dI1lft*67VEbt{@(}(EWQ|r#Q1(w6GjLw4yeh=Lo2z+^;MIbQ*t;W{byxmYUA* zq%83o7<-U2B_7w3<;XZ9lJFd`U@Ax{#t~{Q3Y;6xoFA~?h&g2s-qzVZvS4u6{US@( zWw&i^;T|@UW=}p}eD+mq6FRO=Co{XpNi3nwIX)9?_+kWbyu+3u&!yw}%M7qdFuoNF z66V?d-1j%tJL4f!XtgQc6qUY>bp7Iyxr3@x6UkPkr&H903~s`%s$uPWGtPPiY9G~x z;c!$*TB1QPaAx|x_r6~>qUvcA7?T3;WDqfPSxumX!|JanA*7&HvhD;@0KRow^6iA8 zlUPuhUkWLje5y{o{b)qNih<`xEP6^l{3ufDpUpFT;IHz=4pEZYa4G$ir%6CLNXFQe z3x4rK5PI4A4UjDan7B!8hRyT`ewhnqnKv_%nJDE(8||_146?-vlWkE5pF?9#eUBaM zDL#|{E6OGnO4sO^n;Rq~G|O6@zSr>PY-ffyCwv~_nNP-LN3ZS`9mC0;r+rV6Ii=Tn zsPYWVLYaA;mh-L6G|1k5F(XE4UBAl}RDv_iam?0e8K=hOjb49^IFC>kv`}}?8I=1T zJsohUD!StuPX;ypbLIY|@wqID*b^FRP;4UV{`({Gn|L|8Qzqf&Fm*a$v@1l%KRWZj z8~{3;++9_xeN}uY1}CHDL}1{aUIGt4i+Oq=&r1lPsS$0)Ky0v=N-=wTdm|5fBgd?z zNHzCejS`YcK(*U%+ym8Xis|KAJ*=c79-yA~F*9*2cErNMf~kz)Dvt(Rs2FN$=i} zfkjI(+(Nz~{Lg0P&rVwCp-|T->^Tx>s45~gs7$by%9R}D9EF0jb&2mi{3_r*dH(Zl zn;80nBDS4srSG_d8;LZPM#qxpQkltJ$*8GNx_+-1Ne$V6ct_tv1>IoNwi-HB(|stJ_c~8Gi%LO&pId{89(y(UpW{``3K$5 zl`)Ug&K03wMM|g&b^u;bL~<|56;} zLP>VLYNM^%_5#KZ$DXTEK>kFi&KZ)1-?CbvLSe0iOgb>Jyl;kHK^!z!rfW#pRgGRp zd{NQIEsD@+Q&+N`d zM_C+J7aQ$p&jvCk`Q0{>;c^7)?S3+8RqKOuMHllWa7cB$$zRv|so(nsD7V9haxMYu zXxuc9l{y23S`+U*MR-VRv>ree14!Zpiqz%b+0liX@S(rWSt^mb|Dh0a$Ch2SR%J)2 z2SHeE$QKCZnT#UVKc!@bjFcK=`AO0>e3(D5G6ZcKtM2EeJhcbbNx z6(7{x))rt;saOQ3W0JZ&x4hxH1^#(W(0wKPs$}S7dS#ki%RvOLcpkYqJkefDczqV{cH=RfTQ?&cU%Ky`O6w4ZA&< zzUnT1k#&PSt9G=22K7n@g#w)x$OeJJb4`gC5^`3Pc-_x{iB!7#0)QVL`T@$Ma48tK z3wcF3=kDM}^qMWvgs8wX7O;*ll#U=z_FfDu2nq*T^>E2Y;u-yt=wNEBa9? zi=|jbF>!ys(Me#14vzsE><=WB$pd5vJ(js1tw1}3IUb78!5KvqQ{1=O{Yb{GvFCb9M@*>si4u?W5M+QC@_%X<-b!q+73CKO1 zZ}mREYbLuF4ySWA9AS*=aH}kCL~u&k*(e_FxIVoTz+Oqw5!AtgBwoKDagvKRnhM-r zQ2XEtY}d3bMq}{-7CKvX?LY5*>R2H7qWgjdw*m{v%y1dn+)PuFo($H}&8rS5p**fF zW;xpS=9TdV-ftHdh&;kp^d9g{^5?`hz#u%gEaT1r)u*#Xz%bYWbU8Vx?xQw(C;XFu z$fIpPL57ie-A7o)R`e-eApz;5oGC0Nfq}}sR{hmCv^S%d1dL zY=R=T{5g!vWq<73>s@`3leISbiCq&bd?>(HkZKh`#z}6p;Upl@i-LPw11VIOc@S~G zc5lBhKe%)LciCK$q+*t&Ug|k?MrU0v<5U?=@Q5Whz`E~=gI67VzUBXH|Mds{Tvz7% zgbL~sBW16|al<1q+r{N)9&Gdc>8@q4qhZe{TDbo5{I{7X%kPUGz>>H3mWKc?i}V9} zq;?gIz9RHKDf=o8w8Px!Zy*&z6wL2)Yu)@+p0-E${aFcPM4DH@K+VJ$v^)Il4}xC9 zhX}vMO2tCJv97WRkwD!`PH9yv&84n;zxDDU@?6`XCSb*Bw^AnwXWkLJ_8J7sQ>Z>E z+n8(732-)?K8;h)S?AmWIiX+?pnRzmtY+3o$toA_P(9m(I*0Z2cAn?=SzUu5Vs=b^ zgU$w=1Y3jI7Q80b@VgkOB-6oo&VwkexpgWDmqEgjdfn9A=FNC=ZqQ<%37dBI(72K8 zSl!}kW2Tcuu=-&_s4S!Vo0>E|$S`PsdZglK`ky%-=51{$PR^kM{L`72pTf*X{sn)% zcd{}#{%*2#F%e@Vt_({X9UidXpkdYvEVGHaMM87ITiW^8THP52P%d znw^rnrhghC8L@RtfMsas{=QVaR9ECL=n2)>!tkApF%H?zj21qe@tX+;5a{%wyVmGfVJpOKJ|*hrRCoIT#RRs}vMbW^}Sw%ZvCAu%uyfw!(I z&HNV);iX~?(8b88!^!0H4~{ksrY+TbKw9pw))bciaf9>fGo>*bB%B`;jyMjFB9N=J zpD&gy@VnO$6&0OY4#oYh*$OzNzP-IZGj)9A-SP4!MM&(If#=m~EqssXdwx(IG>{Ys z9SOFSJ-cVFx4%_l-*$OOm7{k@8Dpn@DQ-!V_;JpVUGez6cULVJ_!r#sa=-DQ z5(Pp%BBK<6Y9s$O*Qo1?+UD?+&->bZGbQkQHmipUeDu?FGHN6HxKu}jVDs;a6`S8t#<(L0%5IG)t1-^|9| z-o8VYAqXp9@QcUmzsIkNd0l{#8%H4dVB-AU@QdF$PROla(^CpL&b=(xOV zfi$|)5yZnbYdU3ecd`Wh-PS;+pkT^)LaEzxhCJ-RZhns0s3IUF#8R}Cl!TcH8M>m< z8+054T19EG;`ssue5?ytG)hR!20}<_WYS?@9_(goMOiQy$uPm`S3e{&Oy){LLmUmR z^0-*4VLk3&ZpuqRy)R$*!>z9@iKZfYX<@^rPt9e6V%s0=6Jk}7F$*TRVlm(e_Qo*VM)$hj*?5E}dlj!vQM$!*)2wE4gDS6{>VWPM!)pqgwo~)6Ef(=5=6<po9;>6S!moN;(c&>k08W! z%MbxCp~iw5dcZUPYK~p4yUWjV874 zYT%Il!pt=A%UH&oI||6&)xj4R(Lh=Zq^|%)M_rg^JAm01=7793C`t$WdHi6Ss@8W) z+eODP6eMF@3TjcU)utY8qo7Kfc@Bd^eTqQUUM+W}Uh}j^urAXbSB-UQRmh`b9cqsJ z*^;e*NebDGKBwF&!Vp#)OSu~6#{NuJrErMt<$y^V#7|zBU|Uwmk>PHggZn2^?TLty zOj^t;EJw)3Ov#-F_-CAaltnI`4xE(zejW;D0|z9EhMm>s86gnqI1rRuXQuc|-luyi zgoYiRgJCQ%ow7g`x>kpIDk%^M+H!$atsi(;q@XB&$wR5va@@>R08fvRN@PhlItP~m z64QwqvT8ZY+iDTGf9aTowoD_y777A^Hw8lDbgGBL7C3t_FiiUH;Rx^ma%BUn+%328 zxq#8jfMLMSH>SWBXDCIM_&EN=W&@+E0>hMbc(Vatv;vNom*pv?07Yp`2MnXS*@O2# zPn)6Rg(P*>IjcO3WhD;{wE!W&F3(OeFW_=?d3_;SfkxxfymC_GOOx5<=;cC#G|JC7 zJK#)OD1R-pSAl}Bjc(Iwe*WD7qg5-@E_yqhnoU|(4EEn2HHGIhglc5v51bC2vRYu< z+wf%?q*8zzT??W=(R;u#19!(-E>PoK#Pm=8_1^CBkC>PklHB%|rZ)AD-#)4W>;+$Je5~`f~u&4bQI+?h3!suzZo@+0MYTpRh|5MP?>RElk5SL?^PTzU0B>i-{ z=Xk%YA*Gqllb<%x{=5%INPcjeJ8>Q{NOL0et+L1W$9QoI@OZG1>wuO^Q{GYn*u{m;H4_Jh|Or&k>CmqvYK~}bF z%bb4`rayi|EI5t}Z~L3Edz%ZK11DL36?gU+p+Qw?*Us)ijD2RGLpKiZ?Pkd1i)_3< zsc7bWWvO*>i$H#{(-5s)$wrJ;k4Eq3+2rIeg3PlMwFMDPMF#LsVQWczT*id4+#B8+RQ6u`?+1#9_+xthJ z_QP*P5Ocw&trmY#x3R*v=$Dnf0$_+^g}|z~9AU>TXt`EjfBFi(la)H#_=}kJW?KV4 zyY_36s%mS^>H@kbf(71{W8vA{M(ghujsqb|sZ827HN=bXonHl;b7)wfo%uj zQqOE3Pu<#W^LgX}`#u5}WjTI!BrI7; zg!p94l|pLIu4TG^Mh;)AGtrE5fbskgI-Z`M7TW(F=KsCD{S~jhDSSDECj9X7Ix{m9 zA0J<>Ri9q(i`0Er2|mn|UPAS7dr0dh4RAVMKmWFXF*QLq7UgfpeVaM}-uB16HdkV1 z>^NZF3F+dm)4%XI+CMs?yzD$u4dWf53D{tB-W~4g>B-H_z1sW!rFRSPf;jJuntbrG zZtn>H?>&m}@3gHig|5$3)8B31Ls@w96AVnq0lzf|P7~_|VYfr3g{Qx$cE*2Gi@Lv2 zH!fvz4wzF+ zn6r$9-zO-w$dYZYemD?djd6jzgI<}?Rhf7eF#WK#0)s#=(vS7FuVtu z$kI9$))^e|%~9Zh|7%X%PyN)TGm&P>j5;m_7b_d1V}Q&Ojv3e<u$D|2Q)1d&Md0 z7aS_>mt9i{%0d*#cJ8E1Xf}Z_D+cqkm>Kk(e+qR7O%~d+4^nrmr9_6RaJG_cHanah z+P~a~;b$K(Qs+jnOiPqzQrhzIgrnig_M?JYs%)o67#E>ueFXBiiS?J(*4CDm?f?%M z98}P|tE|Vn`RmuO?d>b52zcHk=pTc{BmjhmVZA3nYys+#K#kz>@$n++;&m1`y`6$) zLQuA!4_JcXEMUw=+mcZ`s~H)QaF5GX;KVGO5XUfxw*D4Y&q+#xTrvgrO=8yC63Uqk zX;kOhiHDzLjL#5$m*_SkyM-WBjey_=Bra8GKLl%+(GSZpme&Ken$W<)rsigqRk03J zJzBgRbgn_^QnNRnFe_lC+W`&rRG~>4sYLd%^0lz^;=`d8O zU7dfit$6+N2-$8U^&kS5I!F(5POkN`rb7x?Fr6sRnhL_&{&0hUEQ+!(GnTfGK`5Y2 zWLY+2ARTj?%yoqZ=F0(yQ@xgq;&B&gOLW9)v3Yl!Q-jHLzzQLio~wJY?Xsor$$Nvln5 zleo4=sC`NPl{U|d4biC=GbEzhlO9R|TU{bT!1kC^a7xx0*R5&?V=Y~@9bTeeJ1)QsHMfpxO~MmwH-Hk!7ZEzd*9K! d3HIQ>%tk%VP4^Gn0bX6q;OXk;vd$@?2>?ndrS<>- diff --git a/media/light_pings_proxy_bandwidth_slow.png b/media/light_pings_proxy_bandwidth_slow.png deleted file mode 100644 index 18e4afdfab3d1bb65ae6f0a3b7e6bb3a76db70cf..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 34705 zcmZ^KQ+V88)NYc7jcunf8r!zbHk{Z-W81cEqp>-$8a1~4P5tSXm83;QNt7Jz z%mCJ=U|{ax)v4x6YO<{%US>wH2~HRkhgr&w)7k|=q$B>MbR+>JB*J0=`}7cBLMceX ze!)hOP%ERVVSr0Jf_=HRz1z#`5bWvjv(-F5F<&z1_PqD?>aYSA+B%Aocx(^4;dcvlbo4Ky2fa;~3t+AFM;a87N?BC?IV|G~tC+i1DDY6)Y2~7C zU_V)61vh-h8U5Ukl0=n>N{!9Ig;bt9J)ge_)gjdVTAM%l5%EyIf$sSGg85vr#`LL znP1?f_`Qn2 z`wO#v8uorxJqwbf#Bs&-egD#i5P%d*yp8`Hr4(=RC+iChDQ-%CctpYrTs1sDjp(;T zHYZlP84u2u*R#U7tFL;f8&iC`-n(z$5X}J-{aIu!1?4}pcj*%LRTAbkSUwuu4m|fc zF>x6y3~!WV)N0g@m9sT;RkxQZfCaN9i$CT~7mer4*^RyzaTaj?WmV>2XLVvnZj@@8 zY@qGdGk+f~S#}+?9sWohSV|_RQZd)S{*e?>nVwnP86N6iT9O*k+At$-$StVtw+hDH z^fON-4r`cVg=3JPjgOv&k7-w!;^Ab#%2YXcuALcb`PMknHfczGWO-|l5=gbQZ7EeD zT_Z=+mK~3mij{Pcv*R=(i0;J6Mt5dl-{KdeS!0~@>{IRC4zVS2(!W=*xEr1jGr!xQ zdyw|k*;FXmule&!E?#UXW3#Kv-+O4SDd=K})!xC3r_6Sp6&>xhG-Bpv)t1jQoKt!a zf{o(Msg>@JqEf2Ua=TgyVyo@ik7M)dFWNJrFg77cp&kxJZOz#H_0eZIK_GIZSXi%1@NDT_ZgPgyW2n9xNk|}H7-pBXMI-Qxq6=ds7{(seDg03 zWNJIe!UR@~p3Ky~ThW|i;nU;GX8PzBZ`auIzA^NQw%*#f+1DOQ1@YUyXv}XyXm{UGm8p-4q=(<#Q0ia@oFS;CxTGeIs!h#J z?DhGDxJElmJBqZ25f$*@FPjEvvkVfWxKwYkLQqzl!(iTDmNpKz`!n);7irJUuI5{p zB0=wBqFSoAVDY}IgQd0(z*Ab{BYSc(sdG;I$ZL9)l3S)7!UO0b`Iveu37-KEABh&R zCu^Hzz!XW-tAnb6t977$e%IGA{FLunt&;8B{XL~~$D4e>kWGGn>S^kf;Y)S94R|cu zdir`RZwSu>k)+$I3mxANU&r~|<6|W|SwrE^YV(~h7c=+J9wB|RnL7#_@7T){SrY69 zUt^SG&tv^O+3)ap!VveP^Gkdq(TruK+tv zk19KF7L-U44u*PS`JU^6; z?)h@3I3|5ZNrydx>C#_OXUK?|d((d9=atT~?_k7R&ym%uT%(1PjX{))9REy5TNP>N zdzK5h+WUghDaeC{w@Wt1~Wcd;0QqM!@RFb6T%81N7-ar`t zk)Fen<%Gw8nW{^xUer%>@N5ffBU2?*NEOGS zHhg~v#%otjd30y=WZQ5meJM)CEyZVN{L~2f2`Nc)oQ<7{AoHHi^{ixX;=eUM2w3qi^WU4#-?~u zcmkXP&y{&J4XZuk&B?9NUFXY%2M=R0AJY#b$er^Y-8p3s-ygmGc;;R;x3hikSQo&r z57lN`VManNL+y4645Xq_VkV;nym2}IGTYwB?65CG9uHpZpQ#->@5tR%z2iT(Hre$~ zA@VZL1{NhtW_WX^o@@q%k)3_o0&00hwo)Hrl5R5nyHxLTAJbY=8l z6nQjRv~AKY0dtR;!@DmP`pS#V;H9^^(r=kHqiOR zyK=l)-lRTg{AGSCkrMte+hLDqoO5P2cW{6U8jLdOR%>vsi>j<@&kE@ZgUBQ+-`yFy zmxY%>A1|aGsCc&&Jt4<#Fy1@g#e>fvyM{mWUb7r%W%=YJ|J}B5OcbIYF}& z*y8Sb@<4;68bhzZI1OM_R9?5$yFeo1&RN)s5uLF{|u9fU{6yuOE%2*;N$r-5jNnI~94zA)K1m^m5em|UH7(>$8a^h*j=FOH;~q z%$4@NUDg}&es~4Oj^)}i6fr1UQ~Q7lqU*d(|HSPi&EI9b@(@T~A0)LS$vR6C(Hx5TT&{dlxQ z1FCoF5YlzZk+{!-HeqQAZK-b}i;^~y-Li?o6T<6qrSh#p#N$F^v!fQ{Z6irDRlmE2 z5@sr3XbdOJW)z0E+(@%T(~OfFgHI`25o2MQ0v;I*;r%jxmF9JzWX|SaMM))EgrwEB zr9g&K$T=!oioK-EwOUu|WqX&4)cjl3eCpvA94uHC3qDek3bF6$;q zY-T?lHzYNv1GBP5&PN6!9*bvb|8wxX;5u!8VNqc5*?476q4>%2#TtRA_ zF08qsT2c)6gn3DXMu0gEU9x{C$7HgLf$3_=0j8zoV!F$+a|-0%7+jJM?E(*XnT{~4 zYpty$@!@qv*H^N=ysiZye6UuSJHR~?#zI}~(y>}%UA0@@KZww&= zVHY4QV$g5W-y41w9ujUEUO7FN+bJI)i6-hOhbJo`lp;N?uqBr-c^%A>6A@_{#uFD3 zZ}w{`F(#@edMn*ODj(*h_m-7`1-pKwo~3a*o5{q<^9OP1`}F(x_;WP*!o!bsCG%CDN!jm2`%x=aq97jNr!5A>Vujaoo&tl34oY~ z&_Vf$akK5cK{R&8WmAiDm`nRz(LExf9-?vdc$5R>_SDlPA;S&Bw&CA;q~_nN_3I;C z-u7y);|?DI3HH%0nRh66UB}J)g$J**xqKv${KQ56ze8q&C4w2m)5MVU8^hLOq@xZx z=FsiDoT!*d!ObK=ZeiTN+ggj&9s$Q1iivDx?UNRiEUN$UzEbtSYi(c)uDAMmw(0U)96A` zi>ojig1;K^-J%QDP_rn`)5wB*^{6om{(wp*OPwxJGAR)wB?hEtZA|X-KS-CYONEgrlvq`#I@0b6U z1&NcvvoCPgfy!^l7sUb3?@gt1XihJ+o zWoa#|_a}dvdihcQy-|Km6uKO z%vteekE!>qfp4wDh3@*=ZmsFKB-571aX&0wj1Q#o!O>h{{dc~nKY>L<4pur}dY=Dg z3VvM2iY#Pu+DTyS$JiHqqoPXGcW|h$6pGkSnu9}TCib~gmidNyrR1xk%*PiT99#p} zY)Gzz2+m`=27vSy%QK(J>Eh>gyQsqbT&XwaJ6WkO|9j!xedq9%HeC(#61Z}$-PTFJ5EdlE+>- zzrWl&o@R(o^`ofrMuWjxWHLfMakbNT(989@PC9Xw&a-reVS*pu#w#Y_;3& z5%IHHs@j>ux9j@ta<)F}@h}{2PXt zBqEI}+Zk;~@Z*VmIh4pVjE*$uHi>Ivmtv97ZNr~f0P_LE7dyjscpf`ih#h2H8iAtQ zPf-5L240BVoLlaNcMHbG#>>^ZnyNRim%TIO{Y>rqXf<~w;`*j-;kuWu^X*QDuIFpX z7C7p2%-67}dk#*8647|yjllc|-(I&rW2orp;7`0y%1f_UMZTG7@8)4-0)_;xrg<-u zQd7}kdqKQLo5Xix%UB68koc43zE9XN2dB5E>yo3Vr>BgyZ~kcD2CT*}N9}Jn6H{qZ z8SDdgX!W>^M3W_Eqsf{EG`?f;WZ%AhOIOr4R>3zqF9%)WyA{(VMIJPFIjz-%TuX{1s0BEtb`gSye?Uy-pc zR*$ntXca#}k!!1g*s^MOx{)2o~g|@B-LW>8dEC#d1m(tr>zZj=vE=PG-f*t={=^ zQrRACpAH>K&SVRhv_r#M@?Zf;i~6T}QGxsqImD#y&C^7_Il~DRkt#;uUo#Wj`w#;U z9oCZaj@|fuGYL5t7N`hGp0$2pi8u7p!SUPkEnL!b5liW!3mSEaVh+m%Q#`8ec>aEW z&ZPG)005vNE%D~t826@;uB^oa*Mzj*XzO8It3|cog6LAC?-P99PsGg*B@mAloinZ? zFt}9~ScsLP2IwbFW^v!vbY6^4Ojs>eB;)Yl>bgb$Da>V;rS3XkZ^b5}B9E7Yn*uga))J{t#Iq(uAGlG4&9IkRn1p%=Qg_IZke6#3AqRzF{{Dh5 z_(5Pm@@_LT!m)X;`oyJ{peEt;Mb3HvRd6H?MO6ev6-ox%X{3c(>4F^I;uLY)_yUa? zIInky=e=dkirgHTeyZaVuhnqpckK?#n0xf0IviIOgoZR&Y6=$Z^_Trb#U;fI1aeF0SXH+S0-%DyJx)FOv6nabI;ol{Fk` z4kV!;3M8SYC8>@=b0L0yV=r6C_8>k}ERlZ|GEs74SFYEcVuK;SXYqfRQd!VwMhr3m zwbz>|6TjLegw~bn{ZL%i4KJj*hh)enwt}RO`ein+gD+_@*VUg>6GQG3r91LlBASCE zVv`X2QB|8CHk_t;Rp#eU8G@LVhzPMz^7;a@V=a$Y;}He+kJXu~GOj{pIeN(< z;p~#Vlql-2q$(sw%}WW#F#nEx2xay)(bEDYk^egF49+EjPEZ32zmu`%y3`?>lf(8c zJM_*Vkd`(hIk|W>Hpi{0Dp$TaP?XzDG)%pwq$2`ns??w!h|CV5Aq={$<`k5n*;)2j zCyQ@hDXDw)L)O*=z4W9G>V*=$1d3QQ`H38h`sFbkL&81h$(9vr=!c6nz#qji)arkf zI+L#LN<~fSnjhVD)OFShoAw=F=eCD9WUyq!sW1gFUDVUmZp*{dK>k}54my$fT7E=-_7J#wvRiJnxmQ`JC6iEGxBZmXS z1%z=>P(VhbF<(|zFk3d3j~PQal_8j&_Ee1i^uXZ~D!*x@8t!Wc6Z*22Z^jFBEFKjs zKT6e|kO>{+RKQ?ie{ND?Uo<&+gr0?9hd`7dSxW~th4vTCrfnX_tWBVy9dg)RM@+fO zm1A+Z?l8QQy8ji+?&z(OQ$uIbt%h9&k3Wf-LA>YaYpenvg>%j~CUj(el55;8@zqLAA=~ zkH%!WMJfq?Q`Krd5v;7fug#!s%!n4_$$M#^JY>B0G(<{R+Aet{X}J#O+W&!61C%fc zN|$2gJEgQH(97YiKM9ylazLPsXSZipmMv=IQWlSNZwvs0=H8YJ4Yib(GI>|9FDP-w zO#g#S{$<80oOr>~a}xMeT^aKy9>yv0FHTV%jd&uY-9K&s!5!-5=aR84o4t0Pdu^_u zFq;zZ^ z2b#|nGGDT6|H9iLtFLy>W`o!X62f4ni6U3cHfc$;C>(F;aLM$W|H*N0AJwrHAaAZp zHB{Cv<02!sv08CIm@rS4WFcRIWlf`BWFbMKlLjpBP`8!r-|)&;_Ii$4viY1YQqFwo z#VJI$Q66Ed!nu!-Z?;{cFCCJeNl8i)DoJxI4=YdCX*%lA!t*~8A~{LJc!-BnEH)jg z*7>YfE=0@hV3Bwq+nuseEnNY^%dp#~H&iK~h2CA0s%pm+zdm8v@#=S32$9gHsbQ!r zdlY_GzQtj?#xY&?>}m;vLHgs z7D212;z`jw)eF#^EaY%eaA&uV%CJ-&o60<7i!p>sKgln>vJ}u?lM*NCPX{&|A}5Xu zsVxm**m8pU)z=9HHLWzmzlKloOIv#&|5-IMW zb$WU8kM%Atm7f!1Tfmvb*AZ8$=mo2a(x{-`X4 z?q$~eZjq9fw%v9uf%|(|Zp}yvei{6p|n^w+}NpPd<*$p}#uW&1V&$f-z$MN({n%`HlKU;B_!aV^$0HTYs4HcK@k?8m~p3w;+Ap|HA_laqhx zNyvny96%AQVIK$hnaGFNSHh#yh>NE|Tc~nZUlnoa%8+Cnm_P-_0~PGm)>7Y>&)OTc>YXm)-C0CJspj zejBL>;F}GxCoZ8YWy_H(xj~YpNbjH~N+h2fS)VBvXS_PJl}nYgc(uc|bz9f+7;Sl6 z4Sw^4y;Ge9j7m#!{Q>sUF#+{^sC~ypBL88SE>aYKIT;raGbEjll^H#iYwt_c9P9RD zr0q#&M;B|uZ98CU`YdUocPRb3!p&Ua0x)o&)dGaQu4HYn1s;XPl^uaRe0;Ii1MuS? zzJP)J$sZK#6i5Bj5mRBuvXRhXsl1%n3fhao^E^4pE-{8kJsQ7qLwVmvi{vJ$I#*U`DT|jfq>JJ1)X7l@{#}qf9%igC-S}ss zKgq~3x47HmFJ;7557*wN^xf)?zn6x^3JL3XO)+o^hAOq0bYrcwIfCAiSQo08+jke6 z>qW{Hm&m_$LjGy_6OwE}L8e>(`R+*h*+`1`b1?4-Z@_f0Tqgl?PCBx+yHX`caIu0P z3ayyUocpBGFZ%}+BVDw|Mf+h*+inD?g!P*%5PyBVq*4;PvNO}k_-D}Q{;(!0s@SY! zOE>+C!G5Q@K;PX;t(EU;n$@p?#>&O42KL}ay?P?U&&rjq{%acKd90e6t%;>Vm ztaIhOzi3kLCNq#=Z%=R5_)K63#dlc!v1B`OuJ~E3cs{hWyh6K(+jwmxnzaAwxN;;% z6M%lD3W)L~6{VT^+(U z+^EtHvZg(vx@*GuS02=*<7E*CX$wIv{+Od!_ee@gBH(c@D=Rw!6~iz{1Z_7N*A5O3 zIQPj;9;UzGbqul$wQ`cOvi|fpnP{iw8WLqDW$3N$JZh5C0*#UG$5T&X_Ro8vDQ!R} zdi!@OlfwoSK~RW^x672tAN)VwZf8KOgK^mX1c&_4@>kap=461fQ=p-)b^9 z5kw2Ikt@Bo617W#N@F?cXX$c%nR^6xhWrUN6({w>Xc!g3BiSph$b&L7cJrru6sTfdFE*Y*r`1>e@47S%eHP1AseY*c zD*;`tts#4e*qP@@|1o4J^@7Q?D)p;BfByUmuj6($IP6&^fVW`}tRnxN@9V(TBj{Q+ zmoLhosxzE+MneStTNaS7umNIn!Uh`Nr!qMQD%x;a&Ca&EU$dO1QGc2`s)r&Gc8$)( zvOy@v2tl%x(}nJaN;r6U4DULJ>R>yZcW;?Fz1^v<6PNM4&&g` zF)|L9eXV3EJyG;~L2o_GcFPg#bNZWZ9$=Zhe>#fi4=X_ek)E`~Qa(6VFkGCMH&Ac< zwz*q}`RqWP7}tx7bPr|v_-K_((>doO98T=z;>ez)%G1!zJ7ol#AdStlR=$r31lb4jbMo| zZ^_Lmg{XA`|27Y3lP(-N9(wBZTE_hj2=?q$F8W?BYNKvxB`xi3U=W&=QV*PabN?kI zWGKLXaL5Y~TQP9CU1f<5WC z>w3xa%8Bh$1^gO%u4F>saj7Kh;niYuzCk^l#(8ogH^s(Pi>(R~#PN+6y7uF-_w$F@ zP&bGVdFpgNCPNi7{^o1{wZv%-781rk%v42{H_*^%zOAjTpkSZhYc1RJL?BehOjR^6 z(C&|;1GTH!n8?S2&1N}ajHQZp7V4d}UAssuI9Y$x#4SSwdN+3TMEv+SaC~yQ`f6tve9uncCmq9}p0rQ7zd1 z)_O^|$UaQ6(D&f?W%B{)-XQqJ_{Wd=f@O)~x-*h*2SterKmE}gPczv70rN2Y!d0aE z3u`ES7($PRVaca%+dh(yxzP|>W8=;0l^V_8fIE2L6J#j$E)>RU%WQYpJI*0Bc|s=vvenFzG^>3IYgVQp}|>6>d!R zFU=J=o&HYh+O`+VXL2afB9U7!*XRf8ab#yp8i$C z2fr5IcO$S7NGvMG^6JzX_WH^V|11RSX6tjqahd${AJlnG6Dpbi9V$145G;|Hn7GirAdZyLx zcu)a4r7Er8*bo}QDxmo0Xain`9>wE`f&$B$J>({4@&}4Tm_4zEKU+qxFs+Ea(u=fI zI}Pa`kInPSC^1X^P`0=&quZ;z&9w8uC7|BvaN2FlgDSJ;<8DFmvg;OU zL2cW84-ta7^yB@~Z)8P>3IM`jB=)dkB??~+5O|oeC3&8#U94TNqVr4pbM2nq16pk0 zZB8z5T-j}fipNl3?F!K4%y9L?=q30kEm`-fBFt{8d z$948V4jy3A*JL}@z3RGNxb;{KE?f1M_t%GS?}rBy*0h*g7>8@k%UCMQ*gCK55TwHY z6qF-XCGat*DwfdfEr5V$M#*OjoGHE!`z<2uKy??N-iL46wt4|XR{#KXBQve>cnA| zS`!Fz%K$n3LqTpqTxHHrn$haQ#sye+v48Xe^)Q7}tPqM+P=7#)q4!*k{Ccjc4q=%+ zy>d%#63=o;fSY58sE<~@1Whw2uS?W2oz%Y+-ez!A?<#5HiIWZ;*Z9~}mk+Q*{QkEc zh7gDa=dbbKJw&}Ynrma~u`txp*=m>dX9yX)f=`Zy+U#v8@0-SPD!Zfw`XJp`sfY`{ z&7M84VxMm=z}+wWncGu{Dxxl$ZwA4e`Q{OC)X7JQ!(tF`*hYr3WBgd7o-9mNA2)tc zOiyh>o$GU-j`yvxaFT9EKJ!37vHrTM5s53fskNNf`Xof?sFdEov1}DH#*{;MD1N}< zvS_0BhcUa_#f zJogdk48C`i=4pDIbGr}U5H^c%^YQcBtc9%QEYZBph5$I$oBDZ*=i;lQh4y1NJ9lT0 zhtHq}ivE&6lfun7nkE?%ST|dlr{S$G)jnfS6hv)m~-VsghlJ z?jH9vvJ<7#BpvM?EfD>eP}J0fO3?AL$0#|W(0`Y{LO-V@nLS+|g10Bjbv%bIERp_1 zq@+gE&h#vyn{~4p*=ZuDcHB5_RqJuxlGSvb9%(D6xq2?M+H1gLbJWL3=(Y;ua&^^7 z64I+DQYuWRQAXhxzTimzO9-T$R}d^4ku=jSSnUti-T5Rr2a(LlQMJsl#0V z7vv4E6T#fG_iM>g3~VQqzpleebig{}n4A&dC7qJyA{|omTD~h6&^MIUvCJ4r{X_|d zU>J!elU7Y5I72!Ag1_WNtxT5S1UyNpSf<6+rryZ6Rg&o9@r3Ri8Iu#0U#+18CxO@h zN( zD&r=L$6XLqqB~5REE-o7L9~*?{F8WE>0C}qAc};jzB^^1*c&Eh3El| zk!yBmvsKaHM&lUQeBb4?=QFAXMv?mWV_ABxPm)^c8CqpNGX=6G-q$;muH98gTtH0e}`K$zHcB}IU-Qh=K5A#}Cjje2!`uk_q`O=zc z-?Kt#pUW|o1xYzI+8y_cms)XD5M5nN6T~yc;ot~J#>AvF#fh*9T>YEiK)ZA%>Y6nX zk}F(MD2eX()N|~{tKk2NH~_w(VLAMp8s6`l3)g{xj1en2A_rgJZc;l_6(W}<%@eoD8 z4!9f;U88Xs-k78z4E61K{ZOSf9x7&<7#H|#yjQ zYL}VH1`ycoolsW$`YOe$E$$I7m`|s-Tdz-jL5z%3u4^D;=X1Ii4SXUL;J!bOFRpOE zy`iDCxyMJom)7vXGOLy0+g6Wx(8cnnHdR?0pis?MZV%3HvD-!}@4jEs9gN=$Ak}E; zGO;6d{cX=e1GMC#1WQWgeD{5n=I!OBlr7EEak%XL6v%9MIi4Tdw@}@&$x(A@!oZ-B z^Sl|OYLuS?&2OyS5I%zN8ZY{|=db&5BL4&E242(LBT6i=x^d>p3rn z_nSw``0?Fb2m^Mhi|ox^$$&8+F~#R;8BU|xKZ)C zOWrP=9j;3x{9sR5HaboS;gYmH(i+IUc zQSbY?9Vxxm{3I+Ifq*xchO7lJS(;Q8sFKzGfFTepEe$I^&pfhpJYH0nUwJIVCjUdF z#u}W{VOPu|X@9>zc_D%kRLr$##|LFdOkrK0)N@L!0xprx1;l^yvtGUBHbxro*W$IS z!$|?=c-XZq6cF1!pxG~=(&h|WG>heDCWtbXRERV`7R*n3F5^?~2Jpz$pD!N0w)q@R z8a5Oe1DQDQWW8sf3!3m*_}|~OnOqe-DSbR$Lus#fb(;(G-b4Z?WE)efR5aDPb%yu$ z(F2!eti9-j|$o!ARe{mB_{WB;6S zbNebNi2ofg>EFHT6bNt%md>V$LO<=|4G&pcuQ!%l_O4HH^rkEjBTXjaKVaUoh=qYf z^PJq;UuhaU!cW?l)3o%AAIO`VztmL7xVm{<42juL9cj5tsnIy6VHCXIa8AD6g=q(! zrR94i`75&bN#Awb!8a&(MZrQJ73+_AX>v^(m$ns@j1*=KQ+WbT#po$1UZU0;rp(99 zw`Gs#g98v1NAWujUcn{uk7uT{rDpM8{@0g|-TD4vbml}$Y$8~(W(8V#iVc$+H65L` z$#hn30xh5lv^R(hB!ZqT=C!*!$(~+q#!hZhVPNNda-U`15q8%|!`tEF%*N;m`F22? zBT3}34?_ON%3x6BH$iadIDrAX(saQvu|;%S{%Y;yC<>{X z4sw#)!t+4emxYG%)h`P=+h^W9oV>NVRcmK=3-P%*`5~^%DkZUaf_yeIpAW3?1a4Gr zZO)cFrI-r6zy*YgyKZvbk!ZGrsF@elUe|-slOJJ~FF!LsfOHQvIqY?Im*!C`#}X9h z{owx8I(yFje^Jmu(A8>H@7>Ptb^ZNud!}uHrZlU;_uX?8?F8c?Na`Sk?%lI}*I#Ie zG>EM)32k$LFG(44yG zH=_Ke@4deaTpcYD@vS_5_!@XvPXPBJ)eUs?K&;>|i3YoX>UaOi^Ttr;8jS>%0f;M; zvGGQkn@DvLOGgF`Xjb{-i()(56OYY2B!p$`n&Z`m%l+;L;q#_pV+a%FSlj%H5dZ2F zCPUu|hSsi|aXKy88Qx1iN{Xo*e*9*P4l$eklM~BAWr_?Q8sAa@9S`OxSOwMqJ$-F; z5lY3J$(W1D&X*}W-vRAG&Ta48gH*#0(7X(YN$IG_Tf@eHL`zV`?R?z-S(!6P+1FUC zi}l&_I!n(^>t^qQ_pN@jN2Z#`T2ty4K&xsk{dWo%_xN$TyKp@sb7bFS@}v*|RK?d~ zkYfd?N78H6{UZ0<_I6e>bBpk-pp_ZMg53R8JzC5?T7R4|S z@g~kEoB7P8FzDtf|D|2DM%ZDmsiRN~R+JwW!^G_6V;?Yu3`Y`>mV*-+|8LS`(t;hH zgfyGi&7jqma2UoKDNf-1eeLIo{l5*L{h>A_$Blo3b58>#!2X}e?eo*{$Aq2KC%l(8sl-wQ58gFDPx~}7D;^axf{uprr)Q= z&;!{+G3Ou>+@~n`-efj~w<(w3FPQc$L6hivzo;q4+OZeIYc`qoGu`hN!50 zE91lS@F(RNupGT542h8EyCNMg?>fRVQ6=eYi9G(2cHKL~!djIEhd$9K8A`O=%SGoU zi*#bnP50y0Dd?9-fUA<#1WLKTr@3zPD#h{)*U%Do_i-*VqtqEUq&GE`Cn~#19vnk!V!1v2Ve7lH9_^DvsvyA6eW^e`j)M zYCb;S4h6N1PU@w2zBj?v?FQPQF?HXmY(?wZb+b1G&$Yi2`j;8agXm4+KyO9Alj*dpT;{~F->(Lc^L<*K zFNjc&)|%;T?m)oDW2?)9i2SI}UJS%)CFy6UQ3N46fCe^&Z8MdaX%Im!oJmL z)*8scBRdYcxb~3rL2t25wK?o*J)O#W6OO#ViqR*|d*QK~A-qN#I8CwtwhKXFDOXFu zd~uXGh9UMwc{@2JPz(c0WL#m1ALy*x%>CXFW8?!#mM9HsMt!9Az6H++=(2|vA&N{F z0r7mY0F9iR&WQ#_=m~Crg3=wQ5hYhxu+t8DsiLaLwFv%E<1G?q?`Vk<+*I6ZN4oyf z<-EEQ^{q58g(Bto0V0Q|P~fhtm-$8Yb$0Rm_wp`f5VJUrZ2F5eRs1^m~vqS4#d z8hrS@f5#BXeUXu`=KIZOzv_`{O-Nasg~0zKVGpPh^Kffm{mw=K`yKn~Uw6by`0Dkm zG`MpKqGTSDT!-DZz_h6`^+u}Raf^KvZN8vtL7Bb;orhq=mz61t__fMs3%c#vtXr zssj5!lbeXS1-U2h=v52UF0|5wX-z(_4|Q9h=A8E!Sa6cXp!rX}m|NDB;&}E;NS2v+ z^u#BdLb7~80nmUWWW#>^*3@)1ulD`ZnpN#0Kvr`4wMccwAWmCbyFtF2=^KItK_xRy z^1=ErR)D6y3#P2u7acc-E??L>FSl4CekF2~*Q*z}xpI+Up*)R97Dj+ZIcSpks)SoP z>wuF0a;6Oh6@+R~Z4X+zZPqzl#mo+8d2DdTuSw~T|4k8Vf0K4(U6}QxA1wmw=XmvA zXJKK%i7__pnH4E=stpGt6fo1PTP5G_%20F(OGYgVRM084oSg_EJD%I)u-$-dY@?JE zPu87|8u)_WP#JcWrz^Lt#{O?k3Z& zXY4EWad&VRUk6wZISTc+81_E~F?VI{v~QsHWDoXQ)EEl7gx1-YtcM@ama%S-X)?l0 z2|im|$|w9KzIfh{bvLYhqY9{9E2wqBwpZW?>M@9m(%NaG20z$kV>7f_>snA;0lRac z@TIW5@JPO?-99;4F+%LO5x{1tosE$-Ck;BKsjoUVv6bh+2sT`edN|45x6{1$dXcjn zV%d&%)QR(ocWp%Ri`(oIplA}A;U82duBxCg4eIdK#r1rCyb|rTL4BMWe*XNP;Uq@S zGPtk7N5@JdF1{-KIM<2P*_`2GyGjyY^F>#fMaL>zfpa;~2FQp3Ecxx=~GuevR`ry-6w?y)Sh@=qoi^lsY9?GQjfzxY} zka!h|p5%bs-2C79aSd&WNCM;Z#_tB!RqL&G=BaudbAaWV>=|xI-hv?)l|OxIp3~fi zVD5GKbI;FFU|2XQWy~{4#EmoI&V#cgMsSqHC&k6ZM-ExNQmKjcA8UPoUMG`$tqae1 zbaV;mf^>6122WfekP7^27n#bEm%_sSx)VzLfF>!}00E()O>{wymE{`gAG;5x8z#`C;962zl3i}D02H&*8nj8WfP@=PmOE9fBnGoaL$9iPy0 z%U!d~v9V4G2Sli#oR&OUy_8wYnQ9HocAG30Bl6$w?wl1Ee^Ah>4b47#O7_uqdtDaq zAAh{ReqMfl#5NZh$dyrHpf$nn^cNBI*SO&!t?4RXMt!&Jz3PXjSJ=~3vLogBA%qHx zPibn(@7gVtt9r>)H4rS#y^@aDarY~vca7iPF|BQw!u}Jft2)>;weXL1OXEQGzM>cIx5T99;E0}Hcbt$zR8ed zhjUZ}!fRC*bC4J8Kj~JAii-NimJ{A1!KnB^N&gl{E}ifI1PydVQR;XSec$hw&(cPg zJP^x^6hP4(i#PAsJv@(C8xdS0H%)6QHUQnNN~5KWA$Bo6soPFjs=6`QX}_DgiZN0D zCwZ+Usvfy3(*N-GPT_fVU$}R}H@4N-wv)!TZQFKZKd~FzYHZuK?FLP|SO4Gjo$cd& zoGXvknrn`6kNf`314-l0lCP*+kPhliyr4!7jLyhTOr70#crdG!!McrR>qDks9R(*8 zqgD17Ij_O<5Kz&~FdulDg-R>Np;Z?Un^^TFd|LD&>x);4 zX0k}8@qLG+lFW_4hNPb^rtjT{H5RJVf>bu?u__TMZ6_NNvg227)|{4c-SS?$2ZGZj+Oon|p}E?o!bT6FWZcQUygi2w-VS zo|h|eu&Y>fnoF3Y3vwMmk@3!A{nm4g?QzxFKHdk^PCKfr@#i}ajGiOBJ9EREE(;@; zCl0%Lw(U7n*`OQTHS==^t^huw&ECLYUGpEmxhhZ9dIJ84aRg|O4`Q#7(VcGX74qi1 z7h>p|)*Cewd7qQ7d<&9RuF|N{sW%FCkH(0jxObL3OBCw_B0t{Z7fH{xQ~NUVw23KD zRXof-8VX5NJmO6Y>hDhk>5@FSGV=PiUgkd=d9$ z`mb|{5(NU2*}iRbH)*Ji(5!R(GJq>r+qiqPrAt6qYcbK_yOKKJ7WZ;dn0RNSX7x-Bd2h?2ah|#F z@r-;%f3dZyCic2)&Z+ciO)heJN!^$$_k)J8>^X?l)kQNQ;&GuAElptiZdyOL$>fIG ztWj* zTfJUjam>VLW#bC7>CS9wB6yRgMyAtKTp=FC=Y-KWxXEL%%%WDGWmUS<-Dn{Sok|c$ z963auZ8D1oO&10{R~eoknu#p?0XKLl5HDy4o5QHdz1_0)R!iN{)YqBUD+~WmUHzxB z_Rx6daHw?QbL!Q^k@d>U^xT$LsJZh?wK6RtB?C)_TL<&Gb8kd*C!A%!YmtThES>Wj zyvqt6Z><1!biTP&y?U(~BX1*!y{wEUbK{LVd!Sf;H=Qrt#EjS7Aj0&PoT?k|D38Uk zy`36A_`K(`SW9ZPT3a>M`??2cs$9qs;ssi56OPY-9Rf2}VYh8J;F2Q1J|QDR+@>^l z73*7suUOFTaiG(NnTGtW=0cFl^~YcUnOvd0DWWiRXF z7pQ4EculhFV2Rb~%xpnRx%8E&*7iw*&5Sw|^(fso`cdC_j^;cqSa@Gdj8iQbq<2uih73K2q7G(K=7#jhpZKtEqhln_(gs|`3=ir{_KPky_s zW!5~nF}L#HI~_w(h5M73BLms!9}z(DeLpYx)m+y~!RTLWUnx}QF?xbW@FC-;2iPsl zo$*}9jzLC5_}@dE7Uj86$65n)+Z-@afnJEBt$ov>vnETaBtt{ak2{1s=NsKo{8t?& zraH)cG#N$_3i5rL6L|19w7YebOrRPL6B{HW$vC_RG3`?#{*)#w9hKXjz}?X0lr^ms z%vNk1;ccdf8rg!VdEyik+)Q48sEL5I{L3pqXX(pW`U+5Ot_XaVDLOUzIRkDS7HO@= zQc=sUD(Q0so~pZFx|Tr&HE%pm$FdsuC-bp-zQOlg{_l*PMbwspxz7kbzh160*w{+z z7@aZ9c5HEI&(D2jE@L?-$Hs1&3t7QWu3{5*4UTk(oA|?@zZ_Pxq^PIZYEert3{u*z z>BMyrc&|$+<|j4i&v<42go;nrZ$coeQuJ7W_z$Vz*0rY6>sruf{Xl8se9zGTdAViy zyTH7(vUqO!snlu!&|+g;h9V0FeZP1cJnrYKg zi+lQGZ$LVD3qNnl4c($nYXvn5aOZ0WShz!(Gvq#9IQV!dJI}Dm=%?vl(N;$W6Pxah zxlustB3df#D4RSzC3OB=5BF|1TZId)j^~rk$UbKuM$15&pCAWAwsvibmkcG5oaVss z=`;@b?n`%ygJaHo)vCZpvy*cV&Bmv{QLI-cz~NZK@=nfZdI3lE-{~}0_!VM0=N7fE zhx=reHk;wM#uQfFqupA|f~iS}Mr9gYn5(gNpq@Ql%>8Jz9g z=HPVenmQ_4VGIVu`^7>=xyu76tz{thY0k#ohEU_#MDG&ej_2j*P;FQ%!eAPtd5f9RFiZ2xJZ4l#qEw@d*$&SuHd)TLiWnCbBLG+M z!FGRf;t6RrU!M6BcD&+RMHN)Ju8m$_&RXbpl&;P*8WDq*3{nNbR-M?C#>vYJKWxrO z>7SdRqoJ8pNelfE`!j;~M%8(ozf>!cAy$>wy25v71~S@B=QK8Bzs^p?a0&cY0Ah^(YRvdVU_jAMan^HuSpUtOko8uW``OW;6oOrUh;3R^&4 zz+IkFo3J>hTVxAI#J4y`laO1tTN?7)tUmvNJwl=|mAcPPWt+yVC-eOoh2nUcYxioo zN>hK5{xo6bLrKKVIBV8@)WLv%%KJ%l-DZ(qZrbXEj0>3@Npf^lGh1X*jmjlS#3b3G ziu^=G`C&-R6s?w~f3%}r2GmT%#xbljCmQ2g{{}3eX`B?O7;I^AI0#B8hqSoH`S6{) z(qP9O(*%KVRvZdl{k~!?ubMh)_Ii263_su+%RT6K`?$9gc=!(BX|ss{oef)@vC4?S zbCl?FKpYOGi9V+&3c;kFBZ+Ye%5xf#06Ch3Ig*mHwnN_nMC{?&2^ipaM?|J9$#v*{ z)<`32JeSaF#%+a(wN2xdOa~*iApCv!^)C$k7k3h%`*>k#MmZ6G)2vRjAVuMno5*sQ zGN|@3`3%?gne@pB7)vVWpdtyc>;qhz2i)`>FLGfp>bPz_Bw|4nic`M6z}@}K(hX+w zoz^rki1jXA>%BPRO)H5ID~)M{t6EhdybRY#7{3KC4ji>=TRYXUhg?pN1IyPbE${#L z0_;#xWnb=ktFa}fJ`mFn-XMJ4ADs^tFL<4%lf9+L$`p6=QIg8U-~gO`rMzNP;9zwe zOor{;0cgE%(~e3{)rLj^zo$6cqEtZ#C9bI3BT9wQW(YjPu1ZQ)d%Y512`m3hjt~KNZchzyDmN zSEgDk9CIN7rS|be0vm8pru#}j1<|hkgV_RCkAn;(ZN5T#G`2+u0uz9S1DQlo;we~R z0G%zR`ve2plwZq#6x(64Mf;MF1Ero!y|@-G%x7-f?yL9usVKGv=lTm$8q}Mj$O2)~ zLpE$iVcTZ=i3O0C_rc^jJY|hK7@M`D!szNO8nJjB(Q&HN!u;f7h@&jt@teDUUfOCE zi?$NhAvprq8_kvDLwBpbTFA+K{%dGi6%%hOcN^}CgkzY`0|75gg3zBecjx%8mupVS zCum+`!8n>P@94c&xepvJ@EG!oQ`^f^Hqeb^915)}$JMlKdcJ*r`vc#vAWuF{VDZ=u zQDB59OEj1OJ9p=8&!i5ap$$$lw}z2QxGi9URCuAY-dI{I+Bld||2~>vaIRs*ro^3I zcJ)14JeBav+Q|q9Yw((J1KOB_qSdj((Ip-a+$TXwUnSMtV*P8w^I)>HvdWy8ma3gY z+l{2yZ_)`kIbMe?Zr;{?7nr7MTz3j3pZ7+=HHJAe6)f9v_&Y#$^9Lr{7K07@SPS)N zMk-toEu)yhu;`Ru=7ArEYgPE#5eD3NyjU%RM5>jJh}(%6zn81{510(T3*~q19iK}E zVmKuz2oeo?&Kzvg?5lYQ3had7WIkFw7`3?EZk=|;_XE3$*+BhUi zk7!1+wm6>0_cp8GbN26bqSq!iB%j<>>R=zDFpAz`s%sVGbd%iV%M%J7UaVy;^AwWE zsk^WqDv`+pz6dF}3jE0%QOfGc?SH1uPS8P_Uo@ae!pwdDe*RJvcwWj6{KFGw9+^>H z!#Z^J4so}w$i^%<8J?X}dFES5JaqI5*Yn~MDUQ#O}1WZQ| zWWf%6jrWwe@F;3Vg?G&_GFnK2DpEq{rcE_$V@d}VBZaSEO||&JAr|H0O|Mk}f2iZn zW2~5T&beVzJ_U;emyY6PtZ?X#1D$|R6eGEW{!KuQLl$KdD*UHz3KMs^t5}Q7c$yxN zkNUZ`NEL<4P?@70Cz6OR~n(3Ba4n^>X?4q`D?rp92y%E9#jL$i}) z3fVd7rlzKvFP>5vDGapbJv&^pa7@Bpsr!{xwIR~xjbdJ@Tf8N4D3nl2@05NzJjG+~ zh$iJhNP?h7v+v7>kEgSz{0U0SI;Z$OFn3@(K)Qi#mLI)G9mal~EJC^;70+BI&Ta@- zM=Nx;*zRab1xogsfpCLz?&m6OaCxyGkZ7&dlgF( zX!M8+eSTRWo}V6Qx#Z>NJ3>P*qO(()=OXJW^Z&jZjQt7K6vA64B_4!1LLe|MvLIDs z6m)?J_`->Yi>Wz9I{+$!(EAzLdZ>Ufj1LAr@UIpeEvD7urYvp+5(Tv|^*r=&=ijjn zynty*gXcGWkfinArvdC`DGL>ys8~RONYBAsAR` zI;-8JH{`sMcJC4kVBw72!}EYRxZ~g<9AhfaRgyx42kdzu3P!+4C1-5`N1AIjb< zfBat)%_g7XxB>E{+2TYzM~LW6Ky{v+mWA62mkC*f<4q4I?n6V? znErg54Qw6j=nr3_fUzdamj+Anw>R`Y#^ii9YOV0DbrkMLqz19NrgM#NYYB}#K->x`5i z%g|UVRI4yKC}0*De}Ix^H9{~KrQFI`B`8Qj8+r7824RUA@iA9c%7es zcL*2k4B*WS%9c|A)?UdV(0~6->ju5IJs&f_)RZyVE;3S9zRU42IQ+w&IG7V}@S(^} zaB5Bo7(J*G!&RHxKz5MnU9V^Zay_}?#lphgV5 zP3lh{|Gj$m0RDLmGzA?wSy>QUb5YF=RkdRZD@}X7BaYkzSWfU-b$_p1v~+qr=4Oi1 z%LA;gnj{cWM*@T9?|r|Z)98d`jA2eCXyD6uT_CdGXx45p83qJ{DN5phGcqP=zt}@V zN^>e#wRzy1ZjNrbv&RVsp-9Qe`CZnuap#AKKAqkEN1g73fxj##6Y7382R8lGILRm~ ze$0*^$noQArrYI8O(Teh^;4anLGoWsu6Tle7^BY9KKA!lfUj#(0q-ct2RS@CD(RG}sMNx2@+piB zc)dz;G#&s~2^Tq;f`gL)RG4QK5OfIu=h1*Puz)uFOukgZ3l1XfgG*=B?||`btbjsS zfXK=n{w{gD=0D9e#j&dQxEG3S!tnjWM(~*>OjU7;i7ib&o==?NnWaXTT}a7PM8_RXy`oGa|abK^|#iY%U)lw&n03%wHxtc zBv$UyuiE~mSwYz&0O9hHH^e|$M$7V;uVFd|Th+CxYUpszwGF7#en-Zxh6l1a!aYA1IL3B1Wwi>9j1d5lE}Ng7cTx$*^O zr}Do%WA^sa#y9_)l6O@-J(%YR$qw4$IWXkDzOVQt z?6KSpsMOtc4kz6#xhT}P=tPT|iruFr`4U9nca)3#$I-1Y{h4hK=!u5Gfpk52wK$3X&+#0F<`U znG8m1<^O1x{@UuChCM6X8Dw_!O4%!@JG-Mh|LmSUKpU)`(4}z9?(%R46`DryfOlQj zQ!S0FpLn$rtyivJ_{_TXa7iWMy7y zZqhzmcd{q(|^ziYc z@dPHcOK~T=_e53Wy{Uvf{@B1yRGkf+q>qlk-T;@>b=$trlr|6wSh;N{r0kTkMswvg zeLGEQw5zd$vkTQ2>Xh)c7VN|(u+Z5o4_VU0N&O@|Jel&2(^d{daO31WZNj}BBI=masVp%)$Rds%5~;36W$4O;G9Z^7VgXYyNqMUf2i_KFXP` za}8*uqR)fN*|^sxnxnm{u{SZC5PS>_h&~{Wj*glgcXv$Ld;iOGnV%5j^*^Cs-+*UBB>~kVQzNa8I(`MAtJ2zR&Uv|<^uFehE))i3zQ%Cv_ULUF zFr01?s`Cqx+o=bbR2eL*)hs9CQU*DqG`C;>Qq|q+tc(s~kr$gJg>OpB#(P zW(zOZo9VmZxL`zFt`QHBee4o8^0-sFm8KT+fQR!SktRc`fPgPni>M)JASL|2v&bnX zbfM)TCWU~Uhmp-QBIu%0bJ> z%pCXFu4W9C9E&+_1xo)?tCjNLRl`7ml<6+#^&G7f8Jxt0M(L1j9onnRloTF zRK+CGcAmck(U4pscTU3%qG+0h4Ws`-L4VcozO(M#3xS7;aNXx7%QMVX3SaLZUHX#! z%JJVN++aLdmxSWQ9EsqjAH6el6mKBRgD#BM`8Z`Vfsmc>(dhWEH^9ua2hrlN&FeuJ z2c4U8IQB*)BJ)?}h?I$vMQ=(``bQzd2q+de!a6O~goK2@<>m*XV?4jB6nwl<)%1|sGyQI zskEaVD3^{l4@KlbBjSaX0nxhOoa79KGMXgC$7#v3r=jxtC0`)3SSZBOs>U-Ce&VFR zXU*#k`}~rPBS#wl4*{pIZj}S}MbAOG`Df#9gjM@%6s$}w%jfZb|23gQW3b0rj^E-s ziPzh{JF8aCPSOy-L5$&}&CyB{gF>>-U)}e`T41T;HBcCD5uZ~pR*R(Uq)5!fbU;=% zAPCiZl%St;S`b<^k=Mwrq>Wn4G|+gY0bI$I(xh4~1)2%gs4k;~o=Svb&V^u-kgFOv zu<44FJPQZKB~q~%&M|&rV_d1oL2iS%G|6f>i`zpTsq5Dje)x$@`%hn(360d5NBaZ* zyjc=O$(s&EqQ3GZg9Lkq{$4fB+I-|lh4~nktaL$hZ_L}t%z|g)VJ7{}X*s47dF}_3 zljFRL4b2xJOO%GfMHk%hntMXmOT!YCceWV5RMvpbUH425a|5(^5rbDlzkBhK#x7a5 ziU^WiAcZR)9qjHh5C+St#(*9ww^^k`L@?AjbB{Sd&#@@dNS&e8&+Gt4p^VVJCjY@U zIU?xzI$x@cvu=iUA`Tv5mKgTU102XFS|ikX5v#U7LDPi|208rWlX2kgPKndk0PsKt z5*4Q6ag#?y!8gdvH3?V}?2ff1URBp!sMHHxT^IEG+>NVy-v57Q}q0Uhg=S zoe8d68aC2ke(|y8Y*4bTjyFy4D#Fl-6s-$+RE5(%38ga*tBZdW1xe@$8qE1#xfcm_Z|%n6XWqf(MC>4qu~#P=wGR!dtAA=!IaC+YZ~?15D)5<-!Ni>O*yn z7)HG(c72!E7!teIJ#)rldQl0UN)Z2fL~^S_g&rAMFwNQ1=d`eaiGjHpYqtM#rMePT zLZk%tW{nreBHF+zYRi1AG+hiwU&`&pK243{=|=3Vs`BC%?RTFs6Z?e14ATS+K|tu# z9Ip*<*@q(gY0FVkUMjuB(evs}(y%PzS8HB{TT@HYC!6ZMOoDXM_pPG*Nbi)%YZ>LZ zbwoN1`X|&1hwS8t=gLj!FHOK=a!1Fkaro6RK~Z*orS#Dev2w@#?*!rxc7uDA6QYgk zPZdwDjta>*8<`+(^2D85>)tBdxGo!Lv;(ZMgnroyFIr2i_K|(fFjvHWL$)m3;5Q;C z7K@b)>I6L-R*UJvEb!q_`(SU>mT|Y3tB;yyJ^&7f)q9IZN>6D>zX6`}ovXy-3n|}+ zRKaCYxaRKXwhdtR_(rw|1qSU0ZcOo%Z2C!b&o_ib?Bn)H?j`p;0M9g5t&*UKk48<2 zl!P)(KnpXc?{t}h!kCYHw(JHuP?lUAtT|nb2sw8#e%|Ne$2ds1-QnIOqMhkt_TA)F z1)AmCE85~OZm>e-UHCnQ6LriB0ms?Fvvr0*9D}B2$^QrhlC@=4A*WNy27Y8o+k%&f zR+9AD;Y+09-V--_-tN$8)>gl0?OH)@p+sWfxmTrmZ@vzW{Fi`77vzivQ*!VNKGP<5 zX^2OJKX#)Ru)@P*Gn&DGe^=x6H$VtMRk7Dc3?xCBCsStq3Q=yPNU-fUUHr$#nN$Xe z4Y%ZRfVk0iSW9Zc_Ykk}b3UjKoP!Ck^4youJRsYNnmsyizi#*YinPDucjn0PRu_bL z(NYJw33@lz(M0C*a7GhCR3jbCPh<`BF?#9~XVOlEgOmyF}js46~Q8XWY1bqsm}{S!L$ZfxO}0 zgIvFdal6SO9c+ym7HIXrZ@eWE#40F&1xD7KChO-gtlx%{%yRdKl((c!UBpjMiEHI2 z^f+NP;-K6V1$;t30xXsHS1s8Jo`9<|?w`Y|n%n?^5R--Qe{oPvNFx=Ex^JZeKkiCF zLUGrUW?!PCVdGX(%Ne@0huN<$yKw<_<8GeY>8Qz5ni!;=qcV$UmLZ-)8 z1A$jDV(^n@+lDmO6y*E^zq(2bmE8s)TM7^x$HaoxmG3CoWo`||nrm$;@)Yqh9m8u= z0Yc3lA2>73qOAEykE@4uZn}^)jI=Ey@gI{h0qVY(t9u=E+7IMG0iir`3LRtSeDZfj{cB zLiNwrimhpA-n$*+p}xEvTm3OyM<9O29`Bh63Xmjzuz=*$nmoDa*-iSbE8GQ-Nq>jG zL|^+wfo_cvA#i6!iR`2iG|jL&x;roL4S5z7jJ($_%+bCgRC7J#>;lAor$@pPnDXos-v+NK?KR zQ*%jtWwX5>OG7pkOI*ND6|{?L^}3=o`b^!6&A<<}K=F08?UTFd4p()zt2}qZVoQ_s z_$up=%jXwJL&)FuE7A1y@2oJ}#A<5A(wnA3F@p*c;U1h2_ zR9iLUCVZZ6zKMCcTr4G(Q2*36)u@=dR(*F@P!cFrz~ge5CHHN{HiZ6Hg)L38;| zxjuQg)cTyip~xqSS;N&hr|>Tn4hJrhMVTL6rodyH+YGJeu`ieIBq~Xe-a^vb<+T0z zSyqm5`o48SYq?c?+!-?o&n2|&8I2eCEiT?`r};)-qALTmRja!@$)w<#bb2Ardzg%n z%4T~1{!mgvr8R!9T+$606t1~A&8NKd+t1DcuoTc^ z1MkIdyAsQGv%VAF-GA8;(*EN2gdRiMM=zCN8Pn71)T3Xh@jJI^ zB?ila^R7)5A0kXhIH2~Mor{f)d{Tq-IFVf?X+poYTt9Pyu}&cXV6gueX~}sQEqt)nO5>(H zz@R7ian*EXu}~tL-ZaAt@6h5=L00L8cNuA=u$iEC`0IC>z8hKJo9UOt?Cef};O-%& zTaG2hMbux_ZLzRtOxTx0Kt-l^TZt_k#z5}_Xwd)$8jQC>djtS;8}pl6io1^?EavqA zRC@OMSDSOZ-~y69Wg|NoS&wetUxEOt1<^qtr*A3-{*ebnMMA?-@vdzNHnlKN_`KHr z9bXb#o@@^S+^Qha;&3DmK&kyr2>fjd^o&5+Zx5IY{H1husfV+vkXtz%*YQ^Q=Q&L_ z9%%jBJH`&C+3W-?mtLBEwsdYeL@SB14(EEeYe)1mtRsP{l<%ng8Y z0V5Y+u)rtq-qqFR|8e2Z9G37*t)9slDgpF1uT|1Epw6=IX$7{Cvi@A`< zVjTBac*_uc99llzN?wTR80Vq3m)^g8!D;<>Mt~@#2FwC)1*Xoo^lxNy#E=V%03qI! zh-QVDMUb-f>sr+UH1gFvBM%8l#U`d_T^{d6wM9-rlc`H@e~c%0s>JV5N&0Q&%7X*- znL_Dbam+|0x1PHb+arq${+E=3mZ!>!E=?eJQ2|BF19m4xir2Cx*g)ty6xs~X8{WLMV5Aq>C@9H z3l$-V%3*6rQo`W&6gIUP0qfA)>@KgjEW!`C4}SKKdy?&x&vf;w#-5L1Z&t=X)!w=R zG|nOoHWNv*D<{=?8^1IE5K`SxGx@vP-A38i-RxXzgQCOpgp5QhbhxhHW1VeJ>!!7{ zdCVrpdg|;LTfe?q%(N#RE){Pw^0Zi;c1iZ|MN-e)XL>2V4B9rO%ijtx7JXbHey0sQ zHsAiwL3Va(Tz}hlQ@}d?6Wzo^I$MXW?n_Jj&GvsVS_~RwC>1c|2;Pj2>)yZ|B8U44 zx8m^5yfd%2FmAt&z|ZC7H1`i{$;~#0uiJkmjDGIdzfZb%r@g5Is6tH$1~vocUb$QX zI!{v`racpMIRe&qvKj5l82QO;7xKXQbgYwP^3|U%tkzryvr>pESqAImp*F6r-WuMlkQ!>}?3^1*fL5E$#^n#_%{A!u>E)EQUN+N@klY zE-q#R1re6JJ_eQDawYonRU^j9=hlSZt3W>6IVbeBKgwD?H=xk?kSNSngVEBPrEk2g zDcuW8nf?_^<*3v(|C2xEy{2y*<7fZA(4a2xH=5-$(YM6{fLN4kQX!kO4+3jAgKWPnk4)fG)mej2! zOWki-4~BD&JhtBr0vdj3ah|)#hIgFq{{)bVk6crid=^`botDd}0$iqBSN_K~yB*)n zoIZls6a={RkGo#KIT))X>-@bK`vZ~Bt5gH^u=QB^vXsx2CwnzZ&`kfYiYr7pV|HGR zh6sKC&3pT8#Ac^wiYtHyfSQ#iCF?mHJkR^)v`KJ}p*OeQhGOS2`|7V@aX^Ay4=% z0EC4s@;7Mpjfu~}Ff2Q%sDhX*8ux!0jd)zO7>Q* zs0$*!(EzOuN4|)kdaQLA+FXC}+=LZiY$Qs~VwF>Lv8g=AMy5ejFT^^fsnaRsBwo`T zu@}Z7k(~%K7<)ic9+_d8np@2p=0pap^E|-WB*1YWDXA>TBTfHO3?+Rhsngv2lFxWq zKn4(!^%;*YnkYm9V|fKnJx(}x>6wEyuy93~ufBwtjh7zbeXAI5*-h88Kp0Ipm{?9;c_P9hUALy5Zz#xXe zgW|rj`U7Oa2t@pmGy>oN5S2QEZj^uiHaGQf)t9UFM_{a)?|qUfE-wD>WDv!#KpwC$ z(W({^PPymAEe4B0WZ!&}6vlt6-T7Y#SXEWkcrb>sBl0x@`D-4xGbuUzCZl$v*L~b;%H-+K^2UX!kSS%c^HgD%{&X6> z0{p%qBf3ndz(jsk3eX+(w#y}Zv8E-~IuriG_-}eXBUkWH9pK`2vK%-aH+)qEHHx?y z4x{r!c=Wjm{BjH6urBK=de>=J*5>hy_nZBX$cvb985n|-NH3nbeBGiKieZYvZre^1 z5A$#ev>!I!jv=JYvwiIU7cIL2kV5GY>8kGl(v_g$UDxGa8dJi@yb+LOU1xZxl2rpq zt!dj-ZImgr^}-lsvTgRf7U;3w5&kmNLh^B+I=|dJZj`InC)2t=Ee{$f&qSsxtFpXAcRq!_2Xu<*zcO2=WUB8zh-_F8;p!)P6 zLCBxja*d9+hG<3c*yWiM&XVCJitImZ$ok(c?MapoU)$pIKYCrcJ`HmBtDzJ)H=0h< zxF`suKlEBI07V|jv*2_y6a|4{6?g$`8D&KC#x$HRYDPO)iRDbb+b-22^Dk=rsuI30 zSNj1w{=c?uE0lS+f%~8D$QX1#O(q$y=Qc0SxFlVMF>;Ui-1`r+0c6(Mg}aW^bT!7` z!touH@&M<~*l_}|uv=CQWVL1{M%;##WE6}6 ziUl7#O@$~*xLoNXMIur25bnjJy2)M4pZi)osg7Bhbk_=_%)pG9&U&1d=Y1`A&i^>Y z2A0;@3mmF65nBx44xRvK!1)igq`s;HOm85(c*Plovzuml>LQxyvn3@tWmMu#1Xe>V z7tNwAX_6{UD%}v)M*&3Sfli1XmqnpUjG8KZ?ATdy zLEpkPdzo|~hL2X_f`9c}Q{_PVZb7T%n4`1jZO&+`?h?AXHDm$%uF0B~qyg28m*4xd zN--au9Ivlzdk)|2R55&;FP9IT0sc&dzC--My<$wIuF52C+V@lv?(8;%JY~Fr4kfxX zWfepwT4#-F1$pu2EE_0Y^$xU3H0wC>tbSk%{-{AuJWa{qMK@h(X-cZtBCUTpn6}_{ zgwv}$8mW_;c3wvGhxvmR^~QTRu#hW%{C96~9CG^!ONHj~8Y{OgXj8q%GbUgWbbkSN zFVG-?iG2|Fey%wA1;Ytlif zRol7{@M(lA#qiX~)!S4XmeHep7zorKt&MyR7|$mikJ9|F`@qS_D`-oQFy)HulH4Zn z^?73@a=SQFWQ1qKf|iweagFb)`FJhhy;d%QE)cWm6b8bI(bS=lXkzh1vHPBK1#b18 z@6}CPhc(VTTfm z-~Dr=xq9<=cs9`cxF^5%(}01;HW>B2I7Q92$fmw-rY?@ERV~q_%*a zNv50rbyi1H-(%4oMy-cd@gEs(ib}2~uo!mQZsx;1xerQK_&w%Y#MuLSF5?ub;}@t) zAR*k#9J_XmtpT3}yO!htAYTUt>NEuSLCp4@w8J%Z6GwtzG2H|;CEdVTZDRC0jg<7F zplD-bda(4dMENT)vZknSP>J|u{YmBv)s6O)Z`QnlUNAsAb z8MUcnr&=m0CH=pUAaRRG<<$e7v_K8Pf6=ve`-*sNrwa&wzy#2}xlTxo>Wxgmy(bEJ zU<UPZR9}ITr=iT(hy)*-R&4h} z@EFHugjamQ9mlp)Uj+^cK5fW&LgdhC9Dmw{wDo%iIECX(mPh<1N)cSBV2)rwj-nmP ziwv^tSs8Zc`@H*vj3O9aZp~1~s(HFTWzuZbmtQ-+j*x!eY-}b2TbY-Sf9nZa=x9et zT@R|g$))t}kbF0or&dcYT(9R>B`4?tEW5*(j6g0%rb~wt*Cb_XzDV+M7;6{n{&57~ z(QWGqMW3L>i5V~1rYgGZ{MED^#x|_dh_>ha`?@l2d}i@8afB1@h-?8Fe!~~drDN(e zf3cjFqqLfDb49*Raul3T z1aGm<_=w50oS6t5W=v_i#eDe-E?#t?b(la-iwad4U1uPn|7UCH6{Yk*^i*v;t_=SD zL!^8{6LU7Bj}ptY%$#Eew=DMsqfO7y-xz0DsWuUt<9J?M0eLT)t`;Y4j*{T;2QV)? zSB=D#sUWcvd)vVo{Ql4CBO1Z(5| zX7$^Fd+tGr#dhSqVbloZ#Zm|<^8^*5Tmu@5e65XadFglN!~?DVStv}?2(wNyzXiev zzyv1Wbn4Uc%Kgkq#Oo%N#2RAV+VOjomI_Mq^z}7s{x2i}xY$5Y;S+%Bxt2tksmRm%D6?9StKI$K%nDryvg*n$9UdW%cFK5At zb^4dm0fR+=kgKYD%&@qNs+4?H0j`wno+USaa852p(Q0PxrE#-j2V>K-xS@96D_-o# z>;$uUX=U#07;+DR}RCVuvgOMZtq(X-%UFi*_V?E1V}@mk3+NV zB0c;d#g zK|}_9ktbffOwyZFZr$TcVHY&w6|~JO#;5w%_5@4+xj~Z-#o4lFFQX5p$DGUA!vM37 zZC{2-Wf1 zM?d=s3PgDxLhEGd8%`et)6RUXKf*+$;A&sb-h?{<;>h3~<6!LS*QLLCNL2eHMH^pi z@y5(ay&Z7qax~^djZCmLX`R zilIIW3a$W`Jh$D94kUY=c(E~9-qJDpLb&;H6V>b7trIWnd$X20Dpwb5?KOeKGNT8_ zA$`iK3Eu`aVj6q^74pSO3eOQk!v6_Uq9*h6Hc9i^f1;L(?#&-bxg%a^T*-@uUPL=M zKBdK+Gk>5FnSsxIcGKU$2rpK`i?KVa*fq22`zE+)(-#}1aa3GqNF}2slZCx-T^l+K zhY(6!%Mxtq^f9d9B2y_FE=i-T1i1Ii=O%h$lx)ow%JVKP+qc#}ZiXP@d$|Tm@?mW9 z<1`bx+(BZTRGfUbp9rWKDypW$b4U`_r__w*6AZbsos{Q#CpP=7ePaw?*#FNuG>`m! zvg4@YRKE3fhgM8*Y*@OPb%vYZt_8~{oKIq17M%AoW*#tNUTQgu@6g?#!9C?V+u{vE zF~-{p8|;ob>T$_{lUTS*$U1}fSw6`s+(@Z=s(E0dz*x0$SOF}ViWX_jnq zZFB$2GOJ>7)i0-Iv**O>RR;=asOx?2y6o$or+GE(&ShcerG9Ifm-$|Lx{5RQ*0uvl zx(rG`I@DY}H9tPsv8XjrCA4o+WX?=8{qKpvfd)r|8U0sAN&tt#awp~83w|{Rm}v4C ze=r9&C^1^f5*={rMoWCU$5(Q zQrIL`(oB^7g4MGtd$`OzpKpyg4NL_2jT?%ZE=_fKc=JS1^g@rQJ2Gz97DmC6v-MFX zhNx9)c0MbEy~Pjurk>l#W&d^arRzeOlhz&e(!DH}!M%kwZ1VxXpO=|d-&}BhE9)($ z+{WI>1)jSMe}BE2+qlgkI^p^{wan{HK-L1?4T0Pyp5|Ex_wCcY0Mu*ZxtnhbL`xJ< zOCa~RuV5_;Ja3gQ0ISHk!sL6YH)_NBe4s_Qfb4b55JMM>WlYMu(o|auG!XuCw3;bZ5#J|-tW3=-T&eKu+QqX zcXxI7*;VyaS3NsI;gp`~ag?R#IHg$-OgbDuN=Fh%LL&S#aGxFk z5k^50?hhM9@?8;4hhR^KpRM}EsrjN_x95YeSBDk2(B^TJ_!|%$ z%=h!Ju-U5R`65TlIiwvJAPXkRAHtrekomVN1_s2)L2uL59GL5?rN}dzn$#KHy2Ojt zn6X9dVPV_~@t5gLdOAI91}az@s!86>b3bkA`E3}(FK&7qLc|yMoF8LzE10`hs0dJ+ zY2~8tU`9V;1=oGY82#LjlSCDXN{!9Ig_K@8JzpS%>X7RbD)FJAx&^YA{$U2)20e2O zH2V62D|kB|gL{8>MrBKRpPzDh)y*TaBz*z<9t{99e_1lahY`|6Ov;(*=GoSB=0= zBTAXb=EO=j?ZMgdc3v2F4X=Z?KFO!;z55OhXbv0)W|6fNlpAI5(k1LGCCsY*_-t@H z@Z9Ib#AU3|zg3V{sZlvm%vRG@-dduVFPJG=Fq}1AF#c!GZopi`S-^S7s>s34>co!H zDA_d8K-;Zj{xMRr(q(Rl;rOg4VdFsV2 zOUVkU8d;jQ?0CFXtfb4F9j9SI3@1)Dx^q4I7QYzv8snT7pK9-Rz^2G4aIautHzFZs zcDF(MAPwHxR4Cc6`3oW!FE)&^+12In0a{}cx>$UrcOc_Avt4UhOLH}in59{{k_7)|ZgokduZ}jQ7C?k5gFy|7B>OVQHQ$AL2iuW-9c%YaFIk2TekdGd?_qPpD% zJeF-OeXW%@lxLhs!fnNcj?d87arW-yM8Qr*U-+xqd+NgC0RP3MdyjF-k{Y z5ozapkqy!Qqt5iI*PuA7f~A(PwxXP^c&5TMAHLYMq_k+ZM7qE|tGkprH;l{oql$Tq zIfl)Fm7PPG`KTeUj;leZHKUi$@?)UnU&{#N)aGB|OZbIkxnadp&m-qllBDL!Kbd*F zK`;TsJx3)=2~UC3RaaKMXkX^w*}ts~Ocl_m1i6?f1e?BB(Rc9_P~DO`GtP_ihu8Q| zh1@T<;RiS{-neqgVK`$X+eT39N>a&h%D*_{r~Z)}my|HaS>G8CHt*?N%S!e}Nv_W5 z&z4DfW4+q@*m(~PJO_r8g&8fNUn&*MPBui`PW?$3E25QsNQUWPFF+Y3Vq9ohC|=|> zHpP>~6W|nhsm!BkSm_aKPHv6vx>zbacpQ!SoO&Ea>74E8&MA9je)9I?`S+&2mF;`a zItPApq%z$KGaP0aX17bACmD?zGZ8J|jmvq+VtXsS!@dN0GH|(nu5#qOBYR))c{@x44T59PXWdAFXFQQj_^?=+XT)bl1#8_->X5SJs%g- zIv5cmQ*iIkKD66#p`Q#!aIr|!;7r7J$ho*%;Jx4caA^V&MIX`PFu2gz(8%CwQClz+ zF+xz~&}GoKNH+z{J!*pX0i!kv`bBz0cP3^gOd~EMFf{ixddjPcjLIR37)sc4lK;B$ znoB-Juz$&m=#P<1GY{en{2ZJgv+nl>Dot8Wyqj2p{G9?$sCnZ?|}0WNqT%A{MR!MQG~vZ_5Rv@0BtNmjnQ zGx#8bAdN9rNZViWVJUh_j>noorxnKI+#%vg_Ie9l5jrFuGn7x2UZT+mcLyP(M^`yc zvl!Ik?t1!2gRC4w|BG?Tf>B;^%~t0UnTR`QZZk>%xyRI3AA({=F`yr3)gU!4bSB9D zB0Os((aPcs@vGG#S^!jQzYN@u}% zSB+YwQ^iOwD2a}jgNa)EhSO6bqOMYP&y6H5@Q*oB^^ zkn5N$<$JfJGwA*JHXl2hYs*l~fL+5;gJetZ!~4{FUGwsEoNM~l*1xfJ1Va!9W<~<` z&0nAn=92`=BmgE4zYCgf8&VtvBk1JsxrQa!dcgeibH^b1nTpG_2tloK`yt^rmJZUIgPHZ~$FA_wgbof^$fXw@z8I&nW9 zJyDPPLn@SXjcPdVtDsF-N?cQtQe;8GMxt9LQFvT@Xmn=e_gLF-(sb3| zuEB)q3K$ywakJ@PLz`}-S)ysi$&DdrRINy{uuOqZ4EhLu8UCet9jKWz`PWgBiN8bB zYTHsE!zg4O6)k_hrpvZkSL$SYmy6UGtq!)y#7pCtHo6pv7 zNf4XaPsI&N4rn0oOz%!uPEs?VsVSv)S5;c4oO50H5NOpBa9MD{bR-p)Y=o~b@E7oR zb{h(;_LTdwf@9Bo25jIY7`(-G%=Fv$htF0X)f|XN4kHfmY;uK9|3Z}`kZh3I>>^AQ zPtkJ>qi$r7InmRPk-Ch1YlbQ#o8663T5@do(?S~tGm;UiHS9@yZg1?JsD@y17ACQb z+&EQOb4$G_AK?k}nh1>ua}u^_|3Qw)WETU|)si!xmXeFwM2ZBB-6ez zKpJ2dC@i7}Gy(QToJWL4m_}4i{mbo?3zR??b(F=E5f@64n)+@Ul-q=sc$PTT_{5|ml|0n}_4Up+XA5zQ zpB_R7<)_BYwhwyI*cn$%EzaRC?e|3wNJu(J#?fO@4pdu{&l7|Uw+vhQhxN$Ke^=_) zhPk}$Rb0m$J_8f%qg^uZQSZA>n)eG2-ez+7NFe!%ivs?J&V-1EFo>o7MAmH#UyYH9 zI_UU^Vdv#U%|aT%(*D|FV(Hf53e7loe>u;8cYd-S_xAo08L~3iK^bQHfH|egw$PT* zrnTTHa&BU*I`@Ee#L@qVKzJ8><&ycRz?Xea=Ye&vV;qhI<5kbY!_Dzr;Z&2Qcfdaxb`@zSDEOJs8Td)t+R`51GkDA3^=2|`$>~sg=yepElAGL1_SpOwi&B9i zhkO*H6QdSum;F2I^s7|wRabf23ztWZ?hc7NQVLv*>c)-bN2sUBG4611hE+~| zXKKnNZYPh`ajrvAX~#d@P8f^y?E2QmoKf7)7wwE(79NcYVq(syL%~N$`N(l|0bx?J z6!UY8ysy~a%FH3bm*+P;VYj1PzV1L5`Ll&BZU`m=*evisG%32v1SuhHHFZIkb)Tqiw{XPuPi?}#7`h@c38Y%tln zTA@xSaOHg3FmYqO8$H@z;bxtlc%RDJ@|a>x-Lvo97=sM*7w#i5K!p_mDE?&vCK;eI z!{R_90CtcS9tbQ~8zlS>+0{_>|5)NFntr@b3W(Xt!)ECI^^FLY4 zu=D7k;Z|_Jm81R>&Kzv@`hU}uQ9>f_ETYep;QZgbuuJ#g|FslkK*Osk^W<2d|GR-& za{}>SD=!6=IapgpDANcL@V^_RI&(1pwS*W*4PaYS{A13IYI$jQ*kBoT7v+EVs4&S1AXrSudE9SX!6pXO+npt27SoCqqTfT1$ zC-JSe8$2c>amK?jC-h|ApD#y+;?cnBn-TKZxYR!Ri@@a;n>7d&J`(Gkl$21~9Psbd znvqxx-x-;hrfcG8J)E7zNe*&9@2M>*;ZVy2+slYVe*KE!FN{Y59FX?m=fXh;;E~NV zn#=R7JZ<@1RUYk+CT5+^mnUX<9%Z||yGkTjINnQNU-zRVJ}s#0HxIw1up18{X8Z3p zMfu1*TFjN8H98&rGVzkmMkM9rOl?#$^y(Us7kHsC=d|0T7rYRARtrs{!h!TgW5%kv z$~H9uM1WBHbO6O4;UR|ia{K5HCf#wQLOye|y2r=s14hbvn*(`i3X}en!$ca(PqIGe z{pP!D6T8`>2-q#}J0!$14-9j_O*B4dN+W^G*g~ax;h&_*Oit?0Fk;_rF5h?em;uyj z&DrZjlJ?8)Cq0wj>XK?i5WvG6l|uv6?;Nv)lhV*90S##e%usMbAOH>+AE4F*Q<>2;x`iT#isFTcB_sHfZ{u zw6rt>Qj(aZ2n^~|03N&LzEveU4P2gJc0&TtWl6VGImdO?VkD#1r3<#r*=2&s??ooQ z_-Dm8V&dBARpno~0@=@{Ii9psRM4D^pSz7yJTl+)N;w0C^XNfFmJ$*bfr15K&~9m} z{5&bmJs14o!99l?OC7w}P8MIs(~EbN4>jD!Q+j1uejNbIq>T=j-zW=VTxb(JAea zxu^sK=P!u@GRTt0!H2WpnE?{9L}JFCo*j#kwSAEr_vIM~B1z0``oM=ueR`c*+8xW8 zh;;gZi68JvvjjIgM%QZnI7>Xy3V#1HV80rd8SPW{#P?JwSY;<|14}OHs*CE>+a!Xvf1wAf zdu9$Fkfq!78!i3^iuxg7je2@F<$#`*fP!VLnaGlnVqArJ3hUc9)WQeyYh|i9DLp4P z*rXu;Ag9MoW0N4EYt+2P`f^~pdCn*wB$rB+$b`5Vl#pLCed>#bNmAD%eWUqw4@jw4 zSy|-;Kb#$aKO*~b@)CZ~4KwGiwc0T`%L^Bz*kT3q%3csNwrDkjrPS=u zm>EMny-v>ZcIp_ew(INbMKb37#X1N;j!5rim04^l)yBmYy1~G{ti{thGRJ9(8-|HN zKqqp(ut0+jF%|=*^;C&Ob0pPZSQDYA0tP(&xTEN zq}d3vTg3))bq=lgi5^3_5@Wq$8Z++jtBAhbS>1=-|Z@=lBoagn#y-+M@ntuR!__ zR0u(*!$ELI5@@CJpBQjnkO5r$###9f*dWnBJ%u5c%KlG`E6C7R|1mfG zAB2*DdIrJPDBAod<{SiQ|KEio?m(mI6t4a!W*H3xi4y%I|E-K99MltutWCW6KQVP6 zlvs)h1vzHWQz2AP&;K88aESmdVL5HeaIPV86*YQfSl=&%>rGXrHR{hF zt$L$DkW)W#Y>y%0_q-XzPW(YlJDmXM-4V!3e_FbKs$*8v^wtvP*&gaUxC=!Vs-xE69~US7=Zp}Fq%MV^f{Ho zkB>B>g%aAB)p1-9Sr=~T%0?jQtAlQ!oTyG6+GE%AawtLM5lo-W>qf;=+Vg%p4sz8b z2Fik<7{KJ{JP-$pF{ zd)0N9?Y3#L+2x_h0HE`%n>+btjQ|h-`f#=cLiAbVM@P$t(}heDm61k*o|3n^oekXNiAO6QKW=20+TnsyutA{D&&R zL`!=BR*%1(**ZvFRAdJrHfJGQh7Qo-m^~}h5sUcOpqr1QLlAMFKsl7dwQEX0;Bj{d zp45UnZs8~*68Le>x#itI-FewzH57%rr02!(V;zPY^dhtp28V}52eL%`jEr_C(pe+? zZbzx9Wz+26E?Pyi->tWLx+xZiV+CGeJ>DKKKt2oPtWw~8huMR)MM+ZpN86G)UqM_5yyq1Oek*eoOgT;7tJD$okEC%*B!s4V=_*!?X$ERM| z9ytr-7N0iUwm^}FWX(+uiRSqV_+72v#~BE<%>|*<1s>*=b!c>8;%e1}HCE8)>I_9| zmEQ-ZN#YX_q5a-(hAG86X}q066cOuC%a~&vA-T!?x#JhPr&pLQ_k2*?yD! zxb%gLVUsiJYJhwwC0&Q#UN|2;5N_egV@MimyDKbs;JvJw!QuIBgwgLg3JJ0^Gb792K-Lf$i;2w)r{}&CQmx%uqu;AX zjRpSt_^1AB-*olUX}d1~28AdI=TBWOyo9EkiMtx$f&onz*#2H*QH0nDEnQl0r{J`_ zI2T(bDl3a9p*5h0r>gdZAfAY{lM+#(U_(>v*+Jc{&{2M7;u{35&l$cs`~7h|E$s@Q zZG=`?aWo>4S{ob7m66XOeth9Mq zb2uc-mHkdc))`=^r~7js?$yN?6rJ~nBGKjA-;C}`8jykCuU4qi)d5i13@+fUjN666 zQ7ic>?R5+!SW~zENf39xU3NzJofN0O8^MN2^NAWJs8frUrl4(`W})*@$I;-OwQ*dj zddXQbBJ9l+huC=h+@XlDZh>kl+fd|dw{Y1TiiQ#;-O}oeF(bO9(N!;7Of_#8v3>Bd zUN2}HvMS`e1Z;jL^GxTzet&QZGqNu27Jcz!N&&3Hmo9_1I?_I*YZrfShFCmMQB+KP zH~v7l4dYQU|GkvzL7w9(-wu}iX;>e0#Q%>IW*rS18^+fD&${G~3v6;^_luJo64q|) zLT&T<+=t})vAMZ9(=J8^hG-W49nY<#d}0VL1qN^m3twMff$zGncbjUH8wU^jGj>|( z?9Li$He)4|T@e37w{=3LNOh)d%v}&`hi%e5E$w%cKGh-kyBK zMu9`ooUmfF3;p@FkMGUZ-i?ItkySyWE()jOj_nJ=t)8*HWo1oNrQJ*WO;53eXQ_V9 z8is}_H!T0)NDv4u^XXK281m!LYi%_bW`+=s<3sCz5VYZR=~>gQ42D%UCKW61o*+hz z$Kz5oA#Bx zG%j6b-x;4q>|(JIE#_x#FQoJ6B=hJX3jyNhKB8d#Sn>cBul*6UGOSJ}I=ZtN%O$Al(e^$3sQ%w6FXSJDryH5t4#}+VC68A=t=+5TLTTz?(vPWiKO!GSG(I z*_HCQ(fl2@F|5?_M*Q3j<3EjUdG9Fgh!TcqY?M{8nNrF_dkJkP`EMZfVBZn={DDv5KB0y;k&)ep5>+$ zFM1h=vf+Yx{s5>B=~a?f=+g(X@ya)P6#sSdusg>up=<}HyfAFyf6y0dQa1du6AZzb z3E1YfeK=?=b%>mpbt8%hw;1l}2m!J3FeMlkxWlxM#|m*kC$qx*W(8bEx514yzmLl%O91SjA>M^AGI3zU)h2C!MNcWb7%!{^Ybr zl2f_smsHMxz#X0K1D+pK{j;0IzRv-LSkDo>2~xilXsySSn8Ii2`Z5RlO8p~fxh;i# z9UEDyAlc9SMHrmmDe1Y5o3%CbZPr@AdyTC&Ynz}mXr2P?85e5=R8gQ1y>~Qi8Arfz zIc@tK%G`ows1tpuY$0Jedr5jV@67qE*Vv>doyu}y2o5aif?pj@u*&0ArgiTp;&XFm zD%uj^nnDU=q9nnoK6)t5R~o|>V1U(i3^Fd$TziOSZVnXAm+LPL0VqYeFf5z%kx${NCkYB^|)K?ZRD1+<|T>Xt;U9{6X7zlyM z5%90DT#NizGjEl?Xf>DGbqw+@dDxX zq&svNVm_|Gm6qSYV|V)=;jZxJ7wrzIeLx`%<-FD_@n*0T<@@`QAhvDDNF8x=vA(to zJp;_dV7J1QIn}WlC)Ek?kwBp-n ziU=6yrRz!6VQcCA`5?$#iEs5> z^x`{GE3mL~^c1e~8M{7KWu|8~$nK$XoOoT&4P-P4dp;hukKq95M*LszcYZgK`r%R4 zc&`k%+M<_w7J*lqd_)S&)n;4HJuLOsD?h;g>QVW?L12G{r9yn_1YEkry#;SUvnKv^B();-J_cvEdF7$;aSxE!h!SnIc zI)o@UED10-TT8Wt|B7Mlr9hq%j%7v4!PJW|X6W6(8Q?SoaOV4cefEBRT!G%|sT*DG zOg9C4B`z`UYdZDv0&{q))e__Pv^twLj>iMxzK}p(U}T8!w3RVoXAZon*@jV$dRmnp zWuGtw#%6mmiOwa%8QMM^uw?+2M5_#1;K6h!sIFR}+8zBCp<&exXRhp@a2Ot1F_kJr z=jyalQAx+b``+-H*?A@*_L^49X50qnF~%%|Wv|*J`d{2JfBK%!SF0FEcPu~3fj|FF zNj1*=7qH-)o0s@ZOuhBn)cGiMJo|Wtns>*6&JpnVfG{ut-dwpXE;P4jM7~?t;FVlI z!_ednx7Sqj-K5-S&pMI7G9&WY-HiMO@+*deV4z#YUAiR=rF&UTRS!n8t&iCypViB-u*~eTl~~(; z0;8H6nWv;5Va>wPLvFJUdBvA>oRF^ORa@-G8@%bNtTZUDn;4D1P}cP!cXUuIBjUB0 zVAUHL4jHVy?lmq~vWEr+O}XZuzpK7~{H;3%QyL{>AFejrKWg3T^m0uck|X7c(&2&B z1)r*ZY+OPB--N~)`b(XMo05Cp%}`QFkgxuT`7rj|Hxv&bE6cc}cP98&#p;0Mx$y7} z{qI8JKj`asvQNU09kL%=BbKKmSx}U5lN2NVp>7?LEmz-b}{{$ zsgzwXUt#Y+waip8TyGzw)XDnz)v~>ujkw$Ic@OOYP@k^vL!jCOb6q-o2IYQ*8`je& zlp3^aqpVbi#D3RS#EYT^oXnL9-V9*yDY$F||7;WHTieG6GJp@=alO#m;Bz3g;$-We z>uguF;Bx}aX@uHwDCW)0giksHS=J1S=^S$~Lt6MVA(HkHow^?Pxj4_~Jxe zO|2s2sj1R!$^PJU00elP=OLp(XE|x<-L<9}Itsnnhl#HdVSjVlR*3b#52kz&b`bb) zKOiN(6h8$;zH!^sip%)JnzRj4Y`5-URfZCcqK^h!IaIGPd_sESh!ad-Q%4GmZqb3?rZ71PZyRrD0Jroo^VCdlk7H|%L`p1(tRx(tk0nS^ z3-FAB1Y-IH5->mvo2{!X?@LnY7;3{}ldHeOfesi0L$~~QQ?zU?rRCSRNtynHt~|v2 z9cK?qxyy~bmY{R)1U#_YzgpVg(60MI4GpJ=Q9YL10+iTFiU12n03B*Xnh8P-#r$0l zLK+g9@auysSJb*%pD|#~Tee_pkRLK{d+W5R9`l_8sb=EHB}#?{FWS!=NPFKluH01z zFox$e^t@?TAVkXLN*JL7;za!oU2VVP(gf(S?*N&BEk>tGS7YlA@v?0sfi`p?!_hwG znJu7f)N=#B-eDo))+}AFbBc!S&P9E}@h3I>ES|j}8{k;0PuMpfv$(j_Y`R zYQb{%4WaNj@d6rw?a8F;v(fh6$)R?L&Z2$kLVZ9=p*Fc+Z%x8M7}C09FxJ3Ui^mKv zJV&_b0*fe^U5@eY-~HB+B85=-16Ad!P`)PL&17c3jjl=9*SGQ>F(r+IC!SWNrF!!C_OEq-6=B zbgVn2dz8gXLS*&=z(@vmgCdgl!iJ(7lPxP$mh5}RdR$7mt1c%?0zyKfi@RqbnwYjY zVCEn^b@6(baJMoix}Oy1=#quM^V+`A z`d#$b6qf*@17?K5`~bmc2TEl#Q_-^j3&r11!6+Fo^Ny5U;Ik31+A=hv3j!Q3ibsuh zpliY<7ggfa6*^*Ngz)g(qZw78i!8;Z@=#|Et9>)8;%sPm03aWZ^$iv%K(L2rKC2bh zJVZ}IYWJ5!;;UU-+6B`Zci(tILeIbrK>J4x`tZ**0l4m$~2ptYm%N#HK+;W`8R-QD{m@hphK`9T(=CqzFu!z*S#Of!q?QD1NN$7k2wiX$8 zz$(YG?(Oy28nv8}nY+>wEYQy_KhvprfXFO~z2qp4I?}*AwN8MB2e;(}JmDescdJP? z$BVah9EflNV8VY&An-!pztu(?Nh`+07y=;k4c>Nz3$YM_ezz+sH~T(DDK7UR59bYI z6JN`Z7mrnZ*VKn73SdjjTS<{rqnyeW>@}ax`CqoTV5)+0S}>(Nfr^jS;++D>I=$|r zI^1x3cYNY4Jk6-PTwP_gr1vo_=O@YCJ5?vkxs)=f?4_o0Q=Kb4# zpYKacZL0J2sjPlZw(4R)h;<(2;sx(Yk-JuX6>f2su0f_d?6SQDQNo>isl%}!iccin zfy4Lzasj-pjzmun+KGuI-`3JREIkjkQ677DE)OzGc&WcuH1o9XaaqLVyiCb?1JY2@ zVMn@$6wAa}j|$M(#HP!{6XSBj6()K=Lyp=m2ux&EbDf=?c;&{`3+vq z^)`F!R+jOpW2ZZ2+9Wog>w^m!S}ebt$)F_ZH13C;9Glz2&xW~hm+U2;>`~E$nVyT( z3y1P5mnCQXHgbn@Rv*zVLSu{?4;GmS;nS=}$NpzJl-@2qcK(Ht$u*eFX@VIRyuhvp zXm;+Co}{WON(|@;Uhn?8PeNm_b-AMnw<*Pn=Va=y;f?u|tVbi{)|2$IMeZlf1sQ8{ z+09*GCC0+*B(FPIGZ7oL!>XW?46WVg5(~hwQ#Hb-yuKGZm&aDp;14zlz7iRhD$0ffrL=~f;?8QO`f2@Fi_$fL>5Tc_X16KJuNII8 zv!KfT<#ATs3aW(yvoH_gX1yW*(QVZMuzXJov1p@`AQO5t8_h~Dg$~D-r}n6BYEI;% zzi#>i$f2$I8w@wxzjCw9_Zmh&cy7442}|sx|EP1{l}^cIrN3@7bSIrA@|c@mt(-mS zZvM`YUcO&^7PzUH*3QIYzpyf;37DrkdLO5@n?jwwO~D9}ThnLfb~2w8aM4PAgg{pv z>I>*zO}@-tEY>$F@O&E6*IRHs3jBArFq=L1>K38OUm~AgXTMW%k1$VPnvuX_Vb5DU zmD%g81=`~VtNR?=(Li&0VO6Eu!q~+fRo1E6>em5nvVEA&N9E9TZd;l176+F%dV<>* zI3@ZYAGq88TWJd7N%gTg7R5!{7G|4+*8$;a?4=(=o=!ZD6P|(ExJy2ng|^p@e%_$U z0iQCRAB~jMa355}TbLWkx?FpEJKtAPm}K`vy$B@aHGHB6Ww;O!3fAlUj?QA|tntZg z0E^?!%s~2-3(Dhn==o%h??aj12hIPa?KSwFPgW8dY@WuGJnuTYZmMPM-i-(sKFk#> z#xdn&UNj(x0skl}F&hR6w#Ij;smeZ%AC!N+L^tJT@Oj*h#FIzR!2Mg29i7TvB-=EK zuFM)mrF@StzNJ^~;l|>$z4+d)uIEeayZd8-wwBTs~Jh8-8?+Vo*%y zVqOijyXFp5dJlP`DBG2gkV-IeM|gZYRK3BD$>nz3ws9B9?=+0mdvPLG{q3-KqkR0U zy(%~4I-B~n#Yv`jI_2k>coKhmcj5g>otOR)RWUR>Q;*fEo1BV-wB_EBp9BHb9CS|> z^G&gKoyRz0gq-v*U{4r=5zqZE4ZouMAY;BN3?7Z|&OOJ_2lvKggk1L9<4nExUJGM? zk}?5P#g#Lh?i~GH1mjhO+&e-3*(T==2A7FlTm}0|sV)Lpdl%ooVckZHUDCcffC`%s zQ5Tn!O!U4oO~1a$vyP3wDpF<{iZ$)3-qdycy|q3xtp`4b-a!ntlr>#q^rVY;saI<~ zfXWY`6Sd#bSv5}AB08_Ue@M{p-nIq-ot}=#=+>t{%^k{n&yPxFTjbx_t>${f5ai#q zTYH>jcbitiZVU09RK*$P{9F`Dy;EtIyV=<*HP`D=l2&ua{n4~^anG_U{OX64cOEi1 znL6j9{aj@mgebo+N{}H`SEkl+kQeKF=hKN_EWd978>i`Hr~0LK}_W*x3+mH*2;m0IC%lF5B5HxL8n?R24Xsa9Xm zY$6Q{Roj~{R_B+hx(DU0Smh*n=%erM27M~smCzWSD0T&YXRAVu974&2PV=1pr_$^- z^Edow*Di;m3{IE9ocHBt;0BY+8L$1$<)L|2?R*z5LTg(R-9dC|qF6jr*XM1;#^}bB zO{0;#;c$%)`kQ7?`0;P-E8MVHlQH`&_3GW}&L2|T<_v4+e`2TCTKMv}`q%|KcyzML zvh1pUO&dZyP1;4{FkgrCm%8+jD@JFt<+8MN=~hzxa`i;Ya5>&o=Vp+}s54zm8$C

-w>Kwm-pX}#+IcKeTeaHHwb?Z+ zUN*qHf1@*^t$H*k6Me1BmQHLK=x?t)KrqNXScq>&r7zUi+HBY#3LmW=b*`c=9l}-RX5gyOkl4?cQeR zF|#i4FpwHoo4Qk7O}QQMP+O+Tim?1V8C|7so}ZSTe1xf8)8CwUA#dhkcd+0YEcRrS z4eXYFDc2d2%Q-c%%}|~N3te2q(s~%z=kDIG*zuO1q^Mvvwi!KWPM}_S11n`!*Gh3L z>9lWs@OS@x@=HeMl}zT>X0+@`GxTHv8+7}LjEh)l?PMHVxl_}y**+DXO~|^K)IC+{ zd)ZFBI&lX~Pk2*Plgrs6%lX@GB-8B)Vb7}7$4jWt;F~4#Fb)cyOe!N(2dLbA?PH~f zb{({ban#)K4h^;PSpRBL4XrhPmSFy)>_N=g6BFXzyX^#c>389HsgC?$oz%hqjOln_ za!{r*F}~|2PxCK1HBmEfwaL~&+B(`wxhSP=!MM}ab?b5AN~_s&q07UmO6%joS!d~h zH`!9BM@=CvIa#-CceS~u7S^SCPmAGxk8 z)H7HLQf#JAvC~EwQRz_XTP4X+-(Q`DrfOYdy~TiYW5idNq|4paM*5OD;QYFq7Zeaz zHAQCU1=~ym^I=2nUn8j@*zR};sr4_<8I6{EV#iK)o7JRg=vzk`Vr@gFOh-KQWv||> zz|&`y%XqaMyz`o5&!4ToFNTd_5|_nCAT-b_6)BMr^HwV={@842p$w|C*A~HW+9CNL z;_6O}>(okgy#vpvnO3{ni1l4P*dwFuj+{b_J{HQGx1-lJhU_GX+#%U+6x*; zTf{nJ^w?EzN|O}pOwMhj?&ctXEy>l%QrM7?WQq3mClvlTfaxsqc82(kv051x*tW$2 z>DETef0O^P`9Ci?WsrF4w5E9%aI zG7q1ww4B7mMK{P$(}NL8M0kM0BP(Ikw_qRb+U?{PVd5EuDztLrqnD^_BV;-o`yCe= z0gU_|!$_@=TIO~4%^;HQnnJCG;!XFfml@WQO6;iqFl^G1ZP{LhYO8y`mSd!W&tbK2 zP~iLA-K_>-JdkdjC@N3L$+y7bWmrqNxoN)g1#Mnw?pu)1GC68M@Hjh~C<=h=_e&T= zO8l9ctZr-;$z;BTUUYJ(#4lbs8AJeDfDj~lO`5x7up9F$PC51Y)>eefp_**z|Mi>| z$D>oJ6b{cS$w%jc^e-Zd?k;?3BoN(s^5$e=`pE3kNB zbt*b4B|{A~1R@}uQisJcpC}EsC3&xgaHGxI_Q7p>+t*!RI73MEH$?O-(zn$GYdUdT z_tv@jO%haL*q?_@%#$rfJMe2jX|E@}xXd@jxss^!T4hV2G<}JTy1nEtH=~mTrq$MQ zBi1?)_n{PI!2e@pwb=J}1(du(2S|#N7{RGK)zsOD%7@#czP%gZqPfqpbOE4_G~kHMha&X*M-_kU&c)DwFYJ?PKnRFL=8L>(@a zp4LH8NkF1AW=D`fNbD-jWQ`jg*|j`%o!`#4aj6M;?<%CiKo4pyi5w)q@(K3t)E9o# zbk^96r!cJG$UZ`u%W=N_7U~pyzwQ^1f4-lSU#WIjs?oJ(-)N`k>m@V77M*F{1SlJ1 zlQR3fI=ixg=nk2+AZ|)9WVh3=?1fT2OahP&Jlv7#WWgEjh_oTa43%0-w^7~Pkv*s+ zy{7h0hfd{hg0GK>9h6fdS)jV$MJFsqP^XrTgUYB8Hsk%!1n1F)oWvaHiFIC2wgUY@ z?;yrVd{uB5Z-4KIW0k=Xc&8j4+^;G~dn@WSjdcO`c?LHrB{r&=(f3y}H>N7OiZEZ#lf25d_iDH504Bumwsr4L8 zWX}8zf;r(kuYXGLBsHld#Knx%05*4iJC=o9Rs+!v_L?i-Ha{~L#4b|_WAwRH-k3X5 zY?F7&TMFQij5B7)Y&K`ba~MV1*m`fHfrP@x3zez-2>7~YCMJDdMo_hyjpC4x9Rq~m zUzYG#>2jy%E73ZwuyuP3Ya6>tz|5bh!ZBR09wMS`9ih(n90@~Hs`{sG2C&vH=|@WE zXIR^W(m{$#Bqvd_KunB@sdkZOB5h_4M#f8_p_jE5o8D`nkC>%((yLb+7Z%@Ca6R(y zSBuS=5Jm=PD)gZA*|{|W03g!*hO{z$8|?e>x{_R1T*X{#&!T@XOrii|sCOd?OL$ix zT@6|mfe_@F;R2}QmhCWvikF1e&LH!!=VS2szmP<6-FwR3JMNqjnF@ zOm5hY=^*9DJ`*v|wXL#+)Q?rWyk>ACe{@k@#{zQ{$1Gb2?;b`tE`RCiKNO3t73<{>|Kdhk_cb^dOBYT>SHFN@) z8AIcQ!qNoQ*0@pzzxj?wM@b4y?v7UgtKGqxs>cdttW|{|DjhYN2{iu4{y8j;!somM zvCI8EJd{M*4vK1D$^!|@N4+Ia7C&>k_xJ45?}174&*%LfP+?ndlQO5(?V`+P2rW!l znl~rzN4&~IK71DkA+$I7&3C2uS2+6iBnRy*FFgNd=a*ofjDo&EsX!u`4CYun zJh`l|vHi~4)$a3~)E?emnbmN4Mme9JxzaQFrk+#21(oWrrSo#~pr_(=V?R?1+8nhpFZ~a@|x_!c^aYv=rv6!t0DfdMqs;_^I4H7 zXV>{tR%%aOpV->+9mLk#24ELQ;Qj0~f7VY~X-7piQ9kDqEjjIwS8{+YAQTS8Q@sI0 z6%4{A;tEf1gT9lNl$ZYk5!~xmNeD0f4iWmPc$j5N59Z_rH)K@X-h-9$e}$I*ZXwEV?5OHqrSYgR`)VkX8cO2qa4@n;%#WLx%h?S)S|B0 zP2VeHAQFth$e-+mPqjN0W>XL8;3ceDR~ z6u;ugKI{2D(MgH(3B9Emr`5sOmI#+^uEoZ{Zpy!5E!t7nng;}!Pzcu+*(Y2c8!uG{s%ot~Qdf2cdlrZ}4@Oydl0!GlYJdvFQv5C}TB zySux)y99T4AKU}MNpQE|4%z3e-L3tw`v>*|RTMSFBRze(`<(l}&Otf+(>R0hEj_9n z>SC}Oo5ucFa0oukbmgrIKROnTl)JB>@voBE9(Fefs8?QInt<1T`gfPHU|g^fI(_QX z*_Bw=VH{+5{jf$MI_v%|-Pxz;Z|X^vkFyJN@A^P73cJZVn7-_Aq~h3{I0&>@Y| zYQC;!zk6x5eQPfla?+p11~rVugdq0EXY=PxME6)V-@N>rk?vLN-oEbD|2tiC6FyS{ z$T+=Hah2mx%h@qf3Y{@EN(nj$0)CHUGPfb-RKW@_SNHxHw;aX6CU_$w+JCGP3tjr| z(B_2K;eY6`$D4azVa0J8?5b`MhaVC>!2Ax^;9yxD^0Nb3tp=%^YFEIIV+S1qXI2WQ zQySmSDD>~u`7K$MdiNWgP*BpH#r3C~>K`9S$2%FjP?L@VcaW<0e@QW6A`LnX2~t`s zHTNs|EcE~@?61;TRz}kFdJjCS&oG}a7pJ@1^DugEmx5WQXD26CUh6twC1X5xI;-;9 zGP%omY;pL&`a_gMLoTiF!yA0|@BF?}IsEp``yv@P^F{by!ev-&sdlXz+Tb@WWD}4x^y3>O9)?rx%PJJC1+YnDP4q_0K$L$sQ&NEbn6gSbF$ zOxt@(a6$Jq8HJ+i#l?;4QG(p}y#>h_(Y*6hi~8JE4gY_s%@PMO@cHax9{Qi{&sF{*SX)9uGjgm_$BZ2Xv*iiY0}k8H`t9d5C6Wi8W5pFE4^g)vb$Y32F{{g zG#f6h+*$3NB8{32<#;QW%uvdXN;A7^?3XWC6W`%@Er~dSIplh{&sg# zZC)7b)_>NR$!h<3b`LjSk?M=G9j;A-vm}X;I9t&xt)l?TNVJGc`oK(yDz=@RY@TwC z-QH9ShVF1q=zw!rEXiEgG^hj{N9o(uwJj107z^n}HQhbZj*Z#VsI7PdT>zQ%-`^U+ z8Jnx;Ql<4=7?;clm2pu}|;n6*t`ivn5cg*o{TMC&jub``eXm(*< z@r^1+mt9c-e-rsag;IfP(QvyPJ9ohbwbm>Z=a46k6ET!yeSj)osAW8whX6nJ`vCA~w-(B;d!- z1|@ZU*(iRDH0lh=`)_xxT*lyL=6z+d=@P77iG*L*r)gNPscMq*^peXc5O|z1kb02j zc@BfXq*kFWg-#NXHvLxDv(~q{sITk&=YfswAET2$=03r`@*oMlrqI_mz8!UY+>S%O zk5am|I*jTy`x2J~EhS-0HVhl!X<%2U)_qIc0T@)2*Fg*T5L_J!TC{pV zi^Pu zwxyH?D|Ua@o_qE}jHSTZzk0Jcv04|Uj69s@j7_r~7{D1a=Kpy}>0s_69QI?u&b7H# z``8hiPfhuzU5msL7kzvmeLtSyg%fGw1TP!U*Sb{U z+PNd2jux!d_1Sf}-F3V?w2TJWE=^^L$kv~Ml@jtHt?g0Gn`vtkML!h16X^t|Fbmd? z$p38I{#fe>0j><4qBopadjMa1%Zmy|B5iDG)lW$9tlxg^%UP|T%PamWe0!3Mi_bhLhTN&7tVc#UN7F^Q)$8zdnhY>x5rL|eNuU1a|;5egJ zAv;ZRIovYTnOC%BrwzBY#OQl!SjdYnL}dDCuBh+%q)Lj+*99;%xV1M=70o>)vB8}X zS2U&22mtmF)U@|wC4YK`ufB2VT}47v$|$yV`XML<^Hn^enne1AOmV*lhs4YsY8gL^ znBi2LPNuQ-Y!6+%q%#RVH(ekycie{C{c$4Ve1z0ICXWX{-thB(M;vw|tc*OwxRVm} z@33o8s`#7vyGD+YUgh|hNodpOU|GM#8J|l=L1B9A(WE~BTKHvkc1zt*6NH}$wTQfa zLjO%h*Sv<~3@**GA!=Jjsr`0dZWUbckv>P*UnoChn_iluYM|8wP7}m^7J#f58u$%H zFbcCfD8}q-|N2rDMmwm%sW^O~te(J(Du(ueI#_iI*&vp7w65>{87MmX0VdQH4+=K6 z#7M1JqSm$hMR@zEE+a_M@_Sz<{@aT_iTjy_*BOBzF8i?8TROPsT;1QXDl<v$$U-n{=yz=T~q*_p28Pn2*0u_^zJ3e ztxPtkmMQLY9*z*(o7_OpOOw;2{Y{_{3xKKqPlGrM+Uay#7rg&+H`Rz^`w%Ls|h3cB$WF5hGej)!ghJDY>NI ziS&*}wdU2DbzOseo(PQB9*f@XlnmaEfP#Q$ zpCs>tK=yc}?rqP*#^eTb&VHf@ITbE>fw*0&L!ZTzubBoBffe9Fr~@3>TFmg42lFLz zbv^gmm)oCmCW|6`#~uan^Eo_#^YVW#&eCte*xvXeJ2 z%5eAPZ{KFL!)o*0HFCA7H_4etUntnH}uYTN8RdqS{pd*{t2wm}Of- zx>Rqdr=#cNcb=+eJ&l?hbTSMHZ`?YlB^ODD>tPH+1Cx25vF&L2vJh_bT;N;?MqA6l zU>}2MQK2&WSH+Iv(GrySS0Lds z{Epj-OOrUz+MF2Xki%w-(A5QTp^}Qr;a_f2%iq#-f>R;VyPkYj!gHGm1Fr_5+@ukF zA8-dL(;s7Lz9D{~{oh)ESqMKebQ@OiV@iKQFFjc5`n70$=#tR{3)9j> zwa546K{Is8=d1X16)7^&6eRpa7rtY=!#@PVLn-FWO7|vz8geEXLl79KD%v_)g75Wt znQsLj*}3gkwxhDc@-_qJ{zs(WHgM4vf?sWrr#tFzAfYIL^Nw!+2VBdm$%{}@G8S5A zUZ>qQ1Bl583V9%Kg{kfLPP#)$tez0!213N)4+}VlnW#JZbhVvAY`C823&7Eb)O5rM z+Iv2?_m39wtxq5I4x;XlLvS9;jlv3EjizBPb7+Z%`dYMY@Bflb>sb4tY)BPVL5`hX zGN$fJEhAF5HicG@Z!tS|IcqNFD-tU4SZ6%Jn}b>-4U@wu)jS z-j!#j)D8#hgVOnSr=dhTKeocKLu;*JFFY@h?ce1(bj<&@yni2^9_NtX~)LKpP2)(o5i+WwKl7z5dzD^iX@pMWf_^!j$y z*DNSYQy6)DDy4Z>-LNvG)Y-dknc&{=5Yro+w5RQw1|9-t>~a-Up77u+G#i>4btSha z$I=r*1%jS2?MEXW%8yoU`S{#V-g8>pRgM~Y45e9jv`3VfD97vb=%7o(rb}31T#iFn z2a`3NHF77;K7Tr-eYtqhhRf%x44+VFJ-2>b-o1zfC=p!*p382Xk8{KkT4?WNJq1ZP zZ+b?uCJ&}EgIQ8pdaL#O-V4J?A$xmq5F-d?zhJn`kGIybp&Qj0MqZ~n>=1|J_Hvq^ z9mAjc6ZK{i>yF;?eXfxnIH-7)1g?huy>0$09BP}{CJi>nN$_0x ziFx6i#|#3N36d{11XPxKHLx_^s0n^I)7&e=k5Cb#T#f*zA-exNhYVewR%uqir(>GN zj}TML7`c%}3YxnC2)tXZP!5ApDL0iwjg>pbuMk_wQfWa!v3nJ7d4ReTh3Yfz<-#QHoO$GcHA}TZ zWXf>M!F+N6%3*4Zc}?6E!%B+`Okd4qHg`ZG=hrYw0zz1^%f#uMqrh%wX>v)PhkxpS zHht|M*yZY84YV`qAt&N!2-B$Bc>0#lWJQBM6{d@oYTfV77)SkdCU&fFK?&8mm*QZ= z@gT_qR$sufJ1cO5%FfMOnBge+F9eL$Lf%MyL(L+TkoyuCsZbr$-;EtE<`_HO*C`TE zHKkUB;V^#k<24|aE?1o=ohnC8DcBH6v{$r+l?8^8G4Uf(F?E7<)eTCOXqdzFeT>>k z1`nbK&CuH@qg+nw9xen2W`9XEp~yvbTb=1NKg)rwwBGlua*Ww0ihST*)g-RdLf3za z8)1O3x9_ZRlHkV^5czAA2n+AAw$`rpb~Rrl5L?BwMEY95N7q@Q!hy`ADB*fLplxhe ztkWXRAqP8ys_$gYslAws;Y-i9R7!u-_5Cv69{}A|_J)}fEG#k-q*xo%3)gP{=q{On z^QV48@DS40+&8a+f_XC1Nexc9;vSc-n8fHh%yec&r4jSW2N*jIi#;o<{+$M^L$r#R z>lMry2|P%NHP)6oqZS{lO>_Wspj2o+T!zNyjK>5kMa}P}y*SL1fe7dy$3AN6w9Wr} z)%!9Xc1brLqQ<)hOZY^$N@15YXT4vRt0IvaM-e!d)R;pRotvTUKP&i9|B9LpuSz!| zW1|>K1tZXnX&F>+qT!o)FG59`R zPOAaW&9Da_I-SKO=iYmbi>#ZJK~Ac9TzdNr`1uY;DPtL*D7|y;2cA>+i@a|_JrZk) ziBYx9!@O5@WwchxWmhByp_V?#g zeb4<=$K4UNE}Su2gN8aLP{|LR0X*Btq~5h*8A&rQ06yb3Un~Q1y^soy$?%`}0h`uf z1sR5hz^%7!c%dK%e0A~RBAWTADYD+_%3$F2jr2SEIy;B_L2_YE5IG7Q$a*LO>r6L5 zp6H9D!3F^ay>yLi4oXpjY<8;I<3lE!O6;=+EehK9H`!sY`!gAuanZ=@euGFR;mCBE z3H!dcFE6~9R9D&^uPLS<_!_Ta1Xa%vc$O8rP(?vE>@w(HrZXSE!nJ28KT*n07{MJC z-LbN+rXk*yDr5&OxZS@Qv0EmjL~GknB0SfxX}%LL1Wjnz-9>B*)p*sOg+=oBvn}=!? zwf%bwt35VTwh4AEN&aR5&i(a9Q3wNV@VBo)M!1C0?e(_7CxJiQ=UEthaVzsNM*vgD?AAbV17*j# zr+-~D^I+vxWuC6hcp0VuH>QH>(!AlrSLzNyJ z>*P=a=}_)&uVKCML^~{j!+`QE38PMHX*yp^^<#+lgz0pF`%U-!DXcy%m|A+cT?GV( zRm@n4wun81ym8YcNYZyfP;4b$yyhj|?&6N%rYRaWu)kOc>t}gf`fP{V?!*$h5*+j1 zfCL3byv!QBFw#Rh+56;P!Hh49t0jd_!k0pThLvh=mZuqwiM+Y|)3b`Y-tYn_j-G3Y zm-(R^YFPaOCmr*xIIF1~(C=~vsI8Gc{u$MdCaAMg3BBb6hZQaX9)(A^BtP zlbs`}#+ppjG{e=IP@yl&5I`<{pR9l)wM@6b`O3kP*bl!rPdNpKNbPbT>{V~g?1W~O zf$+2X+xI)~tYI|srB&2`%^ZL1U1PUqYg^qF`6YMu3yIg<%2ED$r36gf~wt}6`n_}MWHyuR2u+nK`|7b4^_9S#?jTC-=H10P)<(iQA zL`%WGK|LjjY=m5(Tj=I4Z4$~)v2xR>!98O!<=n1j@TXJ$BK&BGm8F`(EJ*{XrWD%#?gjk@2FRF3;uIGoklCQ>SbGY;62?SXrn% zl}l4KZ%PDs1 zEYLqR)g&WMV`IcShPX5>J$iR9;$&Xs?9MJPfxeZF_U%aGtu+wHliJvT+Lzqnz&VNsJB zr-XKhB#FpjIN50&tV?(yf>7O}Y;K6x1H>r^XpV6M>+fw0@PKR#U*iW?H z?^bqX1mxJAqg_Vk`N*dtFq)_+b9s|(;v`f|`(+x&u0c@9&C(uemINts1&fUvF(^_2 zS1p&2=vgg^7dtDQe&of%N}@A7ym36{d|Kmd@dN7bkFvy<)}v^P4tSwjiLC+w}`H%VByV` z0{CaHCk8Cx&1q%Ww_*5VAZhW3Yy#rPY9PA?G@vC@SCB<|p$ZzS*s#zB2 zw_DZ=Yppc1_oHK66){}Di$Sehp5PN82*4wEZObgf?Dt(roIpM`tiOb z^P)!3iV3ySBNBwaRpF*PQW?u9LME$iXkERhYZ~y)^wpIFk^?hn27lWhxN`L6qOqJs z!hYt+%=y!|vU)#^uV2gnr|iu2T_(O-a)jK}5D%*j8jsl?%5~oiN#$3}+M0Mk9Fs3G zA`Fa6ut;h6iN$0{-fnmFa5Y0my731w z5w}w7o#{9v+~THb!b9L$)Vo<3viCXnF>5~{(M?+5+KEfrKxLtcU)HK?7M{?EaQy1~ z3y|V^pR@(h0;l1hZz26B)rDV}hpg**+@`sfx4=L7izon_{%<}&gunOq^VAm>T6i6jEmf1eaz+}wB*u4!K?E%HZkeyL4(JcSrKWL0r zPA#_qa~a4tsw5L%--iv>lmgQFUB0uZ)-VEeMm#z7Z}aWK-G&2?QjL8Pqz@NjWB?{W zGz#?%0S{-;uDE)5oaN-0*aVh`fGBq!(+IdJZYQ#^q9K*ji2i4fa)W=_PY*;8)fTFvo`X2_(| zyi?R6`-=5Q-n0h-b!pNmzo$Xt!{@vm?RBUry=`REHPQ*+=sAgAmi~hdpW*^YYX%%b z;5Al2%+dK}95qf@P^1Bk?Rr!)^bC`}8YmC9NL(|uNTQRbnIR}A$pm+)uQX(`24#Qy z#~rRdarKjQIQmJpD9h6M{oX0l|~(az)BZ8-M0pvtYUuBsT>X4^l`QQ zS@6{;2@V&nNFWF+q1LX9*aXG|ZXCM+hL;i(f{sk|8QMr{J_B;|Xx59Pp5W=s_|E= zdZ{otmU{Id!6#E#Aj5IxQyYcX!vL?`s9^jHqdt@XcnXEXDu2vtYn_=pf*vF z)e%GB2-n{^Ra=M{8S}D1pf{Xo zrxuL%y&aRe_si1P`c9?g-=P2CbeEVQSnI@*rU#g=bw-_bRu2(4b!XsHH3xE-03`y& z<|g*be_%cq7(;{YYr8nxNyaMHweJaNMg*|8(H`Xz|M3OA@6V80v@@Rp@hWy8YrVsA z4S4h&zd91R2&EsvE~LJkb(TX^^ZVlWd2-APP)K0tG>YiL zij1!XNuZF<&@SucT7UxDG%ZWBZk(is3*9=}{I^7F@eBaO0mVyCIMF{41w}hJGS>Rcrhzbh%t=854dV@1kwnDzP1Z$_-RXHBXxp-cTQdE1ebGvWSw*l8@#@zax! z(ft(1tboH-fahV&Q|f)yf3VZsXx@n(_dZMcV&EE>pW#H;Af}>1>$^+bt**Fxxa}~m zz6?JH!w;~ru~FC6p^|xRF+rFx6bkJC$jnSX`=q7WV0NTp5bqVrR}YCTQp|1v-_*$Tj9D+ zv|gmn)%!d-^|pM=Oreea@7+4XiDo$f*ttq>3C`VQ2}Q2`!H%Nmhra#HePZl|Zmwfb z)4;`(7?e)8V@Mi|Zr445fS*s2%DR6u_MweFS7o2+%RLzvL(Pihj24@5J1*DJl~#Pb zm(P`(TD`T^zps;So+(rqM7>5Dft%g%h$^M%*w$V@8=17=*VA?L`_scdy*m9i(rr4Q zB<+b^ocx8LsMV@V_n!|`kkBhGyQ`K*VIU8F7eNd6h}Xw)0@^Z>fnnb<{@@$OfvscZ zO5@rw&Ocy6UMC>E^)UO=+fkyzY)1jF5KtB=I6GBd2350&PRfne{BZzxAG*)9>GPzX ztk5gw-(jQUzovw5E+A{sMgPmH#%AFy3!Tt*S7;05$4=+_#eMsS?aOu+epAXC`{}X_ zPR#Sgz9wplfV0raT(<&mfwEVoBA6;{xQe=TCp;-E13c`53PVU zF4yl^j6;f^>#T6|c8<&1|B5B-TZiGVWML#KhE@ zywXaKlUGvKgHzNUj8feAc}<(Ulup_DW6w)?4rsp7gru1(+S-U%2@fpBs7v_xZiz71e8q z=#=KyXJT)}TiaRA#@TLjc4S?NGJtfiqv`9v!OY9MW&Nh|p?{V*)_~Xn4mvP_ zR_Fe=k+EbRtD2q1%t)~_A|IJ{%D1CD&UTHb({wQ4Z0m$4cEI7&dpTXFi*6``>=F{B zW`>4#bUZz+b}iTbb})aS&6yBXpGp{I#{jonzw)VQ3f!hzOFT_x7dU0>rs`;B|w$NP7L*z(QI;i8&tvD5Jqb{c#lPYM}YF?s`2M#W&sj-!8o{ zIjyF0+UkMyD_wRIyD0Z~&dL6%bLU;Om3J>UIwZ`B-)Feh%MOP|tNxFpi!`NtM2MYi z)KYJ4CowrUmoPud+AU9|f=(Z|JjWDAs`|m=E?L8L=E&{hk~@cK&Gp><53UD(wL#)t ze5U6+{f9qSBZ*cU3%K6b#=9u)eG4^z`$N03^W9C8oMyCJS8>Vm+iX2W`vR@~T!!6` z@(S=~bQ?=VI_A@QzR8d=GsxmGX}fItK6suOqW>55Z7DD{F(mq1VhPw_z}1yj+}nga zTvPJX)6Tus3tSbRZl)d4NwT^nOOdbNozTH4aV8!3vXIyBldjo)-skm61n<%DT)q{f z3N~-8Lbkl4k;02g8@GE&CK(k}hegc(WoKg?zjmS0w6%mx<1v=cXIvE-Y0cQ>Wga~2 zIJmbPn9yZ@0iJVqHdGC4bJL7u?XW&=*~^bld>_|!*C=Bw{u9a|zzpZd)W!a&R2#{* z?;RJPvob{!DSbVgikX_yp=dSoee&=wY`*1W!&4 zq^ho0J1z=P)29kxNBwIGtIxSL&4uy2&KK}(tcIfnoFzM;kXt?E-@5X{rVam=YQRs} zG0O_zHsQ7@hg+fEaouTLWLGWsDKKrw+so#^T0@%0TN41!m8bH1ehOOvv`Xp%)3>#} z{Ah;%FLfgzcU?o4f8zl1$AKEn zaMy^8AOEh?`wU_cig__};0O@wU>McYv^~(YLqu}($mKhYhLIy|0BWn~Qm;+M78KOS zh5vd4Kst&;wjQ0jE{SZUjgqcZlPFZnnIlq$Ft_aV!Y~a~3`K4e}<6X>So z98D-Pfm&?>fu9O8%zv`v1vKaupj3=kS!E6v9DomFDAK+_5SPJW9;dN5JzGiHug%xm zWdi%V(v0y_PXd+?+^4iuRKC{oDryj}(?Tn?>?2Z9A{^-l!Lgy_uruu7$qZ?I2(GcZ z6(yaam5S4cUHl}PJSsNP_9XeE>#o1ORBSqoi4NSU+t5nXHVlblDHp(GFH9Q#hz8RO z3PIe4V0k!YPVKEj;i!7T<$3HxZV!fQ2>I@-Ms*f|C&xgFO{8!~=%^J< zWMz@rEW80MTA4z&WLm!8^LXC3y)-6pR6sDXAf;TYi;=#qAIjo!tO4ewWPf_F7>5}U zJ!2xt_*_17RvoHU0XX2WHSuM@h;#}FI*K#|t*>!zl4pkG`1U?CYrwUi<#}IRshnDG zCqc!9Ef*LKlLXj} zxBaYG`IPSi`3?S33NlFDqV+&lPwEfAo>+xsS5~8a$3cQaJNuILJc^ohmDCB zx*l5F|-3nL~(`6+(+@V;{Pe&hy*+w`cH$6 zNpfRrddMnqG(+bKzQVrb=sbU({Ay%ue4cFUo1Cgf5F0wtBXl!mK~W-2qvh=c)R3Fb zKXJuJH@U&gSJJQIb$uB>ZBwpU0?stCB2O=!MOPQ7mb>&MVNy@+(jWYYjMv;)N^IN9z6}Oo@J)id8lE;x1 zXUkPN;;a8Pg4RWQR;@dA(~Rw6w0EGTv{TU55= zF)I`v&exNt$K80k(0YRbm~ZdE|7UOi6iBbOh%xid!}D;COczwgxgAXT+vjHbI#PgM zj7SArb&+xc#t>f912i8Or(aiTo`s!e~@&#>mwD56$cEt~b&DHUM-u{4l4X^w;T zQ>eik;13)C`}|S2Ir>@X|2RlSUk$68Yl1_VDJ9{RnGLTx$xctAUr67FbSuh2>$-|F z1_zc+RI~E&3uC(E$Q|RARD3J?akWbIJ15;o;zd@T6a>U8+wv>hM@S>c`IF1zzDOt_X zRer@g5rM@bSEleCA%*`;=_#~|ODQ+!wF|!{ff~aiPY;zOf8Pr&S?BR2gU52zEz2fM z1r^9jtMhX-;%Keq6i8m;S!o3AKXo@Rsns~p*5Cc7p3@vh9z$aZu}&Xn{{Hy`0#$uI zGP-EMut{QSDF%;RJMKYaI*M8%c5R|5%=3rDtRO>f3Y{a=eK@~oc9!R!prx7W(x|5XB9qL!DBCvCGSkH+?WQsZ14#n@UDNvC(EVw^I80@i$*huP5 zEkSK?eGzW}WpdIqaP9GSb*;r(>;$_38kgHsSMB(I-M%h{RFmN@n71BJjr`!`9MJ1x< zCSh&hi>bA50M)JK8DGv2oh-7%@fl}$v6c4|a#*A+LDx{M<}Y-*an0X%{`q?!l4Yx< z9$bN2S!@Ga*?;N=8z=OCek@{_`yN9{iQ^w4{+&AeOym_!G8y_^`3Fwq53}GaDT*Of zY}cmxb}DHES~vwfqPZA()C{K1or`+a)l?oG|-VYaOhf>)GLP%tB z($D=la2wg4Y0(P~e@FS^k1)Hm)@WaEy2--L{#+gREZ(!vr_|sy&+$rnfR`jq5ezfG2b&8(q6d#+)<(~Nw z7D45@Rv_i;D`>5wJioL$?lm9S70nZ8FZ-p|6?2Spymu#xL6fezwsz(&Dx}3?mJ=-W zW>P`!Z8z=oQ~kt5iTgPtMN(`#EA>8JWCtEUomKb@kjLh7S>rjH$_so*-6G|4iO59i zPHg)ZZ)S?cf#i%q<9zc6$xdCyT{^%GSU-!{k7x(D;`O^!eW}X{V_O@(ZzwCte2Dt1 z=#F%rm8ONxH&YCgZExURN|tc}hBo7o&;An28AzY3DeW+>sw8Mi!7C@D$(ANUX{b*O zAnfpt9T+~UYiNLF+D1i+^D*-_D6_gR$77k4MsW-*2*6=xKaDFj3 zqYXaLIK!CL974vT&0}j}@*$$!TJ~-E3bVQV>Gg?E3vj_U&BGX0eifJ{DzH1ldrTAU zYnrGOrW)s(ZC}K@cL8_I>{@oSk z^@#wd4`?f(X=e)wL5iS*mv7OP>B5qFo#cjASRXR)symtp!6}{FyL^e^byibTD`x4r zop&HCd86)kujXFIQ4$yk7dkzVr(Plv@JJvi8&kL`i+-BwnQhZ07DJ8i!M0r;&29K@ z)dch9$BCrt_@|#@xianWJ?#@03W=+uX1HPhengnlk;Q$KdH5!_RI!1p!i(&;hCG;Q zmV$PmofVK0`^?07@WC?M!+-=KuItZXr(xD9V`F8thI%%GWn^{BQjD`YA<458d1ImE z!`#Q;aKhz;Q@()AyV36xx*dagb!=Z-g=$%&u<`f+eZM%Twh5smf(T;Cj30CE{u(9a zfji%d?&E>teyT`uLR0l3LD_I%kKU&VddLGE>>yvj}t7p-%Vv(RA%(zPEGHEWKj_u}yzltuUdnK7WSBfXCO1 zS+f1zo>-P-)2Z?mNfOMMAg;JQd>L@X`;O8U4hK(@X<#p-$r zbz5dkPX$AXNddiSMt3VY-VZ7NR+N!D;gh>zj*>F?LGhqrU3>s*gvR)PlDi zD$KB?kpf+im=#I*-57T}ESUR7{{lx&n2rvSpqKGa`Iko8q)ZITZE7{ZEq+BRR&*#F zrz{@o0I=w95m;1!yi^s`8;Yr8*4nVfI7yr1|Nazu)O7Lz7*ftaPGn|zEtxEHN{>lC z>)!g6`vO(wkge;bk9r2qK#dXI%U>8Tzk1REEI*dwXh}G zUd=K7qU!;US#X2u{YgWKNd{Aar}MkNt47l*`faN>z{vqV9Y31w;`hJh(BZ?~l02Yo zc?eRm3o3U^K*@yX{t3{0!&4Z|*>$iCA>n`|0ub3#*gH@#nj+)d7i?X8tRo^8QFBA8 zQ#Fyf3kwT_UM@fZhQ&yfe9^ewkgQs>!RSw?t3dDY8p`%-_xu>cWPTG7i}$?FJdoOqifcSB#G_O!(cUe`XSO` z)dK=UH`_+4@ecGvGhJk>sDb?v0;0|ep!`jGVf@AvGy!xJ!8ty2{IQA1=qcoRZBn*Y z9lWu!GUih2r*UaK@b>bc?>x;#29!@%F`ZYf>LT8R+RF(kCY;U;JxQZLF+}bb`2# z{$t8^)S_W{CA7vum=jM$_oD+q;u8JqmWGOkGMKoXV)ON_gE~K-aQ|ITvNR!6I(J)H zSvlcOrp`9<0Plyxo_Lq};pa3{|1~)F4}j| zt;%a_g={x-y0ajZjdn#O*9;9z#(dqGLDRk+2+#+7S2E5E|eK>GMl`1de8L-{eS zE@(W{K*H1yUnR@>pBE*8AT>ch`O{RXfuh9a&-!knx8a9nJ1gBuf@Vu*Z%aEpC^b#E zD3N}pffm-KV!Repp|i~;9U;uDqk{pmAe5+w&P{{$D+5ot%Yh^4&v)BY{|1`%IhV(o z=a?J$F$Y~^ftdykdgKk0OR%OwDrcG{uP5wG9w>Yzz|Pl8*u*sld#Phyvdq>{AL)q3 zK@)U4L>3#zH!yec=`HsU(h4mg-jeSwwK|!rq3?)!gru!eZj^4*A7JhjLHo^fem@maYm$~>p!B8rT!;m5~ z-~KKSQuyY;Jsk!55>(2H)6xRMA4px3+=AtzgYm__RCiEto+J77TZqELX?|g8xD{JR z>6M;CfD#x9N=}De^aQG;LPQTW-ZucU@ynLACl12N)1{9FJ?*5Bnws6$#mN)HZ zxWJb#CIF6`{nkqJ|MNc^#<$sI_ipD>sHyfTehgCQyZ?hN%7){xj1!^xrKd{XQ_s|2T4=U|-)Ev&h19TVHFyA&|w(D<&u)(rJzHWqBRO{P!%MUAl6Y`nQq zu3w+K-r(=Ew>bgv#o74U6-rFWy+8G+HeBcbvt3N8oq7U4fIs|ha3B1oTX?rGw{&(^ zUB27zd~+z=X0~WcLsO-QPiO9~JqiR_8FKQ0>3bE`_2ti|U@&+x(HHE#gt#lI(M(oV zw|Ol*%EuR-w9)AIuVJZn^5oxfm$f_hnf5m|?wcS}#LgM_gSNLjcUM=m=^81w9!~FL z{Z{VR3d7NfPVZXqJL$DH9-QmL+3R?%V3)=WSono(iJ}hii=e=M`sBrWqxWoF_z7ta zfKKQwxLYAxs?&eo`r*i+m+$BoC*4tnxE2`zqK*g%`{2b>RZVZ9>7{E{F`3iQu$^{2 zmCt)Ys&+(#ek4nV5i}fYjTeU&RJC;ezFb+cPL!r^z3lo`LMt2n-5!%X9XHv|<0v|; zDyuT6AQQW#Ye|r;hQ0lHxlfDJ^2NVx%KzW7hFSIRn=0_XysZ0IvzL_g)A)@=tzSD# zu`GXN@7935iU36cs4bi-o*S`cvdzcwFESN@D$Y>DLVT zVr!UcQRCNA29B3Q(MgR=f1UNU4WD+y<&pfJ#-qGt;?7!zzu#(IR_e($>#u&@-!C03 zEe+;hY`ibrUVIHvWy-Ts`Ufmh)Y$=WZDj9N4TD$+y;l$IDkmMRidgirzrp(%p2NE=un6lp;~q$n(r;3BYqO3}ERl@>OXC{?6{ zC@4W#DSP8Tu|J-fJ7?~^ch2Ygz4PY2vpLHqcMaNSzjL09-5a_vL}aW-LNR9Um^vBc z-*rMB&V4q1hf@W69yLd`enaH?Ih4;g#b}M=*?pH~J3g=R`aL;lzS7l_Q=$S<=GjAS zwxP;^TUtd4JHN-6WS@A;4X&Oo489#a^j4sU+}ri5!XX__M0h>J({tq3IiVnCLh-8N zvf!D?7jEClV%@L8qR!wCw-k=~Fj^k0&Qxq}S3GTZ9Eo==wp(oIH$HQNEKI6n=FE=I zl`}hv6*}ib|8+r6@6Sg{z_G^?bMuZ|M74bFjES4+h4~Grn8$TAH;cf>mp}>y+yZ#a zC@J|cv5A%{KX6d=tg76UY@7WQT5YHqlfqKQ*k(Pw>&|nzG3hMu^5Ea^-yJGbSik8* z3PUb-Je*y~=~1q}t7+?YaLTMv>nBTjCF2G#8+6!ozSP;()$n?6T6%hV(@9@*1K+eb z_S$+zn3Wm?^23H8tD-P8py{^n*EC9YU%ne}crAZQrPfr(|BQ**r&H`|&7jlP&J4-4 z1UB^0x2R=8F$x?3^dX41QJa>Xa0&QIQ37{DpmTR@Dn7P-0 zp6Sg1sJ^n}7$UA)lv&TCzb$-?vTV%XXj)@Hc+bZcsK5VqlTFG6eEXZDuvc26jRuj* z1}BU-TLxZLU&IMCr~H$GSi;E&@@rZCdrP^DeTL};ad82;9wax$XPZHIvo6S$myil) zj*${omhK#oRzAHp5+AiN%JRWrFyMcl!kd$^BRn2&Vq#)&aJ5Iq{JpQ-h@77bDoxh;k zaBu~?i{{Bcm$;@ucgA;uLZcMdwg^ai4~ib88lb3wk?28)VNqhUf>NI4bn0ay>j^q zFQ2S>(ISI=N!YG=bC0nCUtqPEZ9UMD>z;=Zl~3&OR2I2%?}!4C)e*?VHNq&l<^@ab zk{dYjlhO|RI5QAN*Ba&-C5@7qzD@|g9N{2u#cvv8dV8|*7nH8eqjC-Uk7D~qF-SJt z^-#R0UDo^t*PxA<_shH7VoWA}ir|Im&`r3*-tZNM1*~$mKDnkg?I?`znN=LTm^4ly z;pguy=Qh%L>rVWnXt#IkjD&t#P+54lqMPSUz55f=f=66JFe~DGrc;acix|kxe#&Sv zlK)5PZYN+qP|Ml8G@%PHfw@GqLStGO=yn^Zng>tKNU!RGq3MC#Uz? zwb$yW`_oUNloh2AU~yqVKtK>=q{UT1KtNl7FD+;=;BP9$rNBWz5Djd^#FS;k#E6w$ zoh)taEkHoLL2J^il-1?h!u>3bp%dNE$&a&DTxWC&LrF%1Na%=ziHSwTgAeGzz$3_s zBY#215L2t5sH20*xPpM+IzH@YcMA1(20Ch8o>{FJ_V_*q_;uQW3jaNck$nFH3KH-& zAY!>;d$GdVdI8}C0+tPx{0rQfw}{zV0}Ty)?69x-dJ)9)%~teUGr;4@%eoJ~?-;kCTuZD>DtmefryO zljZ%h#@O8q+e;>DXV;kA7UUmOcJ{@MaEAq$v-|PELH@M_%8Zn9_ zb~iSb2^pDmj{ZYCEgsONDc#%O(pJ%VzUd9LCJWT!mamY$}`_Y;GJ#P14O% zjkG=bR-a>~tDZxSBVS2_D=B1Ds#cmmWSM zrunMzm?PwCoI?Wa{PZ;ZOnV~aPiKR67Aj%$9V|aq@6CQYCJ$?juKpdOT%uapv6Zfr zsgBS(r_STxV7c${{>C!pEh!y#-5v45z3(?anOO%xE;P zk2ZjS!-R{5OM>sw0hdcn5bt&5fMIpBr{l|u=bi*k^V&ja?&sPkckjzTwJEDfilCAZ zruM^ZjHSx4v)Q^&JDPJ$JbFC2te<)%JGD-H9}InBZTAjd&UGh#H%Qxg)k0i>kC#?N z-h_tyg}l0gSG>2}JV6guK|K*>Cl<;v9=i{g#C!+O0-*KYb1Lli*%dxtF-x)sMMZQ|9X5%hd>P47rE|3CXJTPP8p^H z^yGDBbf*mr>%WZe*FD!Aw*yvp=TJZ|!EDpq7~jh=R&ClqpE&`xv-ox7*VIHYb!mA? zeLsI8Y|zfpjv?-&#{@qG$)(%0+lGphUu(45!K8LC0?r;JR>sdaCRsXC(4nW3>x@HTwwZ6W%|UwX3-GiM1-3Ey-aB z8>a%e1O)nWJmB&r@Zhj|_~=@OTUy$A9!xK`DY$7|Hy)#52Ji3%%)L_gj@5hL*zCGJ ztL~;%O>)vTR2fb{9?QhIj0()-8VXaZ-N4k zsF6w;)uC!Fdkf*#=H^FL32zHlr?RF}B_$+tArl~(EkZ9oD^@8TUNAC-HoGw6HBm8s z9gj;UFoxvrL@a<0y_6uHv8s=8viO0vweV6d9CIEus1TFpGc9LMg$ z#=)t^eB78{&)ulsmf6Q|`#DrP-#W%P^LIex3U)a~VN|8e_t-s+IJu=NIxC+q1S)8> z_qcR5@i}<5`r57!<=YB0$J*Z5LK%fph?|LAsF}K&zMHp@@{YuvaY<4jvi8?Z*uz>o zUXTmpttXcPnmbyGV-%HvG^NsCrB`>nv}lD%X(=o0t=-8`tKP27>=b{bl$y-J9J$nY zw(I@R-H-6#i$9U15vI$iSE_{z(~VJgGtr3?#kBH|DNvmpg-GLsjLWUdB`bVp7P!*5 zf?R^HRrxfH>%9^!DQ&Ucm#amGPvdc4Gf$&PT??H(x#dsH&;EhD^Y2a%T7qY<_dPJ8%<(y_>KQ?Y{nI9x|8j(4)V9IFtgLsthE>c{T8@(mkK(Mz!^W)(`2*E+hbwHR&e)NkH_DfiUWSc|uOG@?! zULl?QC534Ig%$~}VGOGe0!jXhUm3}F0DkS)uE_Ck_9^Tm1i4U+{x{>_&ivd=TOfq+ zOrd?^{U~>l!r~03FaU&EP$nWL#5|lG&_47)9GYNwu_u&xG;S1j6jGQv6gvS>C@{4Rg+A)3Z9&Q$4FZiQ~4@k?~) z`m=sWf6)ZV4k(ilm{{&|Brwjqvsk&fz=RIPnD?kRy4S~4Rd-~EcSnL{kyh;O4nNAl z$)ZgZ(GFIA+KQc#;j(4Y=|=FncZ&LwzTH7qhL1?bjTBI3lxjD@+=I&*(p62;tc0|B zd!9YfAgaaDD>Ba5Fe<5RI_h5`67u9O{*4ht?6n9m0woRov2qPJVCsRQK)&{kJzld~YzI8ZzHo-ZyK4Uk9#E{IiL1)8wUxQq& zU(HzAP-ju6H{8lq%HGj-(mLM8=0Pu5dl`4da*1(OM(|5uhj63c0e}xs=|)Xg&U4L^ z3AkU?ANGHGUjmHhIWm+mVAXQgA~@3jiFLp6Z5-#Xum_}$#m}M9_Xh2kUR4&RrDiw;8@P=2?P0~REYLX$< zr%X7>Cgo`ScVWATjHHey7p9v z2y%H>6{SgVFqmhT{4{}MHxx3+~IG__}rY+&0`$oykR|+mTz#0)+xyJtl%1 zy%hm$pjdNXLEG4g#_#c+bA!%?IuW)Of__k zplV`}J2f*m zy`x%Dit>eeOM--lI*nLy{v^X-a*BiMZp~dvPtC*dmgC?O%)2wZCL7*cI^JVC!KkUT zx0Awy(-YfV%klHO6#@&;At)z``dlG`p$4HV?&F{P!PyTb9t5up%G;0q0v1Q|NntF> zOr*_PjmQbP8N@c&@(}3c*sSVy^PIa+1QSGBb*Q4!&q~pf7?d##)l_Z z{#r?ji>ZzMn-LUK0QJ^)&&I%t)v(sU+BB2HWbS5uY;4r=>k#^w{U7RK>8{|x>(K9g zyS-Vgc9IhYb6R@3KeVt|2AFs#PRV1bF{yWntqCmg8VO0s$LjeSLt0y1?d~>`HsU_Q zhZSdLEsl?du~?bc&8_Z{9vu(Gj|d3*2xhSpF)oxl(=Ss540jAWMn?^ZEd%Qfo1@(R z&gz~ME?>ck&aoa@56BPQr!5CXhwpQF{KOCfM8!b^;d5bEFEvH=C)p)o{)@-4_8Y9_ZO#I@$Vn6zr)stJ1HV89x-M#*q7Tg+jW{=Yn}OOtKOA1Mmc?(U`+EeQ-!h;Ql($|itl_?*Cpe>_nRdAiU1_OT zI9qzEWFy6L_}OMM?z21O1~$q1Vu`x0 z^1lInRaqlKuP^VoB3{RN{5`=QO6SWvJm5^m(Al78N&+xCps2c9LDw{ot?=2N-&H@l z!o*rALC!!=B8i!hW{o{H$}>IDOjjSJqM#e(BBRDbzCpS9IAk;PUa5fnCXBPRjvELF z9NK>`P>{@QY!DD)5E*e1b#Ks%95`e3;nycCF;P@v;dVG$;&N*W?;=$U_WT-el5*v$ zU<{^yqj#S=Xa?e)9HMF4(01o$`ih)a?E6lwZ< z&fK2Ye=lhUnxP1DemRH(5@1hoeFBa9Ypxa|NxSKW91h?#>s8 zMcAS;??MK35*xoXFrExMZH0zHcsJ$e_bWk%+V;Q}MLQEgoN=T=2;Pm6m6ViN<@%H& z;oOfAE89W93$5UGdIMgLg}!}`rZRBD2>3ju{XR17Y6rfLvYZ5OhtS?m$EotxCr>Ym8DQ-%klzvO^2X2UXTPHkX>B1&YoV^S;Du#X*o>sW8_E)zsC^0oETb z(I5yE`|x0fC@1qpP)5T~mzx54ggmaHQaQXHiBfQw^fzyx#HAfm3jYS6h{&(pW(BN} zp5^WC4#stV9W)c2r<|ZsDUzF?uhhI;ChEc~xwx<>Q4Bsg-wM5*6!9ChIp%C_B;8EG zCyoqbfQNJJ|ppH;YJr);#xcQ$;#tYsvkoq1%fgZ8&vh0JF{L$3Gzs;gYI5%_dN1E06O z^oasqOlm`sXVlEwhh?hyuG+zc=xMU4s~HZ?6Is)^CHim7vNipYe}A4;)fHZj;5j9y zx|*8qZM4`4Joeqs@bQy=?EPjslJ(P+mxHuwf874&wp*!QROCZo;iYSUx`po9b8#Dt zKS%l$L!9p~;v8Uk9iFAMis)AqNryqp+$WoCN11y1Z+1S{;RT#J~6w8DPJ*}C^$jG>hEUfzMMNz?$+4<~8iTxMaq$Hwvj6t`# z{`~WHl<2a}P;biVJYntH$_ zkc$rrJa2`JdIgr~=|1pGXiwYK^-u!Rx5&siw?u>g+ujJaCSoK0CxPfJg8)bAk6UQ=|1#JmF zzvb=4JLEgf=_&FP$9{3_UlfZzn`Uu3xVuMtJ}zsy!NsyVph@X&p;CwN=q`BgA%gx@ z{NG_PmW*4y4r;AQkM?#Khm32fkNFVIMEhdMzf9A&QGs^fPgB^nqu&T zTZ^t=c>ybf#@U`Hb0TXQq2g>jOJbJ~s>-mYVPFZ0?+Mx4Ml>-n^(4HKh& z0^Hpfq^Xil%sCE{lmvD794IxjiH+Zg_KOP@Sb#}B=obp}lUaX!1~f3=3j^PJVNs;r zKwktZ1~fM4AOKX%lJq|@aS8slJIY;QttJmt31Va57KVh+i26@fhG2k_@qdQeP!b?=I!SYRT_#1#C|fiP3os%n0&szU?Zn#wRi0y~pS3UtnuHz0tJ!0eA^dxo zWuJQq&TWxLEB}RJ|1XppndjahQ>gahauQJ(!aQ|0wHEh$03B;MHDF+S3m6X-7*AuF z)V!?Dxp3PBJ<8+!qd_EO7LWW&UiOW%V4w{F7oD6unFqfF2Bt*O%GAQ5axp_!C&RP2 za4><4O6Pk*sjiy8MMRVoN=qbi!$nS%Tt1Q<$wuIXmnj0j9wBQ}UceOJ*|m6zL< z8cf7x*=K@fE~s@aH)U5V zCAk!{l9Y>6Ko@Crw3Zb7LxgjXBl!ZFvtr|mEJtLITPYRt6cs*~epo?8bPg5-Tq;+1 zh_33Hm%aU|u;gB5Es++gc`4IFNE+>N6`%N@#nJj`m zRplSp15k1+I;_#kTxW8AtJ$7GQf{`xk3{HC+j1p~ zdYr3YYgEF>{?yaS&~Lx?!ia#Pq@p@MYAqO3-gSHc7E@xxhA%45oUlBm+@f)ck1CTZ zXxO=)vm@2QRa2o7528 zDz7Idc)#L>cxW2H9UM$#%p}6QT;<FeMkP2CkMI?#2xrh`bclZ;tg)w7O?^w( z^bB3i88@USK@Rz#9x3{nOZKtQydEPN+e+h+D5ek-{pMEQgm25PBTz8dbcn%MlH$Nc zLSw0pK4iW?jNAh~L@8uyZW9oSpR&K0T9ZnhlAK@4t*+a=q#68HqnbuRNoc+37@Zzp znnJ+fVReUt2R(!<6n#s*9aj%ysb#Z1u;TD7;xK=CqHHCl)k0A&gP8KS*~W43AVs+t zr#!0mjIATq6T&o_=#s%Mvyhd3v3)#IGS;&(jo|~^qvZz=?IXy#Oy_u+_ z0YxUf6cbp(2=IAx6BqXb6uRI7@62DW^ z9@U8uAN=x3y zaYKeqGg5S8R&w8EIo+#DyI$}{1QlZKEzeXeW|6RXbXui=#)oS=b-;p&97zzcG(wgG zXm2j9(znuk^eCrnP*zDL;r|uf?3mz>_H(M z{}6TaPZ?Z6cts4*RGe2S*buA89v_N}!7D0^PAEAKOP0|47&8_0|I15sU=95M^r_+4 zWjokOIz)Ddw-yP&%9zsycf^^32`<-bo&`ylyfjVwIn*Cz^9%K68ktaHWVjFN3*qCU z2O&{>8X6xM7^&p5BV`3Lh?9JCV5W`BwVdu-cp{TnLB~lZk3j`qN02LLsPB z^AIr`wZfp~dF5Mm5_yc<3&%Gr3s;aKg$yb`ma@@>l{lmH+#mVD7|I6)b=>#}P7sHK zC)eDnz=Y)SkfZXmj_4na-p=a0SIx7PXNT@v*h7*UeZaw}FxJ+M83QQCJUkc&8E_Xs z^I5y9#}T2SA<-?fM~1Ks%M#Gm%`vAEZPYxS@-gKWt1|_O!1Ce<(9pc=x4JHeHBMfO z$0st|{@0zu{kN70;sfdrXcKOH`?V0byD^W(*!#r9s${23ukX)$&dx+N#&1fkKXf~} zoCOi!t7dnobmZkTvYjF!A)>LS|DD{`{8Ec#9Ed&KprLZc9&80yjM9H+&iL*al`hD? zA*mR=A5&6|N(cn2aXHm}em7~z*{$yl5NYzOJ!O>{&=5RQx%?Vz_jALn9k*%pl>Dw{ z%REGn<4$vM4B5x8L@8p1K|mY;Wa9q_`bTcu{9h#~g%ar)kgRH*iryXu^1!tTYurk)5vN$_~BX{-77Lu6ZZ>4%bHpvzJ7b1PH=Q3j!+ zYgE+ohjaykkSs=el?ZV=w77tftt&b}0+aS-Q9r+%repZoJ%Wm%%|&u2#%8ak7xTiP zB6HHgQnCy^jj85%S|eGP0SkU7_|;GSFbz0}UpSDy4JlYV`TzDr*q4;7nbr7UMA$<~ zih;pW=bQaL+i1Bg%6o(PZvhD%8e*dE znwGJd4P~O2I(&g^vL5diWsodriWawD|BSpcSS=>HeeQjquX=2kE8&>BZ-AKMHJ!!m zuite~2vo@DAo9=_o(6D(iV~k~uI5^&rNIfYQc+nWPRJ=Xnhd{q$jQA{XlT83!UA-_sH-19z1qN|weRz4$pc;HCs6{x|oe1(HB2nLO1r6*rA5 zD<}7SyEq+$2)OLV&szYYua^)c!C#C* zpAU<9pBGl2!1b*+9sj`6pX>ekZfr4l!U8=64mKLF*r2+%w};7~7f`o^SmGPnEgx@e z#}rlUhww;>tsTEen@mgNnNe3=;O+osuLY`N*@++Idv0B*J}dZcUm#bC;Bm1wA3+ENT)=J$ctSQZP=pR5CuiF*Y50~m(yN9&5F_s2 zuQw^U6Fp2gz(6rD?QZeY@OTz*rD$nr3Yt)B&0FWL1Hb(oX9b@1QTpB9PRl}Uh2LW9 zMTjAhBYgvk5!prB+vhvcF+KTRL;JF_^DwIw`wMDiKe z<>cfRds0tmsHu(dvpHW9DdfH$%7iZ0o2bah#MmsKueR|TClmvsX5}&UeRtp9RO9WNVqSGtH%XB4lo&vmBEzqSZE{P$kifi=RzEUQmM5o4Qg}(7e zK5hn)zQ3OPoc?y>{8p`=1X3eFI1l*Afb0fvLx>}S%})b@izr8nicLPZJNDII8dQ7M zi8Wv5D>&&|I-1#eg!;@TF{6@IzR7Nt%TX5YlVgMrpLPv(4)wg9RpD{kpDa}@ zzDf~vkNZ!>AB|FTK`$YJsmua4e1qxp;X9XyF1K7(m>55VD-IP$zt*_HHY-wZ6z$iy zN<@M=X6LV(F?58O5C-=|!xQnv1is&QzE66GrgH`G0#|DdB!sKw4$i5}fE|FaGfE^% zz)~uDHK-6J1qB9H+4aWqS8>u4_p)jPF24TKnNgNn!?h&mspGaQWXYh4JZu#lp)J~i zRKhq6ou_l#P5_^&{OV{YdZ+(x7}nk0U8l#n=TbX=UVuF7wOE#q`G1{qq2DJwcVlRH z4)QDIX-L8Z!+4+h*Pf47WH-7 z*@UM{VMlGzoE5(?tDHtIijH+<*@39|(1iLxmImZT8w_n*3#|@%k*HF~M>b_Sn1%e< zEs#MQB*>3XWW$z7;+iIAWyYe7uy|;R8f)qC^g~zf6VY;PLYkFU;4S%{AQGbVWpCxG z2t3Zjhlgp7b}P*sleHFy9D|gNceo>=bgyBNp<8cxP_%I~6W@d$OU66BKQk zTV2UNl+AWT=ru-z&Mlwg9DCbWU`FqIT+x%S^8b8Xg(=SZA1TdA2eo1Q1LWsq$Z$_& z)Xd_8^k_DwO(NBfrh4EU5<(wuT=yF-bgt!os7pURBB}*BxHVKtnuw@YdV87KzTe%L z@fwIM%)>`G$k;Acz_ldJ_BWKUZ7}P<=Qf@C5X=_5e3mt|41PW?ucah!Dy&b{BVltFp93VoF93e(V25T4uJTXd7 z1Axc^@a4B#Yk)8MS)&$<2%YZ?!?%o;GBYakb9@hO0;w%k6Uc(wS!5 zX8n7D-<^7%WBx4)x=y-mL*ul2dzaei-X)D-Q;F(3<``BY`WE~6qr3{>b4Ml_lfOMp zOOSd}&$dZZmVNiK510&!)1C5$2Wt@{_IydWgOk{ZsOJ#+!*m#-r2U|qM<#`@_y~}F zbiKT(jL=rp(5?um!v6sznT8D?SO@sWq&{}+l#Y0-y$PcM-9Xg8&SW-UC~@&9$934U zYWNP+jx3tgUb4(GNKha?7<*|+jt78_3b)d8nG@?NVOdF%Cylt|bR8H9MdIwoL5!lo zocR*Xg&roTeOf0JZM55IEe7`bOW4ZNNmg0(XD)}v=&&85EUePY)QRG^)&cZ5rb0`y z5>=d5pqc+p(*W4V0eF+ZvVIFWk|v<|8U{+}Obj86^iW@{K>7p6s;=vVHS@H?N0;g-Hjq%X17*r4eya-RkkD==7+ePBB+ z`jVc7uw(#-7`V=z()L)`oylOGxI4>9LQer{trl(@r`u1Q_U+rJA8CUwrD8f|zROK+ zl_828BNe$O&2NhymsnHRIa_nOda)t+9j2laFYxF#dF%UcB#~Vi0+0H9lpWks#E`El zkz$Lc3K%iMDkl3%f;Ky?+ei$0msReJnsL`DyrTtY*Y+S~zICbyTDH@>g9wItb3d2g zk2xLnr(--_hrEX}Mm!W+Z2lmC6$k^Pp`^3(*a8HUKluL;2xdQwQxQx|&~~~rxRWze z`1QKh*FRe!Vr*n6DL#6XbnaB-YE-^#I%V+-?f=>C;x(hyz3^U=IVKw^Vy`8U%4V-U z6^0((GYQ%yurS8r`CGPIz%?vo3U6L)uB!71o7-c(HFJndaeOMhySKCq zH0;_)Xni+bA6*%r3?B!2Xyc`YKtm9G8!?RNk?fT}RG@=(fdLV5qoLbz-u_!i&iP0DD+&}B$@P` z-+3y#^(*d}QsoJ^`s~UG4#9bSUt!~+Q{_(ijbB|;FzG!cl>|tUo1Th{snJhaN%4f) zxqm0BGRP**n*h}Xv6Ws;MnT4aIdCWBIp?8`%J1jRR}=*WersFG?V+s4Ac_@$?2IcV zJ@pKuO!rWIGuyUK4TEnPrHt0C@~5KR_iuz0+AdXv8ue!al^(j~VZ}#c$RgE}EH17r zuC~o0v-g>RlEJS;NmDl21#>Y~D&*9q59#ohL+TH0z_lbgMT?t0)hbGgLJC%8Q%aFV z*J78)>7TPf$L&re-75NH*l`T&9i~&lX}dZWPMFhp z^IlVlw1aNPjW9o@rm8q~Cpi_cSuFn+RutNwH7Zcot+l;QBXQktw%g3}nfH1B|6YLf z0<=;^&yppxlO>0h*^)|XZ6T9#3PIDeNww>~z^G7Nr5HFNuwJ9Go8!7G9^`0rfw|a6 zl=chR2BHGR7%6UODJzQK3u_pVNPP8}SLZKJSyc32TI&^MM_znp*A-=--g{B+DQ`m+ zf+Bj4;v{)G{Lc9UsSML?_Kpp^_h^V0PPQ!WgW+{OPpJ3H!1D0n>+`*-3e27wA+Xlb zlB@%Daz4HYDP1e(l>N3h%+A;HIrBhl!ne8ZVl*+DRU_I%`{^)?$)ak?PfuWY z#TOitPB`06YdHc;hAv8zE)FwU={zOyMq-w0gEr^4pe`v5t1f(JvLTLFTXe) z5L+GH>V57TlanV74#=GPH2gPg5R^_A%B$&j`-6svU~vzR^}e4j9DBW-njmX2`Q=xu zGnS#E@dW+3{jePWc4z#A2U-OzT78F2W}_X>3+K!{nb{7?&u12!tcD?=?W^44eSHv> ze&W~UY^fi{oh`a2D~#S;^wuno;HbGRzigX9wP>9!>A+EW;(pxDKq*!y%1-EK=D7W3 z>ME-efbyfZ$hnRjL^k@nQN-515ny-pp7;H6Jd9<;@3JQz zr}RsvL}=-Ohw%HJdXv3!hnvIK5=00 zdGrdax4dUD#oG%vKtZ+b4~DE3n;gc262`8tRof-F8-v$^ZCW$gfEfdt z5)2uPoxtX&tScOwo!VAYjSK&>)#-gohUxbkRc+^=J4+GzOtSAHYOJ$aU#4lzR;*vK|tTRTct*6M@SG9p`s+$rOeSc44YNw_7saok@}R_t_lh zU>QUOxUHe(E`jjpsB#$j-x|N~H4ls&;$Y&vdPgHh75B%J6m!K*5nZ@PK&lg!X?i)( z)zVld$3!mmP#_y4Wuulv#9+p6h%9|7Xcpo&2ss(YG@Vnplx$ii5ofVejV*L^=oE)z z?E=VIE6^(i0=eS7VmDTetKZj07$qeY9!(LC=if`cMU5CGVctqSEn>Q+1BthTnzSDI zL#mkx9%&PVT()tYbaeaW_RB`CDqXJtH&|NQr|KM~P?6)j14`pQ1-?`Ek|X~2jg7>{ zLW=#90CvVk~RUZaC*li8KiKa={9{X@KYyI_^oQ?HiU5B-Hyz{^sLY@NIBel4c#&D{i85kwpg-wS zB|MX>X#+N1PKJiH03DA9l*_ye`L$*Qpl~}oy#Gpfm~xUAg^H%9Ys;Ek@46@|V;O}M zPHA*(owevJk8bA0SSg>*nQP{Jlzd0!C@ow)H%4qs_3zCWKn#!%$gz~ErXKo4EKW$Xvj8${yCLWf(h|?jUloPC!fFW%xKR zaHf7rj;ZGX$YpkbmZEHgU%yO7_BD;>eoREe!rB~{wmqG6Ra4WB)k)jW^9o34B&Vp8 zmzEf7T;S}V)I062;DmJICnd2~A$*yiMzaA;&FZq}54anzyo&2H6i)UhF5AE2;B~NS zuI3A8L$?pXH%4=o3vVOYl|EJ=@SE+|8}%GJfKDC50<60&w^@tI=@=X~W)cz+dHz~Y zEi@k0qK$x|>qdeqMoqTA%kgPdIdl}}e?nm{9H(OnjXw6UvQ2$~Z67c*9|E;c7l;~2 zFD0U0KZ=XnEI&4~1aH4u%XLS+Y%d4V{-l)C#_cxy~g{PmO5Yu@q#d+V_($AHZ5Yuik zGuOoDaYJo8hHd)1o71fz$&2OE80}VTOJ0?#h-k}(4U&psxPZ-~XoN8SEty(fUEh~4 zrK?$*%VR7}aX5%pfhbBi(d`NHWdfswFG-6cfkEj% zv_N)Q27VyFQRVsnf#yq!|K}B0h@Ig~asxy&b%s3~>T2ybND`ec1Ax4rPdI4SSMB?8 z6>4Q?n2t5`OXgP3`O^VapDl_KQWsktY(1bryP`Rys-j{XB3G`oSU!*rVZX`!T6dhN2jHh+9Z8PmrJ~VcHcE(cCHd#1lQpHPR8~V-%%+b>kOrZX{AaM&_n(1X_S`z%N6cfOw5y1cGO{v}#41nr^5 z`}f?Eb(l6hO#$7jGdYup$ARygJKBlZ%9^pxpTzy0;GET62Z?gtT#h}DD{nGO#i;HO zrtw6-qoX0=vHJ;|uX~4>{f@+(^EIO009E!12&|y=J*gKkOLOqi@gyFX_AmL$`Wv!qP(9sh z?S|kmVJt)MT_CW<+u|CuhJytw%kjkZco-uC0Pm8D8a6iZP5eJbljEKKCAza^;I*xh z2c4+d{*q9vv+)8nMJ^03H(4oBQmwiTD7bzR_qUF!PnW9{Y15tox)Y-CAxuMwZ2DsG zc@jVI>pG4y-=Mf+KB&ViN?Nl+Uaq>XR|0PpqDLiuMM2pcjuwbLL=kDN{YT4zb6&Ml z`PV_BuYM(Vyshvb>-G0!B_p1ena2uT+vb=~p@#(Aj)mC=11uR+1{MP+E@834z*+C( z$5?n{b*xDu8C7*S+@kb9sfig*p$mfX-QUO-?fJ~7Z^FL_K+<^?(Wsc1W+T#l(0QQo zBZx9A6g=Lv`A5mt2Cl46RJws183lX6HIZG6<$~*W=lg55H_1#I?XfaD@$J``T{7~I z#&hliX)khdoI>)LjZWhJWO~b*Mkju}(j^H%l%5du(ip)1=Esj8?q|0p1kd|ctO_P3 zCIJD0gipO+KuIE@*Ypjog||OMfU7qGN7L7BtL2^Nb{~IT!RPsq7Q`tpsQR6R!ec$< z)jGXcPu#z?3|z$X1x)`lMk;)|_@`99WWZLF6;hcv3;qRw5f>5v9A4@3ZME-esRAu$ zZg_aunZgA}GvK5kf?1RVB^3>Nxv^Iw6_X$6D0a_aDca0aZ-#$oZoI{EpK=x_x342m z`GA&XZ$3RU)u4c~wVR8faz$=G&h;~vv6pFz6Lh5=wo|k{7)2!D?YHRiyu8DmW#*zR^zRO58cmDByLsFICx<5)Df{8f#A3&k z4DK^*+_m*6$Pnp@!hCTAZQ3E$%u(zRCjwT?u>|1W4Q9r_7oX1;&g}e!&qM!cqwGkm`pW+ZfU{!d}?;tvp8YwmjwB=loS&;ml3>J!I3UI zTFAZz?66Vz-@;a#ldgF80jK)YO4JC|NWG*mWJ{}p8wsrrPWG4u?~{#ntk@6EwIj36)3hyyonYb zik+<|;--Vn_;JM1m4L(Tee-W@D&49!U27u6@H{EU#iNSE;cqOqI&4CZ1IEMi zpz9Yg?2e7Rc!Y|u8}f;fMLx!k{vV#sIV`g-?Avjw$xWD=Y)_bM-kFo_Cfl}cKXI~c z+itRL^WDAQ@x6cE9kttStk$}&^LH*8+&RYyjsvIyUC~eqh|}%fp@_xtL+(InF=3*v zq?d3^I(-FFt_I=X1NvOdsD072XPewq`)C8K+g1golr&VOHt_KCbVY9|+1YZwKit~q z)*i2RQfURa2ycs1(P^QGLkLon7pn~hSCk}|C+5EeAptn|#S|kmE5>{u8`+KMt&ex9 zRIM0u&G)rCx5^uBKGuRTNBhCzX-UaJZMpD# zO=gvFNcP1ZM@$Y$1oPOWP&5u$hBcGDk;I$*@$d}Vemj}f`%%Q5GXU!l>|Z2??(S3hR4Iyz_Bsofp>R~E?eRNxA))uOcTY4133 zjk#_@rSf&anBp#@c}EMC={&uoO`_0YuefYq~?*)V5VgIT47PV?#X<=M=o{rCUfF-FGhO*F|gUSRJ7L+J05m4 zRsYGjd_;@aoSl=oXqP?Q9yTpuCs+UM0j<%2zAlM{$NFL6^eQP%_N$YjtiW*0DT{{V zL|7wz{gU%gJ`2~^M*6zAl(=?slP3pmwOM;T3%gRLbB(NYnqTcUAlLs&9fZi~G;2MQ z!lfWLK}h-Dzyx6xg|SgS4D842>!}GJGmLRS%k$^s2Q}(9%Zc9PGOoFZRNq@_S!Ym> zF=?k}fFf7_BP&ws+yOrV3%=Z8P%z8bdJWb!vZ3jlN*0f%QCD;UCZ7zd7x(c4nlotH zVafdQw*0AJ;<{&*C5cBp3&vKqv25H-g%jR=K_pO-N%Qr@EkVebsql0-U4#|0h?To2O<72wt=OBK%M&-at$u?vVUoLZKGRmu=tzzr!t))N+(5; zcc(B7a|$RmV(%pHV_n~EInib&6d3c?F5qkv4m2TE_@>XvEa)HOZD5=!AJ^UIQdQqH zrC|py%Cl}P*^Q4Yoq5=q1mGV@2?_d^Lt;L| z_7HS*bcgfR)IeNZUN0cUWPcclMWlk_Z^5?ivQweex~Yh}J0u{)0+)W-Ldf9x?7$kc zzuDVD$!P0I@;OFrB2Z|)OjJA+iImp1+)uV!)0ZDt`%m1p?}?5YTdEf|IyFZnYgyA7 z?wYP#3$-#XUyqK4hf7MrJJag491qmu-28pi#rO|zY{P`?tmUP+t>^k?&hZY7O$dYS zBohb$HE~%#tqObt-Md@nP3rCUiAFN8VeKc*UjC#TpVX+mt(H_6mCvsBa4x2i?Qbqk ziW)s0(e`QP!?PhPZNme;*rv(h8uXv+--S_TKEEn#j;?oE@8@q^r*={|z>0p41nq^& zW}Wo92?$zAD+@8Ut1and`}R)011kVw!qy7Q^)@whFMtkO-3GeYtc|28Kf<{k_|cI% z(MJZ5)l`0~vIrV{`=O=~>#s1(AOmrvff5Knf1Eln6?PerXwdlFbv?{Dk z`aSIbz-p-3Xt6`Wg@w#AzvO3F61dtzh7tEvU|JbFoiA{6R@mFy+u8kDOgh(mUpiFd za?a^y1JOT<$5W-dCVbjCcGC}_?Qd1>*W zSqo58R8HiC$67aW1e;m7$6O?1U6c5`I?pxi5?ji_?PgxhBgDz4{E{gnYra{;K6y;? zy(6JRrWAQrVl*||puQd(w6Ybak)m=)yT-V7+;&^~VGA%JOZ%Dtgp(8PRKZ?mmA0g! zPlyEWAot%GrOVepf+EZ zjGI$A-1qFI^0>3|3GV-1LfIk^c#F139Fry95YG|O5@LQ*Wg{zUB7MLvpdY8IrlB!j z>ccUfu9(}-AwrPik}PkymuI6HJa(d8t6t5`$&(@8r*m+$MN5J69N}+HZgO1)^>4Os z)zYr7nK_#G{8idHRmLxSms9y5Szn#T+-T7pc;r^$GkV7{FB8>V$ls$k9?v#M)X<D)kZ>}1=iy28@ zIeIR~>EdUyaFp|OIb;|?7=_Qz`eMC3nN98I^LPI-4md3gfqje;)*0u5Eh8Jh^zHwEebBgY5dktTYcptO5P~*|h@~;|) zVmyD&mcA$)qU%6l+^^6f#Z&f>;qw?&oEjLk@M=6fm74^a9{k)?b@P}G8P9Mq)U#An z(f9j**0Ix^WFphFzML4093n(3ZApSBaFxM}VI=0pV=1WX7JY`tpF?Hq&?MnEtXmE3 z$*hFig)@yt8Lq+)rob$T0Uf0GI;MxiO$iA%w-bk+DBCRCZ?o#Nc`NH-T6<`U3JPe^ z(_XisuhMlhvd)rxm2noEua=wpzJAT^6EkR50b)y1P`LMjduV;EjqywnoZhzYEd# zR2Ro39j8E-Zzg7b;*d<<|2;kxRoC`3glvF{kjQYjB{Yx?N^xx4onVKBVBYgmYS8r1QCO$X|%6>do)dE(s`01=7`D5ye>%U&81b<`jc z9O+GuExGU*cflxr92n9lT#8hcOPB2R2gq*|{Ik`uev0Xn&hD^U=`l5nZ z8Ei9?$X3t~tB{znK2cWUC<5$$;{n{WoTVJmlihAUN#XzL+ zbwZhPuZPiP?;x*N_q*f%9x9ptP=&fQ%_F<=#pAzU952_Jl(RI67&?JZ&`o{(+ub#6 z%-lLk6DCUUTuF2ZTh3m2GZk9G_oJ3soc4`~9&G<+sj`+@T0$WMVqhf{$XH;?#( z)g}TNl2GbPNDOViHmhODlPeg_n`&L%~I>|tKcSyoeO`jI}KcazKQC z-kuF1+Gy@t=NKEg2q6(dPO6B0_Ep^Psg^`D>Ta&AM3g91;ETARpArZcN-)ws0vTyM z4rK(cj*F@|;N+=DomMsV>MPCw$*kvj%L#od*PhY<)N>%%9eOHT1W4=uvj9;SuUMUr zff0P7#z>A8gwTa-C;u+ph7h=fUB)5(8>HTL>SN#-hlWVg)oP7HuS$E{Mft39vSfQt zaa*g#5{WR>+?j#(Xx2!ZNa0ZxZ5j%X?I3&UfKj;=>qL?3aO%TrshlI$c$aRHe2Kk6U&Am1frQkepI36jp9f&6|85sK}N z`{@&awZ4NWaL9dl7$DxHnET8^10t&5^NmK6HuqVWpIhg-hn#6zSqY;--vfSX4uvCU z6-UKj;o}ce(7~s|35=bQnDErw1Z3%vEECEVL7c9Sx0LM%`Mx#jq|FY&&{8h*`({YJ?=TrbESSGO)6Z-)vY0Dpxl zA7B)YsOtcqtO2-MOk{~eyvmFtJy7NcqDw;dK_y!NxAxL}kTuE~BUXXtwEZoe@-)?u z;45p}bu8i&Zy>>$S1znQ+|DI%e*+g<0&+64r) z5)VAHoC~0GSg_B{8m_K~Io)(GrQxC&S*+;vZg+t4L%EL~_7^6ilOoL!_Vt7fNO#bj z9CHa`Akat})b$9(Kg2Lb$0T>e6S31Lp&vaFr)+sDV-EVxNk;sO&NxS|_6J{FMP>;l zZ1u0qEecLP$duIlT;?wqH)8RbNP~Ix;>UIc`Dhh+ri_!@OZCvxvW>Kn3=7dP@+Pl; z!=|pVUnK8=5_QKLFpjrf1@SQCzTS@93L zr0^j`34NWywFfaVm9XZOiEEn&DHIT(XaoV!+Pgof#YsKb>4-f(*0g!#J%|%y9V+RI zZ8$b1&_L-4fMIm`BOhi6v>q>EM{9c#z1*o+ugya9I~4d+a3E7xdu+!NW)Lk6p%_{B zb*FT48D?X4Z*#ciQ{pFoBB~I9o*V_DT^_MXh@sT2U&ZVU1|oirAtM^FLlWS!1i8%8D?ko37L;@^L|cM>&3v@QJV4xxvb z`SI7C6mBrWPwGmHAXhk64+X-LUEcJ=t_m}@@t@J7r>TwmZZXOpN`*?`JwH`~gK!vu zJ#w%YBe!dSPEbBsuTLH*$$>S1*fCT%aaW@5kNDN)fLTl^8GGyST<;msAh(|pr+5Qe z4tFuiW2C6>QOs{yc#DvSzh)0J^xGbrdhV#YV0wSn{xeau#@5AQKrc>rsTWgenOt={ z^f>HZ&!3jiQ2GJl4e;dlQ`98@oHBX%nE{mf*3%tjfvd!Xcv0#zji6iIffh@P{|v6E zXA}Sj+SDO9KR)6+XnGiWlo^m(;JhQ4ESj9~s-_}`XC0dA!2kMv{Q7jmF*{?09steK zDBQc$F+iEK=d$Wltr4_l^`sB^Y^sNd)8l!Fn%i$@CEMKYL8p({5HQwJpg*mq(z{8ODIA;9?>6@B z&4;#o7pgTa32nhZTS`IR2kZ;2R<#tRu|s$?cj0-OM?+8}^+?V!8^yO+0kNfmsH2(nX&USxzH36_h z?1>`8hK1*=0SE7A<4O_ffk)ADZ2~$Ro1i3h5tWACxPO0lK{2_GUBG0UUG)eRbMrKG zfsc=AGKfV4D8?Dt^k#kAVS|122jeRRD#MQHZ|AaoF7cttUin#sAacVY(crD}2A~Vr z&}r1;A$&IUW1X6z7$yMhB=9igbyVj)m!bs*oyRL6&%$G%T>sG1z-q)OS!+O@{soD~1Mfh6qzN`mcDN%ir;F^%j{@FkHAI`Zpjbm#s> zD_9i1RAu=V^j&m*yxX#={l!z@)t~>t$JCiT!^pHl!n_|V(B%!KsvK}NH1i0g(&Pvr zw!Cjsk|UsB8#gvYjC`#=j<}vhF$otxY)>!NKU)Eau{PMJT~o%e+~_&Co8O%_LJA-oDL4 z(61*pc1_|qOst6HyZwu-fjai=BCphsgCaUU@sK9QvnY?|hWxXp`141wGjn8wkWgM7 ztiYHP?F|V7<6B~PA3!W0HOv9+dZX@a&OFTMPChrgXXJYLEX8KI)SrNj%4-s;e)Np4T8pU z04?17*7v?v&St8fjLsSUk04{D3q2JD4;%pqg;|Y77_g;s>4z@oY!tlryOlRGCkjnlEiF~G$ng|{lc9YF%Hym6j-nSCmmr< ze_TN=!O}PMj{csr0kjMDMw4|MrbR5SKE+H=-}+@!H?K(mVw`my05`k}t@;okhy)2) zSnhN_p0V8T?DMhc&QS``hRt?D2#SNE@VN9vw1J3YN_<8SYFQW@F&_YDsyR7|npD-8 z+joP9ni^O-xM%6oymtQ%~!k16@s|7v3UWgGc1mSg)a%NB)Gk> zQxp>dvUN4?_ou^t@arD;-r@ievPGQz%`IE*%7@CcAb$8ossv;QVJHY0&Z zWpSn;l8ldKs;zSCA$gJjVLoitL@ofz^n_YibwLfskYf>z>=?bS+ytKkJ}g(DP<;_zSrXxkU(q=OxN(|UqaQ*qz|8BS5m$2qo$|# zdVf0T%_?;p;?HQPWT~k_8+}wYP&{GrU|0bzx!h1RwZ^>tfWPv2XK=yx&S3NbDMu^I zv9|-s9~7W`95LAjB$foD;!sBEfhMGixjA8eGh*)bQXRn?+XV0!s09QgU~hY)vx&?2 z>%DU*^`IbnE?LRGH5csJ0mR3(KLY55anYPg7Bc@lD%YbUdy^{zk*kS8|rqylNi#qsj8LJps|8Yr!Fb|M((sk!$ zdL47o-Tb;o@j*;YqEw;fGL_sIp&--|uz~L|nZ(z2F-EDC-rel>_b=5n-zi_PZki%i zVWkToXx?^_2x)ueRJP#(FcXw)FN|Fg>;$)iR`F6uQ8Vr06_w(5ogE*N1L4KNWS=BODS)y8a^u+m8X@J>>-5lcRyA> zUpyVZ8Y)%R5+ZB6RoUD}-+I~UBK_oxs`Qa1oEm$fA^@ZWyF;yhJ6c;5bxNb>UP*jo z`t}k^7eOTk{_2K#o57meNM0hYe7hK1biQQf|BVQTibA=Z{Up9B z2W}pBRNLhxNgkO4{5df9UKo!3TI=rFb9m(0}?XCa}#82sOrE-|6ko{`+h9qDq^I)UTusshQ)yE*KVfkGJ`ZhR01 zMNf1bxVC!)CKe%4L;I_ehMguC-QYcX}KB9x$!1EJjPtGYW>X*u1P-lwne6n)TmNs!@C_ zuUy7SQS@xYWMxeh<>~hKiQ=U`?BEeb=v?EiKtzMtUeCp81paaSP&9hloO}I-1HxUt z{_TZ+=~sV0iotO*-Z>KYMQs=X6@$ljbmhm`?H#DEANKHf44H_tkT5VuUT~E-sudH} zL%0L&z)Wa$brry1Trl9>Hi6>N3R5#)$KimcBkh{6Ev zfyx)G+#8(|Q)ZjL*;dEi0Wmdorv$Qy4y8}TYgftfrRp*Vipx6QZ!Fp8K-oZNkK5OK zT7zdQ+K#`9HlJeyHs1cS0x-m+{(m~CHfk9vPpLhG7jata55&7M=TxK1^q zgD9qp6)6nG(4|P_kZ48dqEiMc>$ku;1D@6|6{TLccjM!W^2y{~gvqIB@!^QHUSE~} zOI;HYA@cf;%NOlJA;J`*A_kte*%+2un}OG3>ks$>9ZE9~E_)e0Y6#1ToftOl|xkx}42S-xn$fgY~OGIfbw>uK#Rd|IVEjH0bqy zQ4jf*5$%2&fC5DrPj4Qn%dfA;^Qjb!fza%_CX(;zgRcRfrqyoyPJ`gpy%pQ`r_)4J zV!GAYx-J$oUYwbk*@%(r&)vzQESB^Htwxg#Q95p|9h?&(9j0j(&}-6%HmK18>K`bK zwaG@3DvV%TEOw*%u58~F*cs{QB1x;lhl4W7riGfapb@Wpe-ODeZ7_OTX^7LUIaGnnw=B!L&=~YrXmS2411IY0VrwVXx_+ z=pO!tYY!fL{pDfzn&kCz*7%xIrq!CHg}2k~wdlB+eH8G<9@^_dJ2GO{D5x;Ivxf+p>y)tkA$M8fTz;Vyruk(d zIxju?R-<52nJi)-@erK~{c%*WV#h2IBKe_+M*#2$d~_Y(MSUXTOejx;<;6i!NDwwx zu#)}j>v~8uL#il+#2LQ43Dbi|nYP&*9-r#FR+qRRO zDEP0dFf|U?jv+r_NP!ZYXnK^5suHud^zJMfEfit;XX`0bhqycXvv_kq<^G5jl78ei z2rc0>uKU{G---boT4_h?rjxEoe~INihq3=)58XHbd>0W;A~r9Jpj(iu13M#yNI-xh zE^+7|ziYu`{Sfs(MA&{5m06Iq+v9s`)I@~l%1#+wo-87gpsL%K;V%ogUTnu#`Cr_^ z38gD-5jSEMA*y z*;_sHPPA_S+N>-ehnezTX; zsp5BM&{(%#`uX6}zD*Z^9#Nro*&tPIx~cr$yK<)?zrI>cq4aL&w0?#6vrhLdcRBPn zv`F^#%gD$8j15dqvOj;YhQB@BG+|IfR$k*w|3_~7l!EP5J(#G1=;BD|>Dosul54sH ziySw^(53IqLPiWZhz6UuiE@L3H8W@1&y@Hs?7ji4-tEkP`XzPeC5j!VO_AYdw$Qrd z8;vNzth^AwB}B=DmcB5O8K4a%Q?+NrnZzbnTlhFi$`mP>BO95R`XM=+Wn=OjC;~L& z%1ZCt$z%OumwFN2A5^UZjap+w1LTZEh-)dwT#`7P*v9Ipr^xfWMf5BJSr>3&7Xv~G z1Srm-iq?B8?Nv%u9m;GK9~CtncJJ=lUtxM=LAJ|H3C->`xEMm@gq|~Kq*naZr#+^+ z#J|d|@rFu=;lpJ1e^+WYqY3V!>i@D^t2w|4&Gj{Gr$(Y?dk;(Q?VXwhUG%2$Q`b(N&-$<*(!#UR|Fqa%w(Jde0ZJ|$3%dMy{ z)q*S8I9lmPcBj=|tvVpm#DV%CVX!h%l|_15q|NG^h7WV*ngwK!FoylJM`qTYVrMg={SvsmCiQR z#Jj8GvIU(AeI!)q6rCS0usy)c{1qbQ-U<=6XKxU4W-f|fRU!A$mF4x2LT;K!^jn-i z8#eCYLb(R%Zp!el*ce3bYr;&hcd_T6--zvQ`5-$;D@%TV+~0ABWvyNRBg$&#@mSvS zhaWW+)fKt^oicryMgaD(Lv`x z5sgqbM9e^~^s&Bv@3)5f7M)7*S&A9U)_05ut_)*9$3)vJV?=uquZ33i^Oz2joXDTQkC?xRTbicOa@fsR zT`qrXFr<97i^-`6j-o0N>4Z|%ygx)*H#V|PfDjYahk%jDC^de)3nJ+@n^O9Pb7396 zomsF9V=Q5i5QPxpmT#sjH#9QuAXb^RJ?5}Wwv$xG>S`{3>C!-YD8=T}9NGdLL=78S zNgP_uZVNDuHAJ)6ho+OT`lS5li>agD9#OX;G76MwL~*N ze>lY7k)=QQ!9ZR?x{6eV5-ohD6zV~dV)yt_ZY7)r>UBTHQ?G@GfslvpJLj@Rwi zaJWzTs6Hk*kF=^A5%xq7nQay{>+4}?=>IxI^|8VC-@1ZgNY2dv8%mQBWBy=F+JIC9 z>K_7K-@qSZk7AgtS6P143>2^g5%5ei6Mg2zX-Np<2ev@UXJSK^G7*9 zA3EC_dR{c-udn$*8`wXhT~!-m4`76m)|pHni@uY$Cnjz-t8r?-2jCGPUnm10{CE5 zhZFbNL$%c7vsLR+*6|4sLkXo zz?VmJ;jl~O1U@7yVfB}D|27;+Sr@)g(Yf%DLd(tGi&mH$LS~~=G)9%>^wf(9t=p5A zLuGP+mfyZUpoa~B0AH)&Jr_J}+8->mnT-xC@jDNx;W^Q9cPnT)evKbNevjd~f%#+l z?~U47CeL@&K53FV%f&u8biN4dH@dak{`A>i$!TP(Tco1%-r0H@PlwB;YjSzx5`(l+ z^uO0yIF8c&h79|Qs?@sraAVEoKTBZ~qxSZ-*2-)T$5o~#B2V3(_F32*E=%`R_7@yf zEa(^h(|>?7`%SX>;lv9n&pB?g-OZEdE|CqEZ|PHuUvH{vU(sJv+1fV4-DzA|+)?52 zG`GedSAVoE>dwY|eXl8T5nm9VB~{X{$&A-^>E@&f|@ z=CF8tP@-OpakOSJrd8%rqh#1I@1NJd9QH|jZ^wdJCbT~_SJ~Pn3Z4u;FB1~@T4CY8 z>cT9LI8VhHXr(5v*8ax17LJX+)8neQDrrsW0qa1#1eF7~M3z7uV=A zP7uoR!NStD0O5u5UD66ZiHIJjOs;yX3yvlQ^0SjTzjo@p%)sB0^~BEEEx9D?aem_x zTDEEK`ElFE?X}CH%-$y^7tC|Bl{nBSh?|YJd?aOi zlu&D%km+RrHek7*u&@|rN$Amw2|FuZbtqI=VjXsg>A-eeA&;7#2i-m*ha3+iA)Ac&VpA!nridf~PVv;mZ z*LM-TZyWzK62Tcs&Uyg77jQ{o!7CSXP1J2I`Iva)Gj^l+SDO6`k(-^DTrGpB5>wRz zzvHIH7Cbu>fBA3cX5dcAEN|XU#*U@Cb?3y+`~Hx*X2L$APM9fZvZca(WgXDyX(}o5 zoUI-#N?FgA${x2X+W>GBvSy5S3##?3=zOGWs9weAE0}^>)eweYk9i!!ooezot3Z(U z`%0&`H((T(mzUSm+j3l7k5n$I5&PyB0S1O&{JBSf@#Nfy5;_KYal-9woxxIVZa!tF z6p;V*lKM;M3rN=10%78D>PHy%qnp0a zEYN1~{x5q&Mq0=17E-a3WMk#0>=r$CyXvD^`q-KR>H9=EXGNSrRS!vc(` zJ%RkI4}3xJF7Xwgs^_au)$=1Y6ZYq5+YG&-_ySi0)Tbr$J->Paoc}_U1dKJFls~rvnM*N#ahc9Ak~+WlCt>M za0dA9y#dHPfEXiB5jY9cbtr%S1fnicQj7i?pblY@?U~e0-QslSwx4R!lOnGiVLDXN z{R_uzm@Yc%0`?K{0~>1t*2W4AY0d3Sf&M6rXzw6FJCIdqBhY0409O=yL>`oKea<<`z z+FwTD=Of=$xT%~UGK(6-RK#*Pc0`8+euhv<3I`k{ zTVIbD_xI)_7%kO*8TaibQy@DcWVCd++zirmQVW+At3Tb>!BwR2kpEmJHKJRovk=yy zG21{@WW!W5`M12|CMmf+e{J?yoz#_T`o;H=pRjnZnEGKo!uLT|wa((Mfk&jBAnWQe z$ExJDD3PYN^L^Oynf(2fBi)PI5xmB3yE}Yww<2xsHq|S0z_OImeWyZuXHLttwb3~G zC%(tJ(aGrC%J8B|q&l;+^m$sKKRMFL&B#F9wWrPmE{jD1j`zQQ3JmM)o5MxE+^~3w zfwgpIC+Ue9s&-MMOhyCGSZY<A#D=(MX-eG~HbxY0*w7*w2kC%%b2c}{5NQO4I`>BsT$3wA^^E}F4 zYhqd=oA(s-fwt{r{4DbvAON-YFfgmY;WIhSIbU;&POpz)PUc&O6F6xaUz;tlfB0`} zaI;*bd7M>XKNA^x=aoN2 z!*S7z+V0X)BY$QK#TlnQds?VNNA)WMuK*>{+`k5>1gr}7K!mvFFZX%T91|*GlQ|tp*1A8l z`s=Ll0||AvR_)e6;e@vSLN1U6JvL>~Q)9dS=HP_Jt zq%`)L4Ram*s;m|%nF4C%$sF@)F=7`@mGhcsB3q;8QM)HauaJrXBK#X&lWwl>$; zTEQJD>FXUD*`q&eBDzGitcMjIqB85t^K*6IGI&WqXOs_C`+D*J=Z4LOvg$mYi=P<& z-Tbp7T_qu@aA6#Oq4GoVCCZm&gQwgeYvDM^nam9j;6C?n-YywG1%H6B(&YolmAmX9 z_J93$05`2c|5=|N&*mej=_*;NF&h0Gw`XPfs#hZBn>u#BynP1T2i+HeR0pu%3!C*i zE??p{3&vyrdk}HNcaze({l2x=pa^^N!Ujg>``$kVM$ zCC2nLK?U3)N`d3}gjVN9?(dA%$=YsIFPlP~j9AJhe8Y2^HLz6rM$I4ZFX?fTepY|j z@zjN{WAtSh3nElpo&jrUo7R%^y6XWD=Hz0&ds)x{9S$cHTEAy~JkJ;2TBV9Ny%uq; zARn}w5SnmhxL0^bpD(q$59YaZlzX2vb}UOgtT!whs-`!*I~ni)+vw={!@9P|x7Ofp zY&^Jczxc5|{@Y`)*W2l<+hlrjqv5IagG##hnp+FA`}+#^TKWm+-fl#5p+1|Z5Y0k69g8|C7=}B4uoM}yPJZ+ep%^qJPpv<{T9^>DAVbD zuj)k#e~ro`;LOJZAnP^tUo@=ew?rrJuhq^SZ%-5i7w=B<$RE3)(xL|>#%!DU$$Jmm z!9_)w$}IZK)pQeMtE}hqlS!|KPNSl6xa7Cfe`}52ul*lo&s)(8WmZL+p8E#O?q2W9 zi;BTgvIOgXIg0O2FI=_8oO>7AR(AzOg<0l&u^YgaP|h#}yc&l@SZ}+{JZzr#{mzQP zvXxdQYZTVeHOBq)XWspT1f$E<2{5it1%NLjoeuQ!=o&UTOm zq?j4vInfBewswGhYH;8hq8!4hGv)@Hh}e`}fcL-%W_7oywv5aBY0sWFBmzt;BX)#1 z*jf1yspq?CV;vG5XHCS%UiYl|g0yon_=elqpl|KwriELCBedWH6LPBd8p(-8RP)E| z8ERa!d2h~a>Ef@-hXVJ+dh4)$&2djVtax+uSyrte`LYd^W8po>iaSKM)h>6YDzVN8 z{0g<&pi-BeNVfaDYO4zXe+I|yW3+MsP?d76R%KCbd=(_StDOk^RiLLY3I}PgqUAUb z5%&|wAl*Fyh_caVLJXLM;)aSVv$ZC|GvV9zp{^>EFza3cz>UtBEe0OsAhD3pO)Uw*(m~qRKdrI zRdAh+RNkoF7~^0QDXD+r7qfZ9U|ESMj@#XO_`pVZ*=)CCs$gn~fz|{BO2|V}nswWn zrhjzh8sSkbh&u|>P;u#33}4lUnUJs7@O9pl)*m*|0n?MaLs=6fr*hE!$99+oB@6T2 z@MB2>|2T4*nd8s*x71J2Jij9=d39MigT%V2k;i%zVma709P+PD*+FaF43EI$67K$u zA&;VsGMIdQYy5aoxH5Pqc0Q?`5S=h$Z$O)OgFnS}Jiq3f@f5MW>s{ z#0+c!b5vp0+hS5C4&tWy$4%#}qU7dShs>nFS>P?6)G+3#j=C0zPDSIy`(@GO`ux$D zZ6njzK(e30>~(sS%7KQ%Y|@nQ?!Q9*4PUW;vP5PxfU{NNWJ0nMcYPjxKC{fVQCz4I z$w#rbxBP1=V#{PIi)a4*k~k@ynS)7Y&`(p*9B~yw3LxaLGTvZn%0Ck zfzG1!dmhzB%_fX!BMRj?u9%Xz;Y7}ss(1e8Md6rB&z$ymK&|-PGb|iO81Fqe_JeAp z;1?ubY;<14#MsW}WMxztW|uZzuRz|%B`7|!T4WMmdPI#E^Rx@>Q7T4J+%EPjXEHN6%h4+nzq26{3XHJWNl!ci{ZVaCg3jk z(rLNF1#GePFl&*tuW2_-wq{35-2$NUuxxsksi-}y!UunfnyfpX20FT;tb@+xt=sP~ z!^xzXlNQ^W6I1k_%d|bN`dhXz;Y8Tqb??lQI-t@ppZLvwqy^aAV0c?5{&oG)GDyMj z=YCH`hgQI491T8#jrR+0--?7SK6r2g1a5QKAE7RJq0kR@ZDiiBGd)~{!u9;5I7PjI znqFr$hb!BCKxB^PF{OP5^R3A!ZRu;emFY=m7Rq>o{E?;J7=7lh=TSj&na1z1(4kTK z)>Gi0j{9l#U|DT-DUK!tY&dpW0e|G_@U)D@?B{%ZL<_NZ|97jY#RVL%8ON&w*@~*= zQ5?%LGVkN2?j3c(&qzwkb+(y71%KHM!TS39(>Tqv-L%p_zE=Z-rf4<@ynYDd1wIDq z$TsK>6@i7<1_B4tIU!)*pnv)=@<$9n>`tuK|Prg-TtK_PFM#Xl-;( zxBIhtD;O?f^CPutM#4ZP*>0q2gSxb#fI)Qhif>M{58OBz;rB_#atfXk_UIj!M^zln zx;)*{U<+?BpS+mSO%jrX+fnhZ4ppweT)NCH$^98|?u9*9%1$eowRsqPmo9PcDl|)M zr-=#hC`>J&^>vgp6%F(2O<3k{LK3E1R0oU*%b1@(bWXWsu+fa_oMp0uc#I~0pG%#= zR9Fm(vcOlAsWrRO$2Oo*h+BxrvF4W87h=&*g?kohaMF!2(G~jZ(I>A!QVI(93EUO; zoC$BDYg9`ff&zx%hU4zC4q0~#&7%%)(Atp=%DPyi$AxDzhtDyf4Nce2OrPjIPeZ#O z5;|7e-6>_!tHVMw_DgOm3!sIntsOdzm)F44i%Fmz81+eeShngZQX-P#k)ZBb*5*l8Z@$#wGiKS};e)!uY6qe_-U=;LI*7U>S+l1uDUQWDW}X z$q1^Ir9(g>PflFNe!k@}L|Go6VHaTHUoNUMX8MOcYWscbUscFqu?iZkeXB(LkO>;^ z{=Z7{h*0dJI7u#;lV!U2mW3v3_y`_eGs?6=W1=8*`BkIKYM;DTI8P1Z0JMFhoZk@h zXb{OHfzf6|HUQ(LjmuU`2~BXo{MY%P9;VX^hu1c+EyMKDeg3|r<|8R2sNGH#lUyg1 zL~Q^w5#C$!Sp+o*x~YBNaM!LRMs-88%}1Miq440uMCI&=^|1M`-HU9QxG7{B8>Jz? z?=%C;mkEQ^Qt;SLwVQNBK8||tVHTrV2;dn_n5OLmyvCtUd3UD2V9&_Qi?SOl{-jO+ zN0rDB9#h_d!D*X<79kdRmnNNcNTuOz#;T^`wiV`!v7V}R0}u7RY*L1vm-(`Y?uW)<0{n7pl=EJ~ zpoy^`9)_;|(d>jw;F%o_(+Jv5a&|5l>7>Iuo?fyy;!xoIa8{1r#%~QkFi?_Z@6ed( zHq69sM#fz)%O;*oLTAzw<{Ksz=Y}02uO#2Av+cxW5;?iM`;X_fdco}|X%0z4eO(Hx z`l;c*LR*m-qCZ|ALV3V7@O+FaOF#21n)uxD`s6B~KJj$JGOE(vBd_fyXc&Odq0?Ci z1PrC_olP8YMgW;S<>NP zZA%J@2Y``Hhf|yOlV=6II}Y}m3yQ{{iz)vsg(mNUkPZ<(G5X<$AZJXAHgZ!Ks7p2_ zT%^JaevGUU2-i2LmtHnfiTPas9&FGBk`QhBo?PQRAB>n0bsNeVBp3KU0qY19_Ytg8 z#m5nRD78wXZUO6RRgr@>Y88z;3H~ys1SkcSbcyM163mS_)pd~zKEfgHe_F8IdUK^% zz`i}p03B3OHuhOJ)v)eT;&@^7O64P=1x2$V%7*WV zjYuxZ5dD<3*fa{4MGORCw-D!1pE@ItR+5`;GU+dTc+!6_R{jc1KXMNs zEP=H6#%e@oLx^#lCDGg@W7G8T)=~Fk+rWxh-S17DLxUuC*wJes20Fc&8+>l1_fbVq}Y#1S@7sZP3TyqXuUUw%gfB= z%&)D=V!gLZFzOtjtgyj!7f0ZYhDjj04Fv}wTuKJip%sGG1h2zGRzmIFv6yKk$l;slbYlWBTC6quS1-5WKEgVy)6Jix+7lAgBUQV5>tD zZWsT{>Tb#GhY{!CMZ~&w>o}g?a6)uo-Q@wv?!b$aPC5x;UmzOb@>mfrF=dy_W<)p@ znKm*CHZmrA^Ki57(o6ODTxgQ*&k558L_XJj_uW_0gm9``2WL4iSvx+X7)k=i5}+jO znaB<@(uGaLA<+2CS=G@mtM;!){~3*O4Rgv4=gwn{2k`jKYv*{o%WDHnJV9XR%(UBYza5ij3S{}4I*D9A0y%L!IJe-hOUy{l zPHpF$bN7JS3opEYZ?BF4P#z_yb=kA@WEZCc4x8>rArVkKywm{VGaB({e2wh%zG6F%}dG-LO~szp!O|Wze=-Xx&v%?Ub?@f@Y0E3eG?P;Ca z4$*+mp=8`T?jDp$N1Jab83_h4;UIsroa&f9uPJhlVNOm1$B`KXEbk;l_cJI!5Z z&6dJ;?b^ks+qiL~Q@f!LzW()Xx7~)g>86{uZ{IE>XydY(;YnWL=w}La11-b zN+F(RnD`yRuRh=?3%Ze+yFE*9X7mdUE>*zVB>DMJTR(fn4kK=IB_KKbPC zl*8sgf#73SCKWG|Qw$TEVc0bp1^I1MoI}Qr%YAB?@rW8%3k=)>aqjkMZBtWxKyxpJ ziS8&jlfp>=-5fR{L6ga~#NiL>5*9f+?3i&&3)3a0lX!4AiG}9kp^Hp@p9GRMnK-3% z{1O6@rHF`)rsR}lg;38XMq3zEZY?LFhSs!mvDuTYxa2+tPL})NgAYugz542_e%{A8 zti$DIrhec0o7B+O?%8LbHL7EQ!TayOzjNnK13nJ*V4`lN_c_g>JoQRc3k=l)+M*X# zM^AUJyP(`PWX8=YcQIj&EWY-InX$i2k}S+Dcbi1dZ7@AcZ|3qA=_#vTN4d>39kfve z=`s7y(jj3#FPm?E&ifGuE_w9S5rC%AgTLHx?S7Uu`q`iRkR(ZRJz8U^bgp zwCK?~M_;{K!*REOzTN^z(eo~56E0(cowTh4PS*G%<1t!@7a3NkK1PMMu4fx1~gqSoBvH(ZS_>bdd zj^HCTLA*e_?6AyeBTk14*;BiUk3G#&nbiU-!UEs}4hnG<^|IqU;sZ^Wz)?syeC#X& zBBKah;A0@NIU&<@A$xj}6(7g$q1Osm3k=2r#lr#<5F{WNr!wG}p7q!bJ~pibA89AF zoyfiCbZ{Yai7!DrCk4{fbS)kw}{}CY4Jj0GI!ACqteQhC=GwzO;btnk_ zTJCY%L5>$mwfK@Q;iFp%KxD-Jgss&b-1;AoaICPU!ZjBuQ4b?euseH#} z;Wvqjk4}%Gpju$g0`+{{Ia^e!TA*5>TA*oxijPfeRJvNATA*5B&H@!5=WJ1_ vYJqBjYJsK&Dn2%?QR!-dYJqBjISc$h2`SPqx>wHU00000NkvXXu0mjfXZ@%Y diff --git a/media/pshb_bandwidth.png b/media/pshb_bandwidth.png deleted file mode 100644 index b0e9bcd60eab4e1576409d2b557d8804b7965a5d..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 25626 zcmeFY(|=^&7d9AmQn78@9ox1#w(X>2+v!*xr(@f;ZQJ(L_c!lc&CUD)b8+f(>a0_> z*Is*ZuV+Un%1gk*;J|=@fWS*hiYkMEfT08LTLECePo!b3KOi6ox|Sj$ic%sXM2b%K zW|lUlARr!~m8s^6sxr-?USL}xUz<18hoDb4&~;^6>dTB1NAA|cVh13ED9FfyWW ze?T-5l@hWl8mN>L2>7kt!+utqKv$ceoyO&v`I27e??+#+HfvD9t&?c+_dZY%->+UF zvo))WCHAHZ2zwB)EU09Ea0l)JCJQxGRPd3*?uP4m5Vtog;g_H4Qs=ZA60cfg#+GqM z1@Wtd-=;I^>2!b$B#<;Dlf2uPewvbtyD)lrE;=lHxL1!Hma+L&^gU}N*dLl{Wg;IS zMl5jx8@^)uB1!}$#^#`c%CGIeU%>@y5NZ?4aUp+n@@Fs4q6ggty|53|`}%?^ zdOMwfdQ-U|{Y?2-m~ws7%_FcPeg&b50Ru6AT{gpo64ZrD&Y9_EC!oU2NCk13{I*_a ze*dgAa52Vmmx|clH6XJB*zcO z$x^puC*Y)FBwyw1Iu8q=I&=J_z0h-L@{84|GR}GRsq}6I+Y&zO+s|Lzi%5)}+pE() zOoMST75wAZ_zj+m6BowN=;nI#2>ELgvPgWjdm!T_vsG(FOLHxakhxK%>H7lfoX!(( zqiAz-rSq$>gz~)1zFM5ndb|4T)Vva0b6Nz-HZ(cR)3LCn5tEM;yP!1n&N$gve>k_B z#uuN>kb{~-jOWo7heL%Q_jTxietEsK^~;^>o)}jB+Eif1XXTT#>t#n}!hD=OpeTs3 zr8%Jo zfgW!@w-)~u_bn$^z=L@}XP7ZEyoY@PCO|m?5CJQBAelN^Po-AIZc%qyceDt6r!47mos^%5%z=>!)N8M88de(>`RC ztmc%~q^@4gm%;t2+p68B@AB>pGUz3kRjMkHcC^$7s8t3X5-rY7sGwfIpyH=zW(`pJrsCY zrNp0MP0FT{w;;}6oV+MXq0ND+lopiABm|_6ql=&Q%!~!j~GBm6yzxi5I!%beA*dhp~BCDwxKYVt+ca zvazc$9oOa6aMtNGXLR#geGU}QHjOY$ZS@LW!7Tof8&)d$ee9A-l-yVznVH8E1Qjsc zbzHoh_#8N0ac$j={A~`JZDC_zs)$S>z{yA^&_Go|*TJ1naYyXJuprJCUgbX(^03l^ z8{o)r>&796>Vo>mE`m~5l0soi;nf8yJ0$pURB>Y?+jI z*6aPx-H*_~i@tD@Fr!73E9LyT$-0QUsmR2!LK@k}KTvIK`G}(g42w;RMN2%!rZ|!~ z{2ctR<$2U~t6gG^f0|=DE|&`qpGIT9rk;io+vnOkb4s6>p1u9JXWuopvwa^}=Rt3e zRi~SwhQqAF?Dz2WBx8_bCt~=$u{n;I?e3&^*_I(r2d)k-RF7SDWgjX&abKGo?7Ju7 zyJ@rIbeO!Rzd@gNCnYwFo=e`QS7n&>c~j}t7c@+}r7Ni`^|!(|FW$tveC#D`Q35 zT_K)qkw7%~qlSa48Nld(K$7|MDkA>wgmHH3Ufx zMFwS?c#GfMvnuESY}7VUzfiC6-o(s=al~~5iu!?CPi0MsK_x^9RT*<$a<(I{vG`LM zQ(i$>e~f6FX%K5bbZ}wJrr*0ydD3d)?cAF@lX@N5>+%N=f>A8PRJqQ-jo=MbUa^iG zZqj&QI{lCr(s!ABWb zY1FX-n*M*ERw8GlIIJ18T4CHSZNk4v-tHj(g${|w4*jJ_FaA{zeGe|9M_WEly%f~s z;db^!ji3@sC(kft$)KRLZl`mFK){tVzZK1o&}HhY4^B3t6wr^gW{?^mIuqn@8J;zg zWNkUy#~f6f<2Z2p2rV9gD^*4f)(ka=H;;H_vT-d$5V4_-AYLNz-UEt1BIU)n)7z^CkLK3BEtyHo;ntZ5&>lQU^+!Vy;uJ zl<)nr&Y<_x`$F7kt{r_5J!Tbq6}%mt56^S+P1Wo3Nv`R8OaJEfF%(`rh#3(Gnm>OH z)E5zkNdQzHZU-do4um)&YS3x#hCyu&$uABY0ynVZ;Pbv9qQ_yR7XY~^XFhgq2xahb zltx^02x9{AOC-(sPkqQaMKgRHfHClyULV#k!@nf24JmWx?@hF1l0|4*bxR6F z7@4e-l9lLNx@@yexlXosnQ)cS+F*-Jf;5(C1B@1%ApI{sEmF;T#d0w(9dj9X2|_c6 zsrW(3fnTuP(|Z$Ela%zx>dL8|73DT57o3+qcv{tXoR*wWZOH}2o8cRaeEEFsore5t zU1h$kpqMjX0h?Hf2Ji80GyM+z;dAB3RfpnH!*B!KTb$w3@BjXz3B=JsNhm!0Y&n`pwIMlwRRhJVvsI2d~;sl!^Hhe@m;)K3*u z-BB(nMEr(&OM--hIt^QL_#{PVw2y`AXv$egOUXs|kYVHC&%M*TCLP>cINoDCL9eW~ zv6jGv)fQP_$@cQP6#(M!QKNU8UUvV%H4zY0v1dBNp2v{ zMEHxP0)ZWJJ%F{paRLjYLAUB;$cGm^7Gu zppdX$pGjYL#6?7CglR|>|cr75SE zWoO2Xc8_{7m>Jg%O)lZCtq+Bd@bEhD#xY~jjuhLIFBACmcl6u(N3{rzy{onB!<^m@ zs%~SBUxA4ZF|L^pNDm#SjRysX?=!i)L=b$0g#o>xGa=$3^kQkE2)gy*Yq3(%hi$W{ z_Fm4E%)}AQt#3^xR_<+XkPPz=R||ai7pEKX?;o#GA*+LJJx7h5t~v=)C0 zUzixH%|Busv-dy2;@`(zyJkKq@@8MqdSX227>C0{dDU`rbFsht^U62<=Lq>;?8{)I zcgQyxb{%CeAn=vg9{5Gm+|-)THF!tw^=>k3#o<_e{QFo36@^7dE#@~?PJlU&EblD1jwb|}mA?Aqq~oKfudSM7{kX6|2?goGT?M*>fh3Q^L3GE=M=?nq_ zi~8RM3X+k91p-0@A|)!M>H&J04ekABaPj*%R1_uI2MQTU(ULseU=~9O15?NU3tdBT z2BYH1)U#2sF)!bztR=5OtCyxUT&)I-p#>C%fk>FG^rDUwMUxasa^%x5*Q@X5pj9R@ zGxK2U0M0vSBHR3Ef~z~7%lv8h`1w7CTTBpH5dsZVEH4c}hR)h0uJPZO|DNGNEcjaR z{f{Py91aQENI08UZ25nPKob7{7gE511&Sq(7*R36#MJb1yPGhv(R#T`y;4iol9m}b z3>7_u%ZHNIh&o7{N{RgA4=&XY>*`K*v{Ozk(X;v~Zd&03+w~@)8u1t$N~nzp%AA!t z)A1Nw4sl5%eROF7R#sL#a7-Ns(CU#*W!PiSx6=~Rf#?r*JUM7askM>h$4U}Kc0lPT z6>b(POKK1lBIJFi`}G!Zh^H~yYB*nX7L)BRAL4%Kje2uLb@0GOtHrkaDIO?90$HLV zaMU`Z!AOTP-d*GqLN2G^5n@tF19|z_Fs+u{1Y>bu+}PsaR5DwWu{U*ODqEnmlG*#9 z6~4RPuL?@+H|L6EkWVX{xANWf(N?XNDzF)}fJ1pcE~qFNN)q@y%t|FuBt-p6*y{8O zlR1Qr6Wm6vClgRnRwf~f`(PIq*8B7S`s-XS@@BYfZr8+ICa?al0fQb8+(0PjzIl1WKfzs@HV^{F_{H@#hV1eV zBPF@MFqGl`{Yjab)};H;&+KXP4w5Ymc5i1I5PN8#>(#1pBs)Tas$2>Robz%EM~mee zgnYlz6rwQbZ6Mqw_4M>cr0t=8l9357SLp(!YD>LCOpFkhnIY;BhD6EoS*hKO(mR*Hn)Uj4$2u{2|9M|j{v4en&L`I6N^Rc?RDjNH-Bv;asOy0$h9^fG^I82xi|A37V z(CU0#ha~)rH(cXi#Z8MbV7J-E20QMt!7ABHEZXw*c0NcjkHi^zN9Us2KVFeme& z)8b$V6prLb1`O?e-3h%*VA+o_(Y$F|Jl^q^-p`M>^Xfx-g=r946F>kKE|Nj3@Wj^4 zUlIBc2YX}T)$FJ@^ney&!Al7pbO~OTer2fNNa%6KU@)$TslW+KOVd~#rt|x>o%qlV zplj#|-DUH*-(AcV!Ahs!hK0+CS4?nN%=nLptzwgxd4v|&lN#LcPIb}b9|s}wBh@El zWo0EK2>pBB_S-Iw`B)N%J*Adfi-%xSM5bbei2MgO7EL@!g@9~85GqCK_`+2laK=cI z3&+2~T-|m?};lx5DN73KH4W!W*c`(xZ^n4TvZcL>bjcPTqC%? zSvZ92jn;a2-qXUQ8`g?|JP2`LYt+z(WHMXHK%7!QGB((6-qR# z2^~jCB*bJMmy?-#a|K8|S%%$S#}vh-MGo7wg$~dAy(8<>^(j@vzDw-U8(5+r-T$qVV0G}+Zlf{!}#iW6ZCr^`t^<IUI}6k3g~}sRWKsPpjo-#aDv}~duh9lbkRc}0@BWD#fapQm>m1U>X5?# zvgs^8*dphmdvL85d}zQv#}%4C4Wu^K&`UMLrhz`R z2S*k5f!rFRbgv+KhJ4mv>;}~F7`8MIL}b*38Ge=l28hA9!7Zee=&fl z7x;35!H?n#n*Ux#q6B)}@T5RR_WuP7NhY9cB>NRW-43MX0S2JKtOWK7iIU;}7iCc3 zfC~$)ZZK8_q)~x62KukXaZ&?JMgEIQ0T3cUgZ%%8{Vyc{e-QG3Qb46<{m~@Hc6857 zlkK`UgGRfXt#J5vYWIifKsYio${Fqdgl-fIlyaH~4t(#%hEDYGX-RIE)#5+l`D&n5 znfE-NEuJ4FDLlP@`hDyZF8ZQHW{Ur}7%L>eMQ`#Dm$JP(7{!Vsp|G1TmizS2WHE)2 z@&!iT>aI7d*So_P#+IExU_=Ubgf2)fQz?Pz?GHmll?PPYwd{uSc|A$C@T32iVNm_2 z2-1Oi6LVX>@0W0-Lve(DJ3Rry5d_>W;Ug`_IbN|NKvw#Fymps zV4>M3&r}niyQkS;p_J<1z8}j|BQ6n(w|lwPXq}Xl^!>j5O+juM*Be+u@E?1~|FH+5 z-%7UC=4u^-!#463j4EHM)%Y(gEQMZMTC!5B@#f&*V5iq(r#WRPN!0KER{kHrpXGy8 zW+nZ!oFfY)?=kRrS#Ni*ru;v2MJEUs_JRYf6pWDV&nx$e7$_C*@rnk$B?We9M;q8N{F%&;lHhX$xNHLhE@6oGN+xcEFF6m6bQ>SbF~?Bsg9+F4x`N ze!X9}>zC>O&u9{fc4*bjo5;8<*PMj>@3NVV#k+k!Yq+ymdfRGB^?-ak8H%&20ar9K z*gsZ)M%gkn{zrZ9&OR_TF@=HMpY8JTVk00nm?Qd64E$i+UsU{N5h;Q9L9!t}pO4GO z+3s6C0pO@HK8G5>0r$`X`Yt7IAT%5#vtTeoD|a4)cH)_&*f_6{sO)SP>SEhT=(Ixv zX=NQGSDjSnHUi6C93-Xg0ZIH9U%I`?C7g--x4iu`(dPz2OZNvQJY-crN*^Yq_#hw^ zCX?giZzOl`#!~7i$xLYAD20VX{7JZ>ZSZCN)v!u_A1!*;q~V@bNo zH$9OYVG}?eK3mWtU6sW@f-fs7Du8LJ)B2(ms7B{+*RQ*SzzT7pDqy~28srJ>oM1)K zD4(MYU8IF#7_m1;qHTirfsVu5zvV~gfdi|> z&QjTR*L&>w(sH%_^kWDvhuwiQzU$e7?Y5cT1fc@jEp`+tx_xHfYhPbChCO+R9-L*w|fyA`zUC~;g z+Z)0#UP$adrseH`G*XdDEMO(W7+q^^QBC3HCfLcOtf8KN?tbKNdYEz5jBuT9kFQ6K zo0)=>6V8G?A&aRP%trbvTc?*!PvAkEWd01%hWj{nr-H!eLlk4z%hS4jCWrl3l)p8$ z1JF43&XAoVpiZ#14YrmlwZm+Utuf5uy1&2P>!fGI|nBAxu`8QMgao{Y! z?;gl~Ql0uFC{;htf>G7qytm%9Na`=2OYpeno zMQ9q{;8BbZbW!42-LGIy>Jw=iggtN85Uq;_J!&57S4X=8Be!iBlhsMYZ_+7hI!(_p zT{?d_S~o}83AkNvea^`+cE0RIo$N(1w1uzR`#qNH1J{aLURDfwJf!Xm=)d{jP6~j^ zmu-A58^?qsZHxBm;nL3$QtLCuAEa?E7RsXjAgjx5h#e{hGD3e(uvu7eN4m02fyzDM`Ze-N2-?fRW#XnT+J7Y z%0C_g$tL!w_=jf!LEDg&$tAb-LVLvW_m<1m>pbO>T**R=u^Q|tsEfcs<*d#iN_cc? z%5J``JjgAiiO_nP-eeVIz_dt6HDbb8)IV|Ub&BV@HhMfPGmaQ3$BYuaB|IRuI$~ivnx5vgF0wX^rDoW zB-)vu(7y@}lKfi+LTTea1?zm?(qW{zT@;@o!M_5oG_ezQrU;n>Q58||F` zB^3&<$GKW}#|i%x6J*&a-xuec@yK4Hr3k)-k`7it50TMK=tD*|M8;MNdGRN*5RJbD z78NHewfifz#!405*%7xAzzR%>4>^%+hE|q3C{DB9%yzZz5Ln`VH{n-cd489T+rvRjqlAW*A|Sd0 zgCN$v9EckUj2?-V9nD}!Rt+Ut3Y+sMPoo$L5>y`v)Nd7OG4;n*aSwlK4FdTQ(_f0z zr_id5DityPh8IAqUXeFI-o-1lUr|3rg1+6D%*h@s*wrrk^8&Su=v?vnHEm?jkk@07 zlF{=niOxgpXB}y9b=IcqvhD|2JhjRh$OqDtMTCZj^vTAbNIcp;W~ch zI)39ie(eQc-{be!;f7r)XePw+7y;2*3DlbXAT}c@>{vm3&BV2q<8%EL3y;hC-)H63 zcS5NSuV56B{)6;6-rCU?yyRb5T+V>P?Ru9}Wlvgyy_&%wB<`=5>XyAopwgnoxpwps zF-wipegv;0b)`iRR-~2m^@l?#i&9AJBsK>dBznSX8lgzM1Tce*s;&^RXd($ay)?H< zTtb)3d>obDcjveHyU_L4m5!cKi1g^TyVb^paz`WoK-Ga0o8D$Y6g!!dq~gke$CcI8 zIdpdQMr>qRK^zeMB`WSP00of;fW&DRj*DQsG0*i$=?gbxCWE2ws+)4b$ZSgUi-Vr_ zryBxC2fx6wXaD)%E(4EmmM`aXg}<=9^MapWj-S44U6f!j-3Zn4cBt$q4x|CNnE~`r zR)S({22%Ms_74mz0i>j9#r&w<)gelBZY?CF0rIL4H3H7>G^%S z@&hRDC3i=Z!&bipC2}qiQJ`Q7asEqV#W=fcqqoe9f+-_IJt;5Xe}>S#L-Hl3Pm=`) zUsT3xxVgqh$h`}hPJht1w4OpZJ&mH_WgF>@`a{MQ`4h?=%d4Su|2!a}ZWzDM`g06( zBjCS0nEJqby_~&X^nJIWPLIQ8r`Rq(ncSsjVG0VLTD>O?Rw1X|<11NOqPAX&z9P~s z)q}o|Om|uk$1knoeeyRfjgQLZiHp}82p&5`QL>TF)&>;Fln}=CipKS-q-`1 z3Ke(Bn2h?D*of(mqDap{bNRSHj|Hg_hWJx`0}yrt$dn3bqpLK=FyRp*Cbawny8)+B!1`d$C4Hyu?W}w}t+r(n z0lnYl3Am?tG?_WfAIRAKQTMAtd3XS{9ShMM;PKG@27g_e(YBR#BxPon*jn`Kr!iJ~ zh2j4uY5@0iL3Mz29a4IYbqBr{&Fi2llTO{&57=ov&Z!3v+__l!L5nJJ7diDM$FT`< zUwHU%#`nA-;*rbml(x(7@=%%cNC9Fh{*95h#pF&|fqIZMpsgAM@-BL)U(Uq;xWt#mAZkSMB|lrH`ebxlgnq3DaB9jsL8@}zJu zi3tZkqRVXWzn<%VM@B?0e(8pTwVc-K=}GzV($AUu zijE#6BAf*$Ry&tD^cN_!MUp!~aEZTO7&I_)GG((~f7Fm7WTA}|14vk?QM9}Z@6Rbv zSoGZ!{m*2XJ%YS<~`!B(UuQ~#*0MM6+lEZ(IW^J0lR8UKM$P+5!2a<)P zN-3qa;?h(fx<3vXADYs#l=hX9g$Lf8sNU@T-f_W^rv_FGX~)SbCf9OzqPKcA_X7~d zMn9W`3Yf7Fb6eR*Klps3p#uA5{mHus{2(X{(L?!AHFL&P&|1cr5zct(h7d<_*?S6} zXL&ZBb*QMVd5L695EC3cL*U}1h+G*dTu>4K<#N&RCTJv0ct53odBv?G0{f!tvEjc&>d-_qJ*HA5k1?s7)DM_!+o_l z?gQHzgKXg!*>SPq#V8OhjOPvW^2Q9XDnbBVf{&~lbI*t|>B_-U#USg24|6RXnX-$f z3^a{-_1;6Qw2_Qt^S2%*8}m!tD>@$t3;~nK(6WOaRh+~dfCEEezRl&O>neHgV1k$9 zRRV{T332cn9r8wfY_HS?vE$mlbNw$!-&lyP-{+MjSxzv|#C5y>;G8OMG@}Xl);7t_ zc_7!lm?-NCBW_C*Ka@6q+dEH?jLOml?FW!U@jCQ4kihk`PplJUU3Rq|(yP0_zCG_pPIejKm@*uRWHRNavxNkFvX(U&yh77WGvQw}& zGl3&>$y@YC?FH~JY}Ca^vN3@P~ zEpwmoLBRJ-LM{%+Cy%|4nQE*3Vxug^S%4ZA11Q|~+Vib8S3t6bM4n{0aIo4tYFCx^5l0V1> zI@plwMb6W4LQ&oqDGcAmrrGoj`B0AzHLxm-|DFA>faje_!Vh)}%|z1H@W(xE&Meyl z1JZ}pW!OZNfPHn3U&8ys*1Q|pYTdp*tC&+}j#KPoiDVEFq*7yhn#719cqs(N82AR-$8~E*deejibO*r*z z{11WG#2K?ND4)x}sJoQvP$V|{6tNp}fn`BN0pXCM9z;|&#>f#A#~Lk5LZU;$0Lp;@ zQcvjP6`5D+aAYchem)VJpV68p@6~;}|F9T%b*duJ3F2dMAvo)$rh^ud$HEh7ezPsz zLZP!kGI+p{kSVoRt|1Izcc*G{z+7T%q>{N)@bO8+iZ~JAQ8`o3T?B2{LG)pYDprf` zk5T*_AH>w3SjD*;yRWX$_~v_Zc8d7z(D#A}U6UOR00^e2Up~Kuw3#_&w`)GUtsk(0IK1Df+ME;XCq?XNxR4{V7 z0*o-yAp;520B)UVU&Dvi+4)i9)D3X{#rvOA_ zZ%u$N?-?~%0+k-KNZ+QkcYJ~jC1~U*Jc9Czw{LE1ZS-|hWZ-MOlmYHh%ykH4OwM+# zEgq}bo(UJe--zli81?U1^Lq^IUPDqVWJtkCsVRcL4!x7MWCwYiQYOXWZ3p~ej+1Q5 zH!#-73=+6gXh|{RxuFif^PcDl>^N#w6i}vkGkL&##i7+_S(k%JY3_-rWMI=?uyL`?OcuxtH*!NJWkBhX$jx zi_B>zNk-vTcB=yxr=J2LQe0Rd0i~jqu`%ECV|<{HHq5tV9v1{kM5r z0gv0SqfepbC1^h1(L+WH4_}aEL`?juJklWTieOT?xbQFI?dcx$v5Am3m|>cwBXr^M zxWWc~^9Bj=ZVp)qPmnQ1fP7npcb1~7?PLaRG}oxPc(4rC_b%v>f-q9oz*RcGxE=&! z3IL6S$e2DYJ)tiCfJH3mzn%4>Orj`477!4%KEB9BeAc>L++@B~IVtj5Yo-Z)Pdjp< zpKApi)LmfGqKf^>*|T4lPAmVWF6#RLagH)KMw=k5Oo z3oym+^{o9U5d*S6TY6rz7FTL0ki*o6HgGFB?9JkZG*j+bY7?j_R`}5}7d!7Jd&eT4 zAiqHx$16;0@TL9sFrYnu#IJ@x8}isjDL{6AB+Zfw?@J| zMZ<`l3;}LjG$mS~kZYwE!hTfvjHce1MK(1Uk3O-A8J|?R5PgK!Cj|mjmS5hi_QJb@ ziV6k|GoWQH4zPpv_{R$djE`0Yi5QhNewb|LI}sZ(z1qO`6_}!v^50ATLV$z3N1?KA zt%@Cu2>^#0vnq7i2(Eh!lZ~p~U6XJMpnw4&ib|eb(X)i+wf2F3u$IUc6p4%>McOgm zYr$zMYX5Xv>KQz{iP4KyWBJjmkUz_XF5kyjboW=S@^<9jzDgxEZrhRLoqkuDT-rl0 z7;Qj^YW)mJy^x^|jpcVSs=rc+XfPcgT!a+Op3ElI?^yQYiJ;n8 zVR4t^GB_%Ww(pnI%h)ZwXqPL!HB!dMPWKumLm z@%5%QW@J;=U2BQ*m4tDUj*Sgnc?H}BX;IkembZ+r6p;?&2!_&Li5x{gI8o4u<*4O$ z2=}lg`|t)SId^7&7$;E~^E9U*(P|+J^Ve%jpE*vb>>t5^@EukStZiJtpT_F+&Lo6{ z*}jo0h6I3G6=H|PTjm1w$Hp|Kq_3z7@1CaxYD;_s|BLwl8yXi2eS z5LP0#Fr|bN7Kx=bEY{KGSh+IR2bmQ?VsLzJLKeP|Xt=1;b|gZA9f$$4N?zvp6&gr} z6)bFY&Al`X@gBFsp={|-U^_J*lT=LeHE%952!Tx#%oIrqP|f?W=<5LzaYXs1R7}+3 z(=_t{>_8PZI1ChG8wlLYOjw{}5s$$QHzUmMpfF^!4T0L|C9)sYLJ-dz`G(6j2d2o< z{+Z?#WGYOuB2I}@l{Kx2&}@JnP$CDy6<}o)>sgOjV38B^AV|XJ103mn8%m$CtG$n! zk(J43Xmd}`IqVlIpH~%ls?Cuiga(PLW$V$DkRI3=IO`;G*DOgCJRJH)hzY>`F^&%C z*v9x01zS~|^Y--`;$+pgLX*hTh+HGigmN+A$-UakjO}Je);?9lr^R;vM(@Fmv)+$W zmCsETFOSHS)-I{;l+ZabOpjvk)9E84fTLhdM6AUb$VTGtL0@+ANQC-^ zqX_Vu*n-eWZYKLENW6TKZiU;)@oDnm|rq zI5=p*B(GAMrPB$y{2q}uh=|9e7?4XRTYxIA*-(U#s7D(Rp?Ues&D>x_5!?wv_tC&@ z>ypiVo-|R`cLfoT z&k-+lz)=Em>0e`nr>ZfDPxg!mC9*GxJW4*Xf!$R^Y#ykDrN7``f674rF=JCv|23K6 z1ej=?-iX7V{jx#>@W#vhUSnQ2*C&q-m!cYTT zeAJfYU`GcFDDT8|un1PdfkN}~!GeNr9FoJyH1vl14aQT|Guz2dzS+AQePu&kCY;k&M?z0-KMZ zSLoT2D< zim|#FJb-3KuD%3l8J<@?ieDYJ`6RX07Ju7h)$42wa{e&f&hX1xFKM)NvY1<(0=0;9 zmTy&;qsBT3-c{D-XLr|YOj$fkeNH#zE$cv*KIX^_UkOv>ZlEPni~AJJ-J6?p`ypzJ zK^uU0&2jYdBpmh+HGcm>7S>JvK-nc$5kQrAr~0lGX+V2gC*1QCW-(jD_vK*nZ~f$f zRjZMEKbm#T^@?wA)XwboNo4h$@M6pT=uNO1$!{Cf8S77>DjRlnEIxA&c7+QevtLsA zbXsQPNhb%#)fiiAy7LfX!t6wNSyXI{3HyiFUbx_nKUcX)bYi>rTTnoN!aH)(5l^tw zavUL(!AD`lgE(a<&M+Fj_t962dw>eU)j3IIPKVP_vTx*Yup+XGvgqn^I62*wyrffP z{FEMB=XLz4a#2OM6@2~9>8(g9D!=}=SFt^!t!cj5vqe5-i00L7NZIO5Ig2rH|ItRxVBJ;|YBOtuF?8^Xw)k2J8OQi`?`!p`;xqqV7IB~IDA!ZD^xPXAT?U|!M#ff$T#j$Pdvnbc*jtnE>g>8l)6{JTI!r}4 zwiow@iY;S43L;kmZ;|kf{)Ej@bA##B_M4-%q=umEra;(P0o*mbXD!wH z(wc6SllmhFS>J^)8I4t!la<&D>{wZT7Zr0Jm)@87f;lUI3j8y98Ilsoz@2|B8f0AN ze7=mX)g{yQ$A=rNnzUIKdM|0b^nGuNo@zhYYRqN=5e=O@>d|p z+PEAw74gc2FEX8;xO{mCD+f_|uEs?0_#)lcFZW==` zos>a2mQ2aO^cA0D(D(~mCY_?cs(E2h0`=m_NKRF@5 z#L9Y@>j{6(KGfD9Z!J+D8^n&Xv1PDV$5f8EU4-Euj=%+>#&6Zd-Vb9xLAf1xP@+w> zSRJfro_5ZaAQ!FgP!jr-7OciCw%$(kgzv@IYt?O=*z0B(V!)lB;2tSD=``!{ma=)@ zkleI;ATng`Rb*}89m|itK~W6g=YQ>yFuiqgKX2;Sx0I0#lytdzu^4~NxV<_$X*|f? zt|j`v0y?%$Lvx)Y2W&i!Jcl}7e3nMulw#%kSq3K=47X3CoP-4_ZY>u!$Q}kz6-F@K z$0AZ8#?{{fpQtzPRVL~`qSHV9bv837Im)&RK_mlAZ+(W<*|NXL;kQ2t8`SPH-G*x4hno=IbaGLYmiNm1bW6`)aJ4iS1MifV}F z59z^0Ph%ifmn*5Iqw2}#S54}kR6^i2Xd20&GrR*!)xD7hjC)%u-Uvk&8~9Dzt@ek%Fbn7 zu+5!ZFWNKfoSrMvW?Zvc+f~AGB?^uQkzqh>!TUwRc?(MZQ5T5$Yl+%5$woB+cC}dHM`JSY(i}s(c>XeuS)kOZE1Tv$g!KdM?0rcbBr)C9OG2 z_ocanv}oF=}G_C}hqW!mr! z19vqI7c3Bu;dVJ;0-|n#D3r8711g*ASXvPV8ZmWK$8Wo*96n8oR^Q9Opy-W?3BJ{` z#dD2meLcib9*yj7R!lr|8z0I4u7^Bo1Y`PvueLJ z&g!?)(fYVNZl9{1h21pvfsQH1;+KD~fjmRosSz#A8A+iwt4CG!e2szNvGcWAKrOMI zcI7=!d{=o;Yb*WNvw%2^31oEf9J4MkeXX#S)lfH0rs`7D1=#NEV)TNjds-$|>0Uj! zh^BUx_yeeIkK`9m3iL@!W7^}u{d@1MuG^gL@NS$Kg#v{AA_XYxeTR!g{3)7~0J)@& ztr$r9bGU+N%np%*eo>3;`E*%+iII-vtIouwh9}k&fAq*F5x(4Bo`Ipw@z_)HRDzKH0R)~FfmxeUST#}-(1o>ZwgXW|V?RNDi34+i%@wegu7z zk5MC_kOKC4Mv7xfxRywFM6HDUHLQg9^74{H=KjO5TM}zqp8k#wvrv;A>FT7s-kL=J zC4haeDFzB9cc69tqRBgtEPFu>yiDpE~HT6!#Fkp&`Mt&eVx ztaY0+kO){?CCy=5dWI4?_EpyX1q|Q;=Y&v*%Wku?;4;x$*#I#ZENPxa*@g}urQO_= zEij#W>^E=kE9>Hb)Qe0u9i~WvZ={v*BS17&=~V-Q1SrS;UUML}b6L;pQUI8{WbXEHhz zgR4=g^$6_p+pjmpyssZ_UHr$vqWp!+8}|0`YstH}`%4QZ2Q&UKKNv~c;W&51p#!2& z#b-|}MX~o-BZ(pz5YBwi?=nVR5{<)lw&itwIJMau1jS)FcW~8yy~GHHUWU?2Vo2lr zI<9|*&A{JAzHBir)AiSBUXBBJ_$Ah!$M@SONkw7viUZaAh+kt)^p1Pt9f1fyd+d6q z+8BiRfAw&dQBn18xTb`mB!(6kLQ1+px?8%D?(UH8Mj8Yhx&)LCk?s~jq(r(IVn~NL z+xPs>`7+=3TC-=?%zl3Nb6=N8bU9odM^g_{<{D9xJ>T zf%qZt{6F5XRq`P$vLw-vha)p}pcVk@@ct>c5%Rdyf$?02-&V=AguM)d%oGJ4XPz9p zh}Y>qy&lPcPZgolxR5Fqx|y0u;X}b^uTl9X@5^aq5GpSp%F;w9;w$GE)>dN z6rTLYsZcTpQhX-#K~{s`d;A- zFiz5=ED*#B(b1^vH-?gK5!{q8M{>)XBRZ`Dag6UTHhmCyRLdQ%8)r*auT4eRrR{hb z>SS@sT93utOx?uoycX~N+H?rl?aM_!7I;m60J_tiKtmH)cQiXMd9Jp5AZ~J;W{I=T zwcd|(^P`g=*S)(xACb6SkGwuv`BkHT3bg*VcuU~BQ&x`&DZ*cMk1?=v@S(;6g{`;n zxkZ$GyBNm7@^8~nR$ihQix<08a|G^|607-s4IkUJM&9zqF`@a^8an@Q>uU6>IjpX} zGX5yxx-;>xLb>+QNly*JZTar;mS)}T*)RUdh_=Fz`Yvs?<@beKQMs#=!dtOI$l`y1 zBhuiRbDl(XAWaz}HNNIL_xOqzBPo~9>kw4<<@Cpt)7rf??(D7mZA9e=-oeq}QQ*ww z3D54>8lR6WP1Qr#fl8~)+DG3zD1LyjDAAwl2WD#9Ac}{d`etvN?Pv4&o$>_TrUkQq z0SSvJAu;ncFf6?GJs$0D*%*kmv$noG{5gSja}S^KdIf%_l4Ej=p>0rQG}~b*O%f8c z*6PyIF8*o;=RAKvz=iUiIo`j$xWx+=S+tk^9i%g;CvTG#D6=gN8t3;XT^X$maQPlC zg(vh~#vOtOR5D`tlmswB^PUD5BGdhPd+;Q-Vz>vglTE)l!!q_#4(EIcDT4ps(TT%q zEkhmW@U`zOw3b-g__DojiWjcOk^kHKqQ3RXAk)kJS2L6Ak)ZuR1}C0Nko8aSjmxN6 z`c$r7-RU}gdo_>zE&Ll2FjSx*rXQ+r}p*?<`ms7DYteXeHLW!#Q1C{bHDUF{>^jx zEairtC{2?g>_9d z_0;_pzLfJk`0|4{{4(~1uge-C7psFy=bvtNtMjYM+!imUTvu&ssvi$YO@R{KXJdW4 zl0~su;%+y!#e&{na>g%;Wqy6=q3Cq)?}gdo6%u+G+wl=l``|k##4B-#Lv8{E+_mgL?TYquk zZ0U9|19!Gl*8}zfT*k#DFIUyQ8FKw($`w1KFP9Z8-INT@-{I^Ugqt&@@R3B}`K9b=az_J9K7LK!x zU8~=AUMCQrVmNwL>nMDQlcs}`(~Ph7$L5&Plh;zg>~nmE7}}fqGI&j(sv)~a!fIocJ9t?!>fV0s8zp*)m(lOi z0e0C>LEo)3aeet7_M{6A3T-ui~X@#bIctsNYa=oP;xS+iG%QG@Nk}sFtJ=B z*E-CG41M1-+KU)z>48@QC@q}+?fK;V_CHFlmO3a=miXXlu}KGWjm5kMqyDZ7e`{CO z;7*lMS9> z!|@n{?b(O1kdVdhV3AHF1DNdvt{zY{PPDbQpd4`~-g4YY2q>`_2OfX9UE zam(x1ntM5u8Q#WLtDD%8Dz0Q(GSi&+dM=&GyY(=ym@W78x3SM5{4IIFeAPxS-Z8Vf zDhQw3D>|buR@Io+d8|nfD?UzgFKy2BvG^(Zt?{4incy~-#6s5`$3_mwnu|f<0)MXj z;ey0(N{Op9592u^Cf6q>(zOs@pE-NeLT<6V3LNY*n1tIFXC5DfcMJ9f(OkC`RfcDF zT?wCDI9>dztA@^thQ5p;&(QV$;3rCk>~kyqlml0-siwq22Y1(B%}5R6cr%DU(=B+y zPTY46B5Q|J6G|_#;7ht@dE5%Mco6Z)pdnz&oZOx73cT_BsM%BFAQvPsy@aNBUNFNa zRYlIr_|*O-=%(e06$&KTm>Mc=POo+xn&6!hT0>8ioL`n z*uzy;1;t}nLXH&9XWRN&+YmR(Go>b5!;nzV^wSxo-E6W(O>Zqq!tDYKW1lwX>c_?GeyBOLXXRv4_nebrK>~5sr|0$^3#Rt$VPa^Z1o^@H^JAFFg$7gu9qK24ALlwPke_*6HEA6o0I`i-mYw zw-GPUX;7q$JQug#Sp{D13Bc5uikoz)Mx7z>_0Od8B_W^>j)5}T`Fw7$c>ONl2WeFW z8Y$1KWi`=rts22|^bUvE(TRtzaUm@bIkZ>Vv-_WUc6+1g6O_wUrkPVWXsCSK2K?h* z%Ug^^uv3Fdrt7t;-9zw@kcd_Oc>xxRfAte^esRBj=_DH|`2L(mquo;$A$$;dGyS%$ zwU7T-ux{7i^wLMx^q_}eTUiIQ>uE=fwnI;DIzM9@oAPhhr%eJup|1oCc5CY)3;sxr zI3k1o`;7qsKbfc6RtcERCG5M}J@=|t$(j8q%_SKd$EgwwxM{AGovHb3CTZ2jq`7iH z_S;kW%SlhhkO(C)}|)&r?AxU3S3OUi&$~sv|6>YKeurQrZ{_ABW7w)Sei|8~(D|T{OtL!<% zdZHItJt8T8RpP?d9TaGNCoN_fBU&K2sgW2NfAUxE5*gUP>_1F#hBU0WL8svAN*8Yr zc!QJgT4r=uXeC0t=5uFmV}uKfZK@-GJiz4 zmPgrWQjED2uX}X<7_Is7L)2A5S{eyPJHTpS&Op$#s)AcE6!P7xZL)nuz|DgUkB&bAzc%d}`d z*$`wHc?Vy%hB=41R2j~3LkzGz$nekO&QsGclKP6>YqCa2Z0-Y_>n)AtNAer;KR0_h zP{Ym=4oQ^)9IsxT&}Dy;<8TG{t7DFMwkKma<~h&_IGwBn_V-l&3O$GYcg>{Oy%XxnCu=80yPETmoOis^g zqm{yPj>-#8#6@OdlcNQhS~1=JsXz+N^uhg zk<&8CVB%xl!YoAs1rH~|Se_(yVln_E>c zE%%~M48n@}l(CVGtIrIgTls^J#>nNmB#WDcYM8x&yCA@-b)ZEN#NAz+akb-QvFluX zGp>r_l4})nOt*6;)gNviEp1ptmAhwT}bW_g-Ai*uJL+5kl7NHnbr>;!~naEU|;%Kj7#0X-~!{ZrOI=m`)bZWu+Nshap81=#_sM5JgGDXu;8)nyjOg64q97$HX*j_+q5W9Q|C6K1qO zm8+&;N?q20Is_m+`)0o+4Bfaq`k(TS zD%Fjen(?Id5E!~DxI{Rd^LdbibTc#2=Vk*Gu=jm9O^Fn~!aF)k34D??Ic-@Du;TBY z&?jJkC`fdG1Yc@a^hht@xNcmTXswjUVRJC!kPCa#=)b?e>3L!Z*tU;HkThFRZ@XNT zPQk%;Eu!V%dWyU30RR;gJ=5UR(jSVF)COHd5%CR?oedg}`&VHuD7DLi>Qmi>6*#pjvJmLlW}83sRwFxy5>FmMb99i&?c2o;U{LyD}!shJoo=m+Cp%2^CJg3*X# zO;T_%g)|{LLVdKkG)}H)z|0O6f`s04&$eF|U^_)xDJxdK`6&7Yz{CGRk>@_ite@LA zlLgnpFzCKrFFOI5BRjMb`tA^*FGdDr)%K=8-f^%&R@UX^@Y1k3+QV-BRy{CKDL7zV zKvT&qV22ncV%TUM&*cT=LK0`asAZe1O+X$Ob&~J;HQo&-e!XZ#CL!*_Fi`Oidhgtc z7YMn(m3TN%_bI>KQ>vFlY>4%5LZuFwV`8RrI2L`| zNjCPE_zw=q2-+}Zm8Q)z@a1e1G)5VXh42OMv{=bASr!Aea7#~-S*nf8XWB|8Uf49p z@_|5XmD;A3j{>>ApgG%!g?K8_4Tqiio-A)Td@n*q%>hUd3%Pa#$<%c0Jr_D8=nNTs z9SEOj85yIBsS`qg(6;C4;Z%&T`XM*TMs3&P-D@7brYCb%5^gBU_DB6`B z3a$CXTmOn(Z6#;1J{jW8j@D#2XZUskSnqx4(?H~xX4L~&hjF!}S+D&_JhPm6NP;(xi$H zAvEmJ0N*#i8+`Zj4O+Nj+_8?(-z&hwWD~(`V*QFWdknsyR`_L!>zz5F(r#Lu!%37q zw=`LfKl53Jy6CwzLn@Q=B4{45;@X)!vp;?)mZ8aOH@#iQ&@Yr;2yHxCsLTJz;I!0O zu95LlHRzc(eS|TV?_5sILn<2@1{ulXxyFkf2QdK+*{#YrnjkDHsD?YhwPTX*5lsEi zRNthN98+fRk0jC(^G^UD(NWn*-?F4H|4nU=$U)w-XvueZ3)6eGAKB<`D`wMcKh~7G zj7nw9duG7R@LgQSb|gsWpY?$9TlvKM&vp#-)~cA9Mo#oatD564b6$1&pId4!cVbiLP2Lt)9sw$wJN>Qp$m95^V zIL1%&$l0iqz=MKQwIYgEq<9^&)vr$y;Oj`_#U&d6hvmju>xW2v>T%e1<0mP~ZWh)p)W27%{po06 zpIJFlL&v@&NaHuDD1N7fdS?!9L(N!ma3`#*U-e*fHCA&`cXF7^kMEdHL6s&#yd`sI z6_asFCfSyRE!w8#SZt^+8A`|!7{fo}DJ%I}6-S87u8D-%i592P5T2S%r{3{7esA0E zqYKa1$39*4>r_;u{%rG&>j8P)_cSys^5xi+&luASTpLB$b(duDJEeDQxmT&!%L*C$ z-qCzy@$1mKqGcW$slN zvYVJ^`8?|qi^UWLb10h5xu(1VYliI|JVQ;xlTQ{!xabWi#Ve7pKUr7DiDcz&jG{=# zLs3fM{u+}io)Pn^8l+={=3LrK#+5iU?CN{TquM6&ZfC-i4bhPJtE)7p@LRvG(Y|QJ z(d_`LqVTim8fKHt;V;E zicqpHW$#Srz#Uqq6-MbF()+$~!MdLr8I@N~hi?ap!z})wsFGHgt$>+RdHFStW;kY# zU~ARB^7%gxTqwUgWE$Uf`>e>s(`UiZ&VzuHB-)rXVB({GQuP6IGPM{5g7*BwhjP0p zvy?JL8udxM8?>!r29499#l^NmO|)0SC=1T($XMufmb_9Lz$$PwR3bt)FYPOeRs6Yp&Xr_&d4*BC} zz>@?tHo119?O>~b`*=4CQTO+sh6le0dAWlv5tCNPbawOXjL46Rb7&ZVjJV0J9l|{m zYp(~Au9GB7c6_n`#lrr1f}FU)env${_gIm*I-#D)yn2%P*3-Nh^!zo4EiT=XFI4(}Pv-;SW`?W4`9 z2b*iwiiTG;6f8e0p#%CE$FV;ONBBlhp2b46gOS1(#R3qno}rfOA6PwxkX%QfWyS4X6zr zN9AG#EIR=$&3<`>cfbw}%g^@1=|`}>$=mUrN}&$TOnK!`TDDxu7kUU|yr}Pl_txFd zooJcNbH8{o?l0$3Tsf5p=H9I{g@4=0#F`3K)?~Yy-}m*N`|Lt zkr`xo3nBH8NxPyrcU8xZjHCN3IewTZ?Fg2m@aE@&%wnwAuqs99A|78w0XC+p$<77Q z2rD1w7yC*BQYQ&Q5Dppt-*DvQ&yc|qw9FXbP3oAS z$qra@)yC~>&o+(d$)tQKFn(c0KhlITYd(V&mn7sIvqC_3O>cnT0_n@OkNeLUbq9)b z^%ya<$qV0qG^2G*N~R` zS)$AR0!N&S%pWCY;KQ=A2Et+|-2?rHp)ujKCrI+$qm29a|9gc60Y0`xp(XFO5`~k* zAS7G)zN=mat09q#Is1n=!)o`HB2e)_jeFGj&s@fb!t--Rte*hkxEQu6>BmX-ORbrefMvgb)t zNS@+9I~?FdBLf~d|Nq7lBsc!4J}K#wi~mXL01;ghpg9AY(z5@wSU^$49qm!VVP>AV VM6_WXaIhjN$-R;NENvd~e*iNK&BFiy diff --git a/media/pshb_cache_sync.png b/media/pshb_cache_sync.png deleted file mode 100644 index 91b28fb8b273e6b9cca9f76fe738add0429d0a2f..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 30240 zcmdpdW0R%9(rt6vwr$(CZF}0bZQHi(Y1_uMZJW2}oO{3A5AP3ncf=DLQBhf0$jn-6 z?QnTnF&IcpNB{r;7zuG0pWlHY9QcHV*D^a@F;w8 z1q5YeKnVu`;9HxA{j3hYKOMd{YL{nb%evhjk3OCqmVo?QCsCsB{eS>IUws0m>lPQw ztSuKHwg5m`U`c+!cASOuzg3WsfJYB|nywcBT;41MUzk-T&Z#!UUNy&!%wvxV6slhYg0n*@&^KM@TC`&KyLTO|g-Ak}%met~xLX0Obl1l|R{unso*_yEd#Ih+7` zkvqXNr+h3p&;v%=WP2lA~p$0ys^5TmEHu|E$(` zGD3Hi2;bh-C$<3Cq07p;xZ!U%0kU&CJ~+s`I5;T71{mZ5$ayOe3=s5v7liT`VEWeU z`L259BZ7}(kL#reZi5bhjm6u>dX18g|Gkq1OhJH=(jOj?@CH#0#X})PlF01HL^b2i z*7AN)7v}%0SMF_Fwvhy*iuk#n7v1paG;nlugdt<;CkqBz=ncBTcLL+ zFR5Ike5#PGs-?8OLcCZoTe4&@Z?a@GXU3vWU&L0xcEqH>%EIKx0@o zTC(CYXfynkIIx^dM5bt_ie``$QJJ1u+!-F~Us{qH(b_O0qQ}9f;kyRF(PWsX7>7Dc zyvjPr!^}-h!A-X(K>TzzU}>TdJlD-^Xgsg)ef{Jc-FsPu(TJR5Hr8mpmmrA>14v6 z?A!beoQoM7O55z>eDwHBed<@S=vvQU#!F_q=BlQ~dKw->vr^0V1^PL)JN8EL=G1EU zS5Yb1dAV(^D4ykZ?boSUHL%8v5SVpHQmDIqQCl+_4-rOTS?Zlpl9Ap>ZV#mo4vPUB z1)B)hqctX*5--;4@Bz)r-|qG=SB`rEDAj8dzFF_pPxe1AJ4%yg6D0n{fpl$$StyGY zqh~X>U0NX8zrwMhGx&w()4-is9hlP~r#Tsbh`gD&?%d8%~Q(?W07cyQw#-o{o{$ zFjtQ`M%kCzW;aZ@nY@TU#(@9>LwJX)R*=+i(?9L(pUIJO9I?}$Ep{$s<0zR|GTFhYA5?_`U1s>C#0~ z^k^ceVyGXgTt4)648P>NR4ZmXb2|4skf$`!&n zfh*>^=1j$H;NviVe|jo!E2Ss!U2V1td^Pj<%RQubHgi{Y;}dN~G)t647cxd6_A=Jj zgXIB}E1m;`(b-+oG{n@@(&b=kp;g9F<+|Y*2{mAw%V+kL{Lg5e+l~3Ity@`wgm zOX*u6yE;2JqC!Y(fHK){GDSjMB6}hpf|)|(qO&4}lA(D$eQ=`-BTfSa{YUQHDb`7! zQG#LjV5;d1X}9eAP9jY=v`Wy2Y^NrWM6y(-ndxj(MGx%!LsQZpJG5arzi$dnOiECHmur zygK#q+Uc!6fh)+RWSJ3#QjcS&RQ#mo%81N7u0SyVkw3>JD+$j5 zGga4?JqX`sfZ4yT^iAXuNcq_5i20hxtEjs;3rOz>oM;zCdBSS^rh^|=+pzrYX>VQF zWRRSYl5N7tbi_&Jw&Y%&uu>yrCd9?e&^LA`g3SJO{>@7Ef=jN>7|51Nd1t!b|J?lu z3ApGFBMdcMLcCHen4fA0znhLo7%!rfeoO}IU@3qb!=+tnSt?%UGBUvw$K++>eXY!+ zXjuCr(wy8H-F3NAc=$9H^ELf60@pd;(VbKFME~sN%Q^S1ww>+sz_b8(d#pUu3N{jI z5o)`Ktt%c4A2S)v>xIE~#9(tLxy!Nwayoc*aG`wcv@88k^@;V`+GN`^1=B;79ji_6 zIr9zpv^yoXVfbA7HnS$hpvRp`qq?YO(j!?-QLVQXwt4X;`p4T=%sTcubcXk@!cO^@ z@713LEX1og)8 zXXuB}2Ze_g$E^mu`W2@vCg0AzNHQt@B6wbca={wL&`wusS8N1rAaRRy<#;iEh<{P| zOZLeV;24;1hWfGR}?G8OkK}jNw7g7#X zd|C*d5n(cAP-%v8I&}zo5We00st6etjTz1-O)pVzgt!Nm(xs}LpjZxUadSC)qJUM3 zp_ZkcHm8+S_-mtm1&hm(v#=G#3;V~!M-P~IR>6M&eO*5_E@U>)?lLTEG||$0uAd>W zKF5CW_7Orf9802{0;m;i9(w`q%6Q{&=4_mGa&6jj5{@Q`Zk@`U_P!dvO1p}-qQ2Io zR%@t*t%SL~^`vF2mC2c!x8^eDis2IFsuahMXB&6D*E$wER-p?qO+MElSHkChMSIBW z>3uPFEZ2snmA4IsYHPZfxptFGOhf00acvhdTW^Jo%jG|E?scxszTxr*VL+D*p|i4Uqn zan9^bT1=7AAgC&)c2`werChLIdSh$WVzZmGgLNbomTZP?Eb$cZbaor?uKy|bVFE;( z{qo;LPtbpl>zEy|8wi`PJgzwujU0g<(H!xhys$I!N>qh1KMxgKg>9TJthpmwmJ9a) zdrSNU4R#v3Z1+ioLT4KT*42`;n3j@@;wHty#+!SmdrdU7w|KlqcY;z~Yh@{h1*IkQ zcQxD7^Og_DM+2t}FZ^>E4}u(ks;Gy17L>IYOxPb<9+0ya{RJq7;FCmOlpar=u?m*; z*I$38f#w}_H&8E3fq+?lVFFwNmz%+xSvMKC?OT-F{Ts3PC~>+2BOpm2+W-MU-G1Z# zp74wCkZ_am%IUe>PMH8PL?H)hOesVMvI%7xUV|~4LzeDh2<{iYtl3m_|*TKkr%e@)2Hi8ox zV@hhOeo9C*9aJm?+oaKysFb^emUxCZmH5P@W92-RLA8y}HYamYb76P>!}2quW}8Rd zXta#$rWU6#=k|x9M;I7w7^CR%D0|ZFsh3F{nmd|py`y^A=DxN1za#8kcFHc}_Fn-B zcG1q65AY9Nr_Be2hwrnw-1s0oct!qwA+y1v!89Ui!mv7xVe2sxQHLFKNVcAiWDEr1 z4DD|%#uly}F286O9w2i`Gz&z_YIXPHgDm)8JD(ru~m-x_H=^pY-gs(T-7#waxyW zb@pAV`=+C`5oc!Dt!lwp}u-hiO51s{hCdUJz0f?xn=6_A`*aDs9@?8nq87$OH3UCH^ z5{6F)H>2;OQkLO@WVrGu77ku76&5}g_zlR;#Uh!J`%3n6--NIe*Kh;?fI|BB00LxW zp#uQm14sx9D7yh(=s;;J4}Imb#HHpL8s@*sG9$^{7i=>3>8e7mFiYJou_&AusG6Qk zjVmj9l7D;Yr^L!Dwd)E%N%_y?+QCe)2u*@%$_p0I65><6f9Ko>?$%MC^BSO;@_NBK z9^GbcdmX#};bJl~jgc%}VAur#0s{2+b0nM{Cpe>20cHJC`r z$;oAoqxORUJqhwZ^j`#5RUg=Fv?-_z_?x&~tQtrnta|%zc)vX`B(Rf_fdP4Yd99C4 zPfS!QmCCNIt%)|=lx2?3%*@ov_=DlP0Vt4XOI1!adOTVXQACd{lP308k6CIrgjHkx z408!)IwjTNa=ketolfr$x9Mcs?m*~D6eGIB;W$d*E_j#IDPkBDkXF<0+j%KEnQTrJ z{~fxz)q0~5i-}@18{x0V^Og8jeIQ6`DyoG<)xXuZNyA2#i4wcZ2Q0K2gX>s7{y&MX zvfkviFcA|M>D?$F=>T+kP}Z?;&Xv|Ho4?n1)Cic}066^%ky z(4y_OBf5K3)O0*QJF_6}yj3T{KroTf-A@py>PCP^Hnk11Cc+EkD$et~?oPFdjEL9? z4-0eKk7i4PfN$`6b-)eyn)U|^BN*%@B#k)a=Y&i&aKa^{i;5X`6^j2 z`f+k=pbdd}Xl@bW^?unp3!>r|C|0?2H+Zv%s-+}56}Nszc?i`LNZ9MU8a%>)fX~{e zBF7W;uCJ(}p}}Ue;a6%j62tA!Sk%?Ek#~4&gTqMJx6>C01qs;(;uePhi(AYrnFlR^ zxqs*T{pm_9Uoj$ey4lHAFrC8_8D}z)V$Vk+9|8}q46l;)K|(?zZpE!iF`_+|q^pgC z0XPR$Xx2AZD$NLJ>3I>P!@c1YqI$66b0yx!|n3XYa5rQ5cOU`~G-A#7*crsUr99gN$wxACV z)aS|%prkg~6(1k3EofcO8ec^%@`3~Tvv{ye*v*uI=5*W<`WWm{AbsrO9w)Q;q%zXh zebrj6h>w0nIc|Fp#xoNW1CL+t*I;ycXrd;C_+8{T_xD1EN?Rz3wAz-5Ge~}pkJzz{ zbB(^=K8CbtXlTuv(b{@GuOu^;+$m&CC-tPY0{(<`)A006JoT; zfC}URTpNgZOQemaZu0W*a8}Dz7#}Aa0{Ebqv4%S1ePDRPtx$#BZaa08$tABd*<366LSQ1QiCx;fax(kc zXTQ!s@3eU2rVg7u?w^x#CYW(6k!@;>O>}o%nL&iv$iI=IpYtE41BIw6&{J z@7}L_)Iw&77vl(o=xZOwscN|&W`)MpU%I=yUuP2vs1s*~C>!s4GjKJ9MR&&q2!qMh z;^ZYC_Su6mVw*)BWOziv_VMw_C+*k!DP`!31Xsd^p|Mz@aY-!kQ6nkIQJb1=HaTBx zdp=!!eSIO7YkK*?P5XX#ME8)?N%KOm9ZK>L{b2?fvi{p5Ls#g~CWiEiL?(M+ZV}n6 z%Sb2ahK&Fy=A%RD1Ps(<2#}~JI=ho7DK1TgqHl4750y(P2!1ptj`^V;CI{4NyDjSi zK@cV)(De-pS6napC;Z1g26JB%rW1a$T`>uowslpRU%$3cw+PBFqw07o5J!YVd~kZO zIiWHIEFdgatKP(@@R7tSZ5mL>-s*&YdZC$en0a>JclzXy3lp91;_AW+B09e-n!;dR6KVZ$*G$Ve?PVSdo;BvXQq=|}+4 zFm-FcX0+z&re1L*;~;krHn!G`r9o}PsWyX~F!#?4h^iz#CH<+m`FX`INIwr2vkeLc z&SYkO*0TI~bt;k-WtAXyaG-#G>>`37%zuf11U&52OG+Ne{a;826Znb#fy_bjLO)Tz z4&>*wq~wv_f&b(P*Z{vgdN6bF{1ASAe0_+Y9;gLm4iLb>L9qWdgPn&Lgz@*|??wCx z!5RS>qeSrV;QzlNaL7gwmUyv$2?hRNLJ=1NXZdGU>L<~dLRb*S{&c;A4-O9L7#9L> z@y}|?zg>a2D2)5BYk{9;NBA%Vi|{{IssD|Xq%55KpAUimnh9VEmJ$3|RsT2A|78wE zlB5ggXu{8)I(aa#2t6RCIatbvG0GP!E+rY!*O@Zz6R-p?LNm|`46XwMnw%$oWDq=& zulO)puB%MJ2Npv?GJ!|B`y2DLB?y_iJ=7dYR3-5XCe634W&pV-CW5Km;gdWsPMQ!0 zIh^X)S3)x+=m@W21KL2aHZf;Xnfvn>i`e%Vo88$m=~yCBkyo)AOGA=L?XBG1IlP=g z!U>btmWUsm?h^1x5GioS6(j+<8%a&+uHDFFh$Dd__X8)lN4+GUN&pr038_KmS0WG) zj;n&pFWgr?rkGLBzX zQ%USNw1py`KoGO$Q<-59mGGk$k_o#@K_mg$wjZK`2kqlZ`YI_%*7w^20!b$NVW=CK zqbAv0Q>$ubzF3G#7H`aLqnoRT5*4ZzP?54QD(U%Ul^()JQMImwTmE zU>HrMJ={AdpVlyz7<5>ba1A;2FmBqbe(|aL=)|xP&)n64)o$bIeGpi{pavq(rti>A z%rTRd<`la}Iaqq+m2&`PQC~iS)uN50W*C}N5<4`EbA)slD`xeK8y~N9w8AuZhL#Iz zB=%KFz;_N!Nw*hA6*ppmX}AMXeaEjggx}xAc8tSP{~~jp0Etgu<31v0`)ywRshLhR zK(TOitiwDs{}YJsmP!5!en-AkHX(NraNtak#G0t#yvvNZoT?KVnNgAGOH%O<0b!h% z8RB4A&ZNN^=|;JaL)0*+5Cy5mfkQfrMY+E8248wIY>e5WWnDb^!UvMLT;#Vu&L zDKPjR94rOl>Cm%74TW2g63J&4Gw1;8AQw}Dv6B9q&&10z4?%Sl4AkM+Jo;W8MMXuP z@HJP?r^cA-rF!ou37OH=YRady2pGev9?89`b?jfrH0YKS>Tt4ToZ)k@=c@!b@7T&^ zMpVuh-^x~L5h7))o6Qi6Bw1=m2O>K3JNRLf$S2fNL|7TjdImyLjnavn(U zI&CU*$mj~{_V)E84F}wuE(KXM22n?I+A7q_L;dKTazjNFWKdbs?m{Y7Wij2utFD|a zS|d+qt7b1o7hj}SIT6mS{L~G38ChK~{EBsHCi+{y$~d_7T1$x!A~7j2#y@ICts%h0BC}#^if7i3AHRb1Ocez z5YD`e&(E%9WWJoFtLHA$#4KQd${Kgq8XuBqs*o0woYKfPv8Fr>i4JAa|HN!it2Il; zsOE|6A0UqnDKaMyV8M^EaF~~omL!n8d-FS7H|=y*BV}Gvs)z~omHf8glC96w+u_fX@iQOp=VG>D+F-dMzi2CeT4<)7k1L3)xr2QlwSdb5} z=*K7z5s|J4xrD4z5*lGgPf{pugaL%Am0>c(Axrz8l{x&kGG~#S$|*6QwOP>y7XjRE z((?7XY*U6SAo6(-QgL9(XnE+1o#yslALOF(Y(wL!5Y%s-n;iTE+Gk zod+RRRr*O+zlQsQ#ZD~}NoKa?3cgY!XjB$_DL#2_t$wuu2ESPZUJrXxkt+UEP6 zux%8(!fHSP{pkUfuwVoFEf}!>f}XGbO}@r6s*J{ya#U9ql+~4Wk#!NBpGQdq^Kz;} z-LiLFQaeTm+7L7K;ybmm{UpDL6^XNqre;}K0*@CY&4x^Rp0coKIG*B= z2Ek-0(bqJ^5b535O~OfJd&j{dlYxsSVik}32Wy|`nsmPoi@TPx`z%!D2(LhZoI`)g z1unzr&)CBY734faN6VUAel`hj?)}kvBD;51(JAAq&1&40FG-EtcNC3Ms$7yHZQz;q zj{3zWu!07tJI1RBTsG6kc**EyvqH73*UF1Q-<-_X^E9ArTCUf*G2kukY7-mwCBX$t zX90oXkY4jZzHzfxhUe$im2+bH0mf(9G> z?yrMT-EQ_&@OJnhgRHiHnM3;gIiGCRuJAmT`5E*xoUiG+W+e*e=ySPRu_tl=4t;`K zqKy8AK3R`wPH;%pG1#?@hUo`dgry^%iokuEB5^LJucEXZ=eEJ>RV)>mro!R5=)34T z#nE0hGh3U7S?FwiFqM;q$@=I|=fmBuHtjY;_Nw=!n|3p?+KlC>{yN;MVcU2j!X zZT?n&^a#8hsShs;i0ICbVp3N!0op|aUnKdd53T%Id6v|N3zCBG9S`owv@?`T0dh*9 zi5nPgT#acewR9>-8v{C<^R*S_PpWaLbD{i82MVDa7=?P??j~aOPEzw=)zE5Fj1B=y zD^mvp9f&;jQAQrmtJbz#txmi{Etl++DI`xr*AK1OEAouwsN{|WSU@8w{1Lz2MEIeJ ztpk0hN;P@EE47D)G5&t52lyL0t2romzq!Isp3bxu8^VW+uN;*_6(|;Q)P3k!s)2+& zIMn9s&vM7!)bfmo{%LuyG>(!ft}o4TytRrHLg?IJv$$9l1FDJ1%-YzHlMB)Pb&6^s z79)Bx3#D%(B-d9Bg6fQUSf&oWhYI;t?K5e4mIECAcX zo7#{&OWrYtR)-skoe%TJ-D_}~CfkLFNC|c|!v3cB;+)}BvEk9?d}o2RhscQ&Le+ty z4}s-cM=|oMWr=JKY-UM`YhGbYin+r*WO`+*ucdjk$l%<#YvGl*l2d1~U;yc9MD8RV zwf(crB@Gjrq+C2<6h~LKFpATKkh0hiZ(flhzBx1_g4*#b5% znIi7`Y@^ZWd$85uJjGADIrMj1kC4s?_Ttc|k(uSL5R$V6VdS+?5qXSlyI_wcArio! zUxx_)sJ}{3drYqjE#w-`08)Yk=SrIa##RO6F#|(||7Q-`6%#0h4W3RStvA{bpjKpa zxW_CvO678wDo-y#;3|paWMyRy@|*moom?-_MUVTJSbnx@l?XO<$T0>SEB07IPi~09 z0bdo$CHm_jT>Q?2LwFJFQWE)O3#4wR3k(o25K!AHm0Arl%I>?v1R=n>6MS$jI{b>1GI#gqE zKW`R3KD=*|;1uNK?7m;zyr|JhJ)ciloZ6pnk3aC*Ow$dFW%A67bc>b6X! zkB2k2dw+Kln&oA}n-#qGJ<_o}uQu9kHalQ&xzV$R?gQ}o70srz%>TB~IM4Q?MWWID zG9ZA_`EfvNkELiAgYV;JAO?qPI*kEXty$9}9BLSlfdB-j><2zXA%Ksmr<4pj_<{SL zf3Tks8pC*#v&Hh9oE#)lY4sMXwLm!DFm>ZxK3`rR&A8jye4*!UUq0c!Sn8Vr;PC;K zwhrN+TX692{nKEguL4?hQ4*PSTJbkG8u?4xKN~yxsNJ!!mE_94QN;$yR}X*C*M~Q` zE~=f(qb&_2r9p6s*|FywADuo1{C7IrXU23|kls_q-rH3W7${DxlC#3#pfY*5q){3! zzz;r~E(>ok`b4*^Ra45J@s`X3D)Ix$NN>@Wvh8N2tPd|!^?cl4?@XW}{FO+aN9?e?U>UPg|3xbD*3*N9uyWvBw zkmdAJL5;b)yT^m63Fo`ag5c0nVs_V|(%kGijm?cB;6e&WzMN8uK&h#Lhl!x15W#q= zxb)rVe@C;}CmtB+cvesJL8q#zjtdUxLfm4sT-piO#%Xt9u1qFIvZz@_D(POzJH_I(0`X1+2rK_*U3CD=Nnt4Bh8m*i(3G#2Rdqo92VLTl$yXw#QZu`yJo)>67w37yafWGz`~GGCE*6~uD3I$RDk-_` z{i-t-w_4p3tl|9!6hsKv!Y(G53U3S>O>!TL-P-{aF)V>T{eC;I<@^3fED)#arv4Fw z$ZxEp`~a(s*t)CCSqVcPs!@c%Q>YOf>5aUfg1IJhSknxbY7?r$GM-&fFwYx-4vS#6 zT$$Kd_W~Q7=Etp(GnY}tve8+s=U^+BYwmK+=F9b$*3@-MTDGZ;r|;@JI-nzo&py7x zL~%oxe6+c^Ee_5Hg*uv@sn}d~w05H3DW;a8(3GSqkSN5Eje2NNNtw*%h>te>w2Np$ zd{7J0=;nru=dpZW{0;8+NBNN;kigjrv}YOdcq{FW$2D55utFlgBW00Jpq0$io&>=S zf8uqF<@s{8yGJot0-bi7AH35neM%5WQ*&-E9;6ECzRzI4oRR~#yxSSTKa47n8X-;E zfVr;!QTEiCSer~Ls6win3tDq@k9B0ES`G%6Op@m9Bu(WVvD;V738QNn=ksPS2(Sv-wOkA=aZ<086tR>zt5_0&JG$sw^}yjg?;dpNgsAK9|mM(WILs9Bu`%8y$>Z0pRGLTO zpPOp>)j6##CTLne6;2W#)duI5*~sjqSOq7>u?vm<{#{2}b!HY|GLTw+fY>1laTzs7 ze;;GINBiu3z`p+pp1lut&GB_Kz zX=@P_&`MwNg%8ni&{15}q}1f9{%X>b9*L*cUt6Qow^kz`GSQlyj^A7*klwYm90;F9 z^kVqd8ZtXNCs77NQl3u;_>E}WAC-tD&&uq7n0UC{z?R~U2m6y9(-Aqy6UK_5@(^%K zo+_9sgsc?vxo-F8GcB|fWzQp{9cOd0QyB>KFxZQ78r9&cnjdeO3p?C_+v%4NQ*xl1 zp(2|yIL)7vanCpvV-V&-Lf$i|mATf6Z_bIIw$6Uf6>@G`2KF*vCAyru?6XaE+E&%D z)6vN(xiCL{ZVq8i@df^(=Fm(DRgvQWH4#gFxHG-d8BRe#^W`n1J8~f%I%5{s$(t+g z3fPBhH-5fKbP^+~dTCGo@k&v~edye;YZA24pa>2ELLe8J>@7npn@_H!zSkEP?riV! zYO7-+?_`o@*EI$8ce+=}D?`HY4BN9od2Y3jluz)crv~BMds_Rboc8dxD<0t$S1O{G zeUrQJWVlq-fz!v!TKz4SnGwzY?mgMFmm}iXO=M<=2L>MjPwMhZQr6$Fm0i2;5!+-r z5w#crw*(r7n6_R zB9pfup6Unpa7CQ!rFat}QH;20hb$b5m4NGVoEzQy7l}#rMv8 zz9SuRxmNfXx!shKHplMY+s2w3QNjZTyngZ0BfBUP*Lme1#4 z#LA57+UGK76jH`j|u|PLj$ci2c(9DI_RnBN<=Nm z{**58dw`;{U+4pYW`6}WrV}rF(S}wn7OFIuq^0@{Lcn3KkLZ_Ve%nb)-;y&RpFYC( zLV*Ou4R}Jk&C(70k_$4zQZkA1{|ke1Wg( z22CfY**r@W8)>Eb{p3Koe01d>WzFm94rC+dT7702ta`y(9-rEv;k2~SPlyrCl6VI} zOxro`^hZ$)dh@Xa1{TE}dT(9(aDRV6+a(Pll!(xBy@^6SinOsf9L}BaqXZWzF<%>T zsZ37ziQ)fg0p^W}k`jh)8Ue99KW;}tVX#aWn`o&P2rjZgVq@FQOCR$(chQW@}YBkIHZ2r zZjLF=94ehjiS6-mZyafqlc@|e8&aG_Ud+LUkx%lCtrliy6d0kVWhL^ic1oX*`|x~N zYrJ!%AK67`se=C8;2?PoX??mQyy+9V2(7s4C24209jv;<^nII25fh&hs5a2|8a<;l zGmcgqgHH|ePq7pUX*Am^$R>7ZD2IT4wHZ|6lkVF5l*WH;Ixm;CY=>L~;nPDy!JG%7 zkC6RQ@%g=?^}sJqFxld)r45luJBGD|-R`2|a`>d`GR{c9kVK3xW)9#1v zMA*IZl(5jG)ynzSy*(V@QU@$c%I$Ie4{l;eoouY8L%>sRPY;w^?y|Xj*DjdweN1FU zjcWyj@W9Q?Coi{rCk+Qo$z)&7>RZrKp0RLnob5WK4N&g&v{CR%aysp{)8ud;#(aG3 zm?I_s>`$ZSTbW9K?7kC%q2R8ev%B5RHwADVYM_30X@|Yy3K$$2sd~b~#4IIv7`)t? zYk5*O8jjOz&GkfWU5R5bbg*l^Z(Uc=c4`EtC7~w^4iR^h9BddV+Qg4agV1yL?8k6@ zJ=XdffYSL8)2DQKpzy`BxeC+{TE7x`ZS2%6P|p9d71xTk9Y*HmrE)X(pc_^rAcdpdzAo7-!aUdBn)x&PCD1SEQyuAQ$$7oOXWUxD{=5;) zs5Zm;<+R@ZUPeNZ!SPBm*}W&@D)s6K+dw%**>m8>!k<`2TzI3X3$Y*E0vj=l5<5jh ze#>8e*Xd;Yh8hI1M9&bOM~~#sNU=uo3b9h}sA5SdGj2wW;ImjV<@J`?f&x6&rhEY= z_STTJIFm!G6@b@4)t+0Ntgr63Js7kHHV?VgPUJ4|*T<;NYdb?l|BdpLUoR>@fVtN{ z*YhDU!cz+$;HyCt`cLz0{!tc?+xYDIQOaBX)fY|?1x@k24TZ0!D2DOq_1>o9Hx=v^ zsn=>>968beNN_rM(yp;vRB{YCv=GlgISmX998|7HtL>cga+A5gnRb6|Lso>Xx0KIn z2i1>SrB0)9_*b8e*p!66wcdL%eSbzY5lhmP=xD9rq-`F_>Mbp)hPo<4)6Jc@g@7=P7tEBrvlNARWRx6$F9VGeaRbD=Gh znkFd?R07U4O5wK&n#Nf=6v^s&y|re=gMyZtTC~SiXs81NPW&HB8mO)w!*;mh)+eTMT{l=f=DpS$ki4Mnc8M_nzG3TLOkTnd9}ibkzXE!Pedq-jDc;UJ2uK(g|zw?#8)vXH-eKg4>CX{Alwvh9<0*f*{OY!*K+20yu z0ttM5Rv?v`kTne~*I!=%_hOj1{0?!+aHg#%s{|-m7QjIpp5BV>VFD>fJQN}x*T8HR zV+vDQQj-IJJMSJ7K3vL)`Fh}$+LLpEQWG`31)TALRR)qNr!8e#Ra5anewb?EAITFn z2<+O;gQ72p8udj{b2bFZf#X7t$hT)~JvhWCRC~^hnQj!`r zzPgs*C>?y=Kgm^!pO_9@hoWy#P26K)Q%wPqkuSqjHc0^v0~}?*nNvdLaMGj7-cDEq zR5m8yKX%^AnCDAy8)Sxc?1$I8Ia#%V65tpHbntjNz$*4Sh0@9R@WJ!2;PN7!$z zW(}Rh4<{R!uZnY@a<-_A(5lmJGB^}KmVs9gsY%X%M6Z)1l;K!kG`vdh9ISIU*SidLeY&OGt7$FL96%8Ma22O(^eRnDc;fbqfxWj?-yN zg=2@C;?@CQseXvFd1rn^a33SS{k;5N(qV65^S+PpnabaX~yw#(rzeWw>7&)2_(B7-$Y~4ztaP2WEtWxw>qlB(30EP7}P^V zjM?Jlprb2%jxZls?zEnnkkE8veQ5t4-6Xv@iJ_f6xVXUCw4D?SmiA=z7)tLMAE*6F zsG~j1U*h1vz*?Td{?Oqqy!Pzzt;l1i8~A}>Fm6j{hGww2FKde?vj#!oip00YnJ@BM zVyxp!u8Sj-IZWuJ%IZsnCu($%1d8F!3>7xKHbgDoKBr^Yd*zD2~UFgf>1rvEAU zXbzem`|;I=yfW%qcjxMhIbEVs54P&{=%vJYBJM|s2jDiJXLg*ao_2H09r?5{ z(ReR#U2`;f%TW+i081`UN?>+B-nWcKcpZ4mwKv>rdG~?#ReeJ)cjncwk1C33_Lgvz zgZse)@5%%p#pj?F281@2nSg$fb`@a1p0NH|yz(`uz~3mI@aI6(U<*_b<6n$rANyVvJ3Hqrwbc9C>JL= zRGXos*$FOAM(?donxGxp$w|baZ9iw?YrVEwQWmR=nXAha?6M|UtD{9_ESQLoHJS>0 zOHfe7=_QXfNo`Qs&7CglOqaMn z>TKV(P(SbRL~O)v!(9gPw~Vkwz)51a*zgp2XFM0-viPIR@Mw3tte|8G6ag>XBT^+w1GD^c*UU=4>e6 z36~YVJ*}9VRj}Xuyq(J*(Lw?vEEdd(QUePZWXEKuJpPYq9b?m%->AGhL2{GmO-;Wb z{i~@*nK>5m7*?SI0pJCYP$$%}r%od;k3TuBYCgWWNn&AUj2 zIuAlCv?ejen$GOIKW@stf+`j-f8M1Gj3mDTVbexaiO5|fiNE*gU;F_q>LN1LPKo%8 zejXZMBYwZ+VXO(!t>X6OlbHK{%hUzx)_Uj%i99tRv^huk3Ct~k+k>T=Kj?$YZ(VBT z_W6ERk2DHU$Rw$4=iv{Yqn;L_?o3Gf`VzKeB1CWytAE0)%--K2@b1DGv1&e1*;HnQ z(A6F+LK!R)3e3oUn0N0ZZu|RUmXL_PTKlyyBPULw|SmW-3H-%a{3GP6{DUiqL zH(qggKea^2-hm+6+#8+yr*QTCvj=FJu1t5-o+`dR+&@YgcqwxtNlmkhR_^9~Jd!3P zwUO;y-$gp-)uS;BCKW99&yN_uv%BRHiLEw7oB+Pe_FtY`1!7G{?7w>^r3Te1zYS+{ z2mSs$q+XXb>lUOAN^N{sfR7N$cbNONyqy^wCSylmIXIl6jxSB4iv^oZHGq|=qpqfx zS00qyd+2XEHk?9);wdzeLu)35{w_MgyC^~Rk}F?NKYXRc@L9cY3L$3rDkQnR`{DWe z@q3-jhi`gjj?1^-slKb>AU`T)Y4br4%UTk)N?;X>mHJoZB;c+y8uD;{-Levr_5w+O zyp2Jo^Mx6XR;AIq(?!pZbVU`#Q+ntZ!*b7&i{*a*A;YPG*SEr#59S{}kkI>U0_%*s z55avw=wVGInLr?symoNr1XB9?jDY^hX1vb_fDF_sERF2i+|m@!xX1|aJfoh|RazV= z;|uB-tbtr7QxGV539c@#a&<9M9HZFauYY=>gde@oU|NU-M&qHj1!;C8xixbljze_s zGuO-ObMkJ=$8j>tTt791&;dh`9}LY@oLeXq)7<>OlEQ(WqJgsGjwhiBXWgMand91^ zLVnqp-V%`*M>xLRC_SuCjZ(&5{XKWuX6OCyi_c}OqUZ+=3(3CB!mI>J*WS$rbELRF z2@n7VY%H@*dohDMS5tC74r^z43Mu(yKWb8RMSq1Ki)>QpdE(zsGT$r=>ypj_qe9yH zPd65gsojM}KFM5=p55W`HzpOiXa&8r~dnX+GKiwgx4e3|N z3!mdoBO0&Y>aWgL^lW>$6#86Rl1TPPZJrLE@-hl0U-ErMG0^eL+#t}Jnl`!G-?>GB zLYNg3-DE4m|72^)FtbL|$VX>qoZp=oYBkz@w_NOKpvN~!Kd-T?;b<)OMQ~WNQoB%o zcI@1{%hv4{o6GIXIUD5uT5b~VV9rg~!^7=y!90d9$L`RFq>#ixqK%DfMQGdGa~POp z*x`70N~Rv2uRMW3y99^=x6*8%GXgOGGK8!jQem2-&zy{1v-AgCuc6V7&u);<*GAf{ z#{=@qSV!0?RQQvbtGY1Xq)8Js;={Qr!DtmuS!`xbqpg)@X#THKM3Y7R4PXI`Z5qVd z=JUy!jsRp}p-+#F$}UcdcPi*pV-m zgHnJ{3!luU&Z%jLNyxXG`O%8|em<`JcrJ$PUZm6M0$!?39Q0wVUWP_Kxv+qwrVQVz z4SUQ5C4jsp&F`lf)JoLLW@Ano=2S&omcjCGdGC%u9_)lwWHMQY_J7n1`}~BU0n@!= zc7xjBsq9q=LyU}!ib_fY{r&4L){)wFNom{;eolbabIq)%1NlaAlQ7w&m?DOVK;{RfgUT#7si~=GVbDv$;HwydanP`*!HrZvK}-N( z7i`VU=xI91_0@Ka9G2Ao6k#;|6oJrCd{M%j^!P!&(>Ie!Xi?x{5%J*Cr9z{=-|yS| zBe63%JXj#Y#KHXX=sgax3H>{vLGy++ zQ&Cc4aySqR;s*`hb$!(5|3P;iWDi!DLk%ErNcRIEke&iu{ZV%zfpAG8QvH*rk-(HU zQPKmMp^gfA-fT-05JwyiY5$1lKcBb3gha%|0%61E;(ifqD2VzBNt4vFD;gGhqP#jDc-Vw{fk4FsyQyTJkGSVWZLnyp-jD|GhCU4Szu{@t={Tun`Nu zN$nAy_>UCIE)Gb5LFjw&{fs1w!;z4XP&5`-hQLV#*^F~s@Sxb3_HJMDKtzpFZ4GLF z89-(ytgbE8#vRjb2S2FhhlU^iA!!MTh*D{^LdqE+OS?wF!PXTygYbX;p+&l9K?VZA z$nt+m`|6;$g0D*;I0OkU!QCOaCqQs_x8QDrYZ%;uySuyVpuydOI|LHk1K;CUTU%RO z`&Di2{zn%x^IpI1zJ1T_bIyZJiPdG(u}dCG;Oh?6%^mzt9MYhvP%$sYu-6jj&ve?^ z-TnL?zh>Qi(|1%)DnK_|PFj6!N=T5vQ%WI&+fJ!*wvX_d*u)c2G5qwLF)5A1Oy=&- zx}nd-AaD>CL&z1OqVhFupb+I|C z+uOCvH4Y9WCZMiA^BhSBnrxBh2Od_nY{mRvu}d`NWmz%HUy zPMr)5{RLen-ol2s&#WkROy99_Gb2d~h-H2QB9f^bk=MWeK$U&x!xru24vF}&8D0zM zOMnhEqzv=D4xvd>h%v3aElYA`*og%0*!w7Ny6C?AL3gV65EJX%c-1YT)BPCNKy>^)+kpJN*|_4%8FT13QW4$RsOwu)AA{dXhRxgb zy<1OE6y|f-=)^Pd=o{roG-;zl9(d;0$Z?|FsyoL=Rij}WeD#05^Vf2&vstPJG&(9? z8DU&SmOq9NVYuY;&BK12qT#F0RRekzHC?6D&svr52Wl}Bc66IB_IF;2fr?z>kTa|ZlcDeU(C%9 zc7c=C>p4YMgU;oF&9B~?dLwv<7;gkDE2PwBNzJ0%T&Sl|AKx4FsX8<1r23N(h|(%h zQ+>UN^=|}JN-QjB8Ptqpc&~6UH&LQZH#9eukqLOQrnGD>=m-3cTcYddn))#Cmof?p zU%Osj?s^J}-LxC&WXX))i2q-E*(n)>goNnmEN2U)m#xC+L7$xY6;lZqPR(4Jf`5U5!ir!+xa6#gEH z+6Zpoq)<*-%2ZNRX?cPf%3|a0?O>@ruqcuiH2W6l z3Y7vZ+RG0+AbLr2zg=2crdm>M*h8{e*(I%lStSZ(v+wvpq+2O`N|hl9tVw2M3Og*#7!6R}$OL_*)A(=t2N=8iw=&=&0Z<&IOX4zhuA%2ONP3?8gB? zOXUY%&r7Oglr7V`5UlX&4Dxe;Okom4x{1~I;>h0T|EW>D6OgmCvArwRZ*??2-|FL? zegKk@pdM7HZ_XIgZz+ru>MNj93Ml{iApRvVpbS7obCM^3a4a=qh{QazlYt-Y@hH_F z9aZGtwJPx=vRYu(1B^IYU;sPNzj{J`tt+tf5tq&4mRRiq#X$4|;+AReT#4dvBql0z z6)p`>?qdK-548-cTJ5gKS5qQA4x7R@4~*`HVKO+E8Zt?ix(_lj;4(G#VTSH@bH*|^ zN`z7vU9#ufUk*$1;rWR}0RV<7OR6#KiAlO!e!lN{{RjN*r@{SPC#0)FAgf=ytreaW zZ*9&x$96E3d84Lfgc3aSv7cPR!&s%ki$a{thy|D$g)TL0D^XMS{#O$`_q@$*h>KGG z_P-ii%WRfH8d}#k_f>7B?H_fGyXpv}ijX5k;tiec4YmG;i9P7>HM9AFmQSl_6$Yk= zUNy$+5nZ>`x`u}{laCcMa)e_!Zb?Y}#UHI(&`p1d81Ne4a(nM$1}A35kctR!`|a8y zil~fCeq5ysj|*lJ07)}^k-@05wK)~!<7Ijopl(}}eKMig!%!EOi=jKE{f$T*O)PB>FXtPCe@uY55^DdFsD8v>1U+5Fc=%NnFbPoOZGb}2&@$xk;dLtp7EN|gG}(-y5oCT?Wy2s2LDWz+H_T4ryk=Xv)y z2r-d5Pz&Oo9GH&A0xLNZ+i7l>JHS|S8R2FIcf#rRIgQ26iVVd7h2f_H6yL_z zHXmi;Pc1_HR?hFGw0w$-)mk5Mx|MwC-(feN=Mt+GhxnU)4a{U>(>}nJwmrg4WN8cf zP6rYz4*7ubfGvwkl>UQuzbdX^E^GAz%Y{yzxG@IZe$};wJ(NWVZJEocs~Mk?&@XOm z8l1d2XwOXCHj62eb{x&X060X>jljLP)D1}Z0Ey@Jfbcb|?XJwct_B+}&#HRSB~d37 z?eqY3j`_IvUiS4wSYE4Qk`F2-GwVm`QDSkk z9K8m(qNvFab9{AVtdx*rgyB>_CDbsXMib#KFRJeo zzI^sdD`_FN%|MA8P7$y5|DEN&Q5P*vUUWe|jZcqiqfzG!vw7M(&w7jX zZmkhclEGUFzA;&Qs_SmIVL1rzLlM#wWZot*)N5O?enf0~CIjB(*a3+?sb0$AO#4!99(phl-O^(&z!LQXB+K`( zj{wFYv5uM+rv1kq|V8%GuKjF4(WTlZ! zj3uCCwg;NGj5^213Hyi*`fwjW*j^<(+e8GctjvU)IrwxnE8(Nnu*sh^&8O8gOLhF5 z0+4E%8yKYH;r^=0s%jG6$fQG3{$1+f)9gE=X|Sst&8j-zj%Ou#!JF#HF_bdV5;T}6 zu?X^YLrZrJM5St;@0Ks(~<{5X%e^A8L8|MUgWFLfS-gY$$# zrY=e~3HyF>Yf@7Val=>M>6f~vE1{6{fP)#ruw=q+HW@^=<$D40m*_xccc(!llzm|( zHRtuDV=C&r=ySW#yAAIt>1!Nopho=OKekY#!gm{t$94s##?}f`mVE_E6txp1q@aGbu>qTTF-Uc@rzs>B=mt5(P6E7D_&3M$)~m z2%1p_wHjmFkvniZN*V%sIcsVv3M*D!2+R}7kB#vtniQkgU`xqHb2+)Fe~}-kc}Zbz z)`jYB(4piv06r@}GxHgMp*pGtby?6O*9G9N|I8M3>^+8z8}OredpQ^SrQVJ#w(NbU z^_q$)!lG2@#9?=^@rm-;5|CG2a8O>g>-5 z4clFj7&}RQua)KAEoGMro9r1ZL%y$=4Jyg2#-)TecxWBLTY6fTxWW&P1~*21E9(z- zt6er>uAzA^uaqNWz&L0UPJaX8Kz1Ww^r|b;B2?MMh~$WNO%%V^xhYeo6J@wh2 z(pK9>N|luO?58!MVsTrb{o*(GL5uO&W*a!iawO%?%Qrh0De4mD$_x}^s>UJCV)_`e zJ;UwDG5IxdNi~W5BV*MvHw((=-d1~@CmNw=c4}I?X>p^Q0w(LkLqurHmHn|4Q-6Ge zc`91j!%8Gt3`<08T)->BRM#<+T|vNc8Fvua_IjF`bxmI7Y+hMDPmLp*pY%lN3ko^K zFHeqhM6pFiUUAIDZ}^B7r_9g6aUQG2*AWp_ClOO=DkGPI!Xy@dvLZz3va!&se)kof zwK7a6^z;}q#gpPT#d9IXt<}NF5cIr!Ln1&%wZk|Fka#eo;h_(U*`k=tCo>;_kYajC zQnT@~dx0VCT_)8{%$lAazo0MSbYBwMe%W1O4dw`(#3UFik;7{bym1`- zU=jH7gw!N&Ok3NtSp0mx)KU6CMy}aRiWRMJg){ee>|L4chymb@_= z^D~~3oP@PUHPczs$&cK{VSTnY&=BW_iGG}Qo+870@T+Y6?yvSDfw^StFZsmEDk?iW z25I7xWz3z4np&qPti|G5RcGpUiY1_y11~ov zdSO-nz}+ORJgHmApqNx)OO677Zc$+&ZzSZ4A`!(Ftcx*kEU+1+s$K(?zTnt$`^|14 z3W^{EZn{{>!@VqNeL+ICtWzBVpLfu==Rh6d`*DjsO}UcvZoeyT)_;fZZfhLzQRrN5K>POABY^pW3{7YHa>I2LA~o6@i#^rJElx-IsD zw)9n4d-;y$to(n4g|%31-7TgwTZ>k@?!RgW1RCJ4VCf&5nzcfpN%elt+nP8IK@V%Y zKYzoK3+{`Rjz+?wx&FO`j*=C1$n|0DEWBA|2RT%<{Zfna12MzN^TQQdQ7op}NpJO0 zoRiNUz9dz9YpW4I>SM37kt`s>`Rdvr9HEPbiZn}A;cVVfPZGzUkh_Vp3!-Vz;4?4S z+A3ij{E+oo;t7)=Tdq?9vWIty9x53c8fyBnyQ8C#a>YdQYsl$0U2)x1>OSV`y=`T| zy1~H(`L9P-JsP#fI48^1=adMz{RnsGeIQ4I;-Omdp9-Y@+r^ORP^Qtcv(XTF2M6T^ z5~xX~0qtC7wh_yzGK6$LQwO2zecI&O^RZJQQtr{LrrN(dO@OSv=W3N7-%FliZfW%5 zPgW4*WUiVerQtQP7DvLij)%y2K{2;2`tLl*%--xbdzUcyViIozWiH>*?)h=Pz|T$f z8r+$49sv~-hT4x^Sh4H6%zg?Do zCy61u5d7ofC8gmSLJZxNaYA+~v%DZ5J+K3-jtwtBIqYqGl)*`YOi5XATq{H6nlE5p zXM7PwEN84qjBKpACRll=mO)P&=E;hRZ9Z`c_dBWL6A~csj*OuNG&Q9SvqV0hA=Sb9 zD^nvC%J>m88KA-Mc0KhUB{?qe%%O~}g9CPt7TGv4|8s}QdeM-hr4L$HG59%?Evgr2 z6u1j}`fO^3*AUxZERgD>66NJ2yR(Qw^#V3n`l{#++0_Cy$poaA9ep-qi(AW&#+s1o zQ)A6Ipr-*GL5}+$*#(zD49j@~AN((JWMKO8I9;vHg7uY`41i@Z-bx6@9JqGr(;g=& z;!l?&%N5^|0yE>!(3_7z-F%UEJBiJ)eX1Cf%jcl2ofsAQE<5o~?Q@Jp{1V+3=H z45ecy6)`pm5xIVV%Q;a6^;<*u!xIhdZc8hlkG>)})yU2n_ih0p$-W`~$J*+N z9N-1{EhGPYyUP08p}TvS1oT_u-&?&<#1{PR&0OTq+xfV_Kt9x4!|$y@+We*d&FjSd z?X>x$iE_YOL*%W2u1l`{=8qx(R9a5a>ge7qvT8}+8lhEjOn?Q+@*ArO6sm;{SZEH4fOY}BZ_uIc?8)kQR-@$N`_NWM{w0}yi zFz3LWt;N6qE!3{gp*58~B4#8(Y79n@!@{)L%Mto9OTjBnit_$pP0Fl3169Rq9I#vq zjIBG4S}mZO>dm8>$qI8CdaB6deU41IU~V$lV12IKp+;GC+Xa+_L>niYlF74Q?tqR> z_ivo^)%RsZJQ>-knsm0^$Sda*lotXQm1!OqyU}`K!=`UB^Hv$PRLq()|48$wWQGH&$`h7UA{d#;r zpyCiSJAyPgXoZOZ+HaKC#EbY94`DG}vP{DzfbZy6u8*omEGGiuPa^VZ5q%)r~;z`+bME~<6Q!nwfXL5O9 z9<2EEY0>*3W}sWqH;Jpk@P;$R<<$taU;1wH-4My@+>`UCp=t_=-sJtM&EJEMa{ewC zwcl4Hj0q~55hgad$O~zy&b+R+MyjmR{iWh*s-?5=U@jnhLNJi(%xk| z3*jf+fD8FANJn%|jUiXlKBh@tb5LGk40apSIVPVbUv1DX!#nL6oRsazdCalM$!{bv zM0f-X-J9IuS?LcyjeH8JkPqgax;9=;Zfcu&-rs?OTG8Qo_terSHgo+d=pc(O8@*;4W zC;ba$&8K5s;M{={8xy(a7Wb9hboo}DzOBgKU^O$kKRZ1>)l^nSBayl@1`G`0uyyR? z{E&I9-~kgVZ^~_g2}OuR49b8OD;*+Idb@^eA-4qDCY2dt*v5^sH(q55*`YI$X*COr zkfZ}4;U_00MM8?0<;2w_{RtyzobWyW2|Yc%F9(0ZJEU!;Dn&KI|By8J zm}t!@af)l0bE3~|ryK~sPHV{ej&ZoObhdLXQU~u&!>_xE=EnzXE;u+HJXTUtR+M|* z++P@B%LJrzap3`P=yuZJHVq#)pp-CD`;7*15UzIb1x;lyu^@x2MSf8&z ze`SK$mUTI(WW$zv&8INU*Y|K||F>?|{IzQ9!$ZcU#>}9k1B`-UOshjGFh16)XV&Ib z#9b-I=5FH7Zz0(Uh@F*AO)aHWqPcfqr^N)^^A$WF`c zFF*scr<*8q2Y+-p$ZKCkf8P8hVl(|GZ7aqxla!s<%%81ho6pH!Ahoy!JgtSTjO9k; z)ebz3+J}{`!DGtBQ@$-4kHBXG3LM3Js|yv>r>>XMMVba1P(GC|IyR6^MB~dbhPbH23g0pQV%C zJ{cZqT3y{%$D>yuBBnN+M8ash*!9ianNRm&xpebphq6_2KMDHbWJxrCTXHJTIT+7_ z!z#pLbYw^)@a1plb6P_MTnGVgJR|nfFvhhXl#;}n`nonWr=yEu{B?p)D$5Q82wJ_* zfm-c4$9m6V+_aPZ8p8>?C7sx+jpmvvvoWdpsUy)=WR+{Ffr^9mm>su&!~Z1U^EnGC z)b`d#UdtQ4&ulSOy&jNPro7v!%noWiH&(5$ixjky%{d+H@8|jOPd#~>?xp8?R#vNL zsN${qVmU+M_iIZC=)MnDhCv^LGrLgiF})K9e#I)9HuGlHyMwCD1y3c#O^Wxw33|Kl zA7T+V$F(v`8Z2cL4HsQrvQKyZQS;!p+x*bwj_F)Vu@VaTYR5pwB=oR;z=Z30^dMPF zboJ0;YVw`Ze>4kw$6+%L%s(4AU&4a5os|9Rx=@l- z@>f#;lz;jNhpNyc;`cm)+4SgmQhcMEU0Nr*Hoy9d^JB9${l^iwKOyUS;^MF~xYcvT z@(rqdYA9x1TP^gq$%r;;ATuP1wYCEtq&>e(B- z9;GVht4)avb95(5>{4QCTdQx{cdMb2iF^Kf&@(<7KlK>KK7iE)bW8HJ?Ryx*%m)44 zzwYi2#+>=N?IgysF4=sa*_Dswcfu7W5k=eWkf}L)ebd8u^C`ROZMXPB*NdCs^u~9l ztNnh2>1JP6_ci|Qy1(j4_S1*9Qo8+Rs4^wnD=e3Qkf7n{0V8qMVRm3pnbP~KF<)=k zNcd;=F++hzxt-M;m!OiUwd?pq&`WX4uMWMzI;^Bn-BuY%C8Lh}F4e^;K4G(aQ9hi= zjT>JJZ_O_ZOSP&X#dD9{WD@7XVqFgmOWuZsyeZ))TRFM$y`KrPGBTC8=Aux{tG!9h z9lOYqEv*o8bp7|=njMthwJ<&fE!7rkX1N4NPAbr5AGZNswv8jj>yv*lY9TSGmpN|!#Jp1{ECk7+lfgywfrrNm@k z#_5f*0!G0DybZHS{h#aPiPAQ3Zt7>p!ozt{TF%#;$CzEI(PMYQ-{Ufz%4Dh;PqW$L zSSHfisw2kqAuQb=MY>#VmmIZX_)60|zQhE&Fr)5O`3YD0!FX@FgiuVv*coqet-729 z7H=+h95Fn!6vVne37yuJV+cHvbo#wc+WdA@A<~M%A{gbIG`UqR-(E@jS8H7w|2qsq zNad3`*lT#y3;AfN9Qv$Ini`Z_W7w@ABr}am{M@=2%91Y^7!V8``Hh`HDYCX39r*-y zR*%Je({>Ro++ST5p?%-(L`S2HkDMqicb@Vu50832CLp(VwT_)o>{;Rp@LS?NTeOUU z{~)~p>uJmqRos8HDq2okzHR%K!4?A7-t%CMLOX31Pj1+U2LD{6p7_(RPC*`$Fu54_ zUc&IH8pVc=j-V7lsJ#;p9=Ty|6#kvrk_|?A_-OvFv>Pq)i8`gSN5PvX?EXY73qEo7 zw{*1r?{;lWhd-sC!3+gE!2wrCESz=$Z`Z3;eh`g!A7IOK$YUxQ4Y9st!KahEhGdrC z5a!kcL^B69>PThDac4m2hxI(zVHDJpS+Y)8S^UO9(-G_%31^I^w&JyV`|{Uki2^CK zAk_s?x?j0(dAg^I3aR){ljJey>`YF_12HKR_CsYu%hl<(f7(SlQ}j33RWVtN!~!rw z;CuI%VfeQP1;5do?*$VW5)C|J+0~TTY!Cln!Q>I=X2CbUrBm}NqHh)nkgMZz8}Dv2 z?Lr|DN9|IYoV|VAo04ho%^Vl>X0hVJtGe$b;|v=Xv3C&L`8v>|34RUf-SId4 zVnF_+MYY;%>;wVU1p!ik6m^nwsm`Di?89OhM@JG~MCqTBMgU9#oREiwh94uP-kzZ*T1Z z6WqCE`D2s?Hxmm9??b^W6%$;CnOycOyosFYjcK0oNCo>pPaFdAynT@+=1c$rN~!5- zw-6*E<-N?)f6bU~XroZMBpfeFDgNUC)?W}hh|U|Z#{T*>WEek|pTz1~{=BiHqhq(y znAiz{7b6CPpFaz&%Y`E9o-)`g5TeAYgdc`VqJ|upIe04nO_TK-ocKT`{sLhBI}bT+ zEh!cmSS`g9HVGIQg>sy;jvh!&7In9|J9&&IIZNCtwv1*%cpR;(Wjxva1qg&DHp4o- z6hp6l&7q=031aRv0J8VbLqmT@Yvh7*PY(}_$UFnYJe{TJtftl`)x+B}GqK--R({jB z_b5e0hf5-Npe2bhQmem%G62B(=PzWSkG;2=Xy)5(E&cVhSR9wrY3|o2gnLcrG2Ujc6`74GWPZXba{`KXP{*%5EEx*q>#PwDv``KV~Eglios3sR-ci>^9l*1>Oe z0pSjl84uS`tY;55%CEzZH~g26JJ20yibvs`x6Y92lcDO<1wS;V7D8~}i z$O|^)0Y!Ph22GFaU3p)W5+?6PA8ceEWe8&(e*VaO!1uuCW|Vdx{Q|R9q9UF~i9?my zS?!LJwMOvq@lSj3 z8wzqP4o1SU{4KmS&{+lIQ&Tfjd7Tul1AYnFY4Z6>*K13QLcJ84asHpAL%pnC_Ki+4)L_$B^3GKkJ-oP16M&G zcA^v=R;R}lFuzpF5hGeYPH&4ADUXKNjLIL?pD(6Q&N$P(8IkC%d8;Q>T^m8 ztUQVsJC`^K+n2E5Kp&2djI!Qz$QV$NuPAbHx-$Z@huNS!J6VU?*-WfqlujY-I;ujs z9IUo)L|%v>GN#kfkWyr2(Og3COhKdtJ}5*oJ>%oE&kKyQ!YW+BZL!Qn`F7sUUeR+I z72V0a_*$m`2k80e=j_IMw-*mXRvkjo4tu&@=VfGHjo|EUs3LAr1A8P)C-SHAW4Du@ z{_IDSmppx}_WvNvWyJ*wM*GH=dvt>S;u@JW=hwvBQ@PXH5|iP|sgr#hx~j8&M4*P( z8<<-wG!U(2!i7vp9Kble;qqA$exM>Gw7j^06I6wF0QqmR z=x~OFoP)$)ueL6f3O(fm0E`|9-4b_MS&k2U7P1QCHBq(J1aWHl;cn(T^Ot*|2c4RaBO&Ztk(gLwHg=Q z4u182!>Lg{NYGwQdliT@4Snj%Nlv-qmD-5-wclQ#c6k!+Q9iW&`{CNoRY8RyJ#HgO z;>aI$jx@2C=;~0rY}nadrL~!_Tu}_yiz3GPKu^| zHsKQt40jF_2YZ_o4TdE?u<5&Gf|!<{Z5`)}xotp2B+3;%n?2M!cl-VQEx4)WMg+Ls z+*RGvQ}dM+S)#o_`3w7iPQHY%+ueyja)tEc?A+$q#6-)#t{*l_uyvcSUwULRTHF^h zp;nCMVa=hS5G3B-5ip^B1NS4ndF#mg(^n~D$^#!KLG*=Q>xQXa&50lV$*24ZICGhN zjYdI<)Q#g^E!hIP&hHF{M| zNz3c9V?vwha{4OPi09zSVR!&u@+DD#e!!5^i_2p$T9uNla>Y1ZaRa1gcWaQ*;r_eN z-nhWtZ0T0=eY#3pou%ccM#5V^N!Mbb82fbty^ZK3lHvajbRr?|IwHniQIf#}FIx-w z_$WBCe94MagMHQgdR;WA8>xM~ky7%?`E4Sv|D=-1%{9&^F~*hbrff{yqv%jX|Azi+ zbbSTrRD9(I1wYfz|M?!XlZ-dB-RfU5ElgC+r8_ofFbNDa)?3ad2C4}KO45MHJ1p>97R0WRZ4=2RzPg9~cTovR z{x>m7Q(Pg^AlwrktDT+FA3_C=8iW7Om~dw60|$hQ7#1~CZN`zoq9uL#Zy|E2Uhu*L zHLqKKTaC$ZOXoMzj7DF*)aFve5{(f_`9xeC?EeF>V{5!DL4yzw~suj9F14=F`F2nqquek+@8$WYisbsmFR@hK;W? zJ=`HeHVyoCBgf9-@@UFg<2Qf&r+_eSE4s(#;_Ld7KPl)Au9{pa1xf^^Lcl$W7zTs) zvoRA4qG&D~G`5DvB|bkaSpY=q9Y%ntF$`Vh`5wC~q9_!&4xS7u5CW^Dwf)od2qORr z+4Q|A6bu+Cw-%BxJWUP-jXgvd00oPTB?|bD#^#AZ!O%rQB^WJ;+}$c%!Xs2^c4M2#z<|GOJ8yHwbuXSP$XxKcPO zS=ce^l>7n(zTy6{`m3wSt@pieJR7v<~%)D|6k>ERF zVVGyqpF?~%B#X+rkEd;|%&%k1Lm>3-RhLQ&WI;0G=Td^LnGa+rHaR*^j7;2w(SB=w zHV)NaCUROfaf+GD{U5Z9x1ugAk>bE^>8s~Uz#+4T;LE?mC0lMF74PWj@%QjZojQz- zjrHd->oRaZIW}cvWUWRUz)jBmDmTOtY4cYy|N3qr$@}1t@S+Wk7WI%PWh@L)duH zj-mvS{FC0pl5<<*>h*}CErzW(b2>DJFD|ahDKS5S2qY*a%RlE5L1Qn5=YVRs8)6uKRPjF4cV_zI zOhAHZzBJT=V!T$7NR!B?(|WB2*BAIsHV6^Lz_qT!67KWSlit5=!$O$o)5cgL3;tS) zYuScb@QQCdn&1q1|?`TIN@2JHJ7_QVSg0)nJ(Eh?%cEh@! zi6x>^MpeTAm39FEzjXla=d=rUw+A?AUY=Pl8FYC+`1`cmf(mVeyNfr9vd{u8!X zv$w$Dm-H7O3bIQecX<{wEZMySmk%*pNe;Gp2*;GpaW$N(=$-YY;PSR~+01U^WZ z^~v6l(F6(JZYfp8oDC06OT)lLpLH8E~lUsQC`D{K`!KeZ@%GMg(a z?es6s=C_NYw0)Qw3#UEjTTP_U-p@xC0AW}C9 zHTO4OI#$Y6-mdGgAi66j8|{UGQ*%JPX0>VFi(i#*8`ze}S>HZjaW5(y_ z&0Huopy>-dA1@(-p~=Jj=mAP=5~^5YwPzsfIlE0~MMrxrgOIsNwfXA;=bY}>kB#EZ z$(63pqEgE9a>p78Lfh?{&r{1PaP4VPX#4P#h+ob{txeecq_~A;>360nriR1$Jv9D5 z*^N1=ImLM&?D05N1@K>n4(ONHyV^cIx$lYLHLlGCXZ%(^xVoQrR3|LQ$%BeR7+Vi> zFc&ID&ZcWVY^l$&@agbnv;B07x2qj_-|2fqTkh>WooY^eZjd+gD+M_N9xg2jy$B5W z06aPZS3I{|+(AIgpsom0R75Yw-`FrJQ7}>PQU_A$qYYH*bKq02s0@^H!Ygh57vuAKIi z&ZNFU?WfWGs>iCsrvLKp3@Yd)m`%DX!&@2VvULmS6Gwv0^p6^{YbwInn)LkS9=|}u zHJTZk5u|;L*x<(?*$nGen@};bYxQPZ1ZA~Z4CaGnY11gjo#B6bNc*0S)#ROuKYA9E z)zWGl-{a?1fx`vX=wdck7klCxc*4t>!g`Y@k&YMkZ^Pdd&A?K8X)BA?!Zw=7k5ml0@ z!`hV1rLQ4eT3mc+%Hb`+YLr%#DkKD?&ZPXr(}fsCXGO{-gL8&PFs2u#JjTjK4}AHP z925Q{#6!QrXfxkXr%4Ezdolw56qL@e?_&J6nJdyxy% zjn-s*HK`P|H=X*OJx4XY(;oGTS`DFtznh_zG?@Reo5x)ce>iohYU0Z*+D6ZwPeIaQAV^ za?(@qbmg^e59*gCXs(r=k+~8og&-FrnP4MTC0!>EfZ~qWjbTB8Ke9S-Dh#;NiXY_6 zaO=S-kM4$^>JUY#FGZoarTF58pB^ngE+uJ+v#~oKYT4bfo|Ec}oLZIDpDUa8#(KT~ zvHKn#e9;$45@E84cBKNCo2-wzn~F{vE25EmNQG`^2Oy6UFf2AN7BBIdn&U~~32+L$ z{4JoaU+oreN^Objyj(6kd>oDcoO&Ea?wD)u$}4+hdh!k6nSImT&h-bf&V$|_t4+5+ z4@cNUIPU#0kcvZzpNJFi#pOI=cDR$-WnYFk9k@EUP&;=6O;J>sqI`&K=_R!`g z=rQ?Be}O*kPD*Z=Je9squgWqT@}<*jENGhd$W&2R8E!>xUc5?l`#DP5CtOEN3#=>e zlz#?XbLVDIt6RLs$vi6+Vt(o4`3jlnqtyeKm@4;^Si603kqN4DAu? zMZJp@5~DYPO+cImWh8V&%E#RX?ZF7Zr4B|AeMC(}=R##eC4sF$X+~E@4?~ehlSSJm z-V(6R!|f% z93z@$8pIh88(bK(>-X(bnY5XBJ@+Ngrd~(&xrF3JGKpuH`m0y55xRlSC*GOo%knPu zNgX8fPl@=avBfU?Z-!YnW=m&h*wBGkvo5uIx7yghm2ElUosnSKB;|X%gAcOsGU#K4 zH2oDHHlk;wc&u5pIuSf>?IPYJuXj)t;X@MfLw_hTOSBqb@4;maX#b8=FNHLFd7M2` zBdNyIDKJb~Gbk#rJLp{@5pd_tZ^a5Ab({Mef|JcC2leBu8KozN&xAN#M&^tp+gi`| zF^AOUIS<@Ez)D2nOP5oFwLs7Pm`A=c+c=y)8{?Q*owA)krcYs9qqSzZuR^KRt7NFC zt1++99c<<-VQXtSX&!B1b*B@kzKp+OzQnvL{Tax=O|aH$pYS6=xf3lzDc>bu+W&r8 zZ_xMgZ6RSa-+{iE9=n>O8qtBykN2tNruyaSB;Wk4wSRN_82U#dhy@V{Mxa0~^d}LP zSrBvqekT;|4uk|UddTU&4WqhR5-m>{izOhQynR37R*8YQZu(3)rRP4dBSv}6Oy59x5? zb&BD{FF>oXw1l=4xyYiVy=0ecvhcX@x?HJzixA$w&cUSV3TSG> zaf@k%p)F719MKHZ)P}HgiWbBK7{=fydPDettiaNOc9iUyKR2;b$yVVRHLYn75oB^M z$~I!JnQ|?5fAw;G%SEb9)&^T;f6L&QH^S+#3(;%w>yT2sGiVbh$>=SyeWu^3KXUHxarL1@%rL?L&lXqYv;vC!52X*H7fzy#)`M94n|5%#Abs(KgJ*=qhzW>2ZU$~kPntb6Lpcpla&xklb%x8lKUfh8^)3s9b*&8lNkQnB5)}= zKDIh;D>Eqe5A zn;aet;;^%>8=KuC-P?dg4~U3*h^BF4vCb6Rlg|@B>F?;b4Ug)On*OcUtq*hgI;nY# zIe!KxImNkW15tpTr%eZihi^0ad_)lZghfIB!e_!H!sx{_#E|qGBG=-jV-MSB(H(tU zDVd3*nA={P&1^i|J)juofmaLs_ZO!diEr;OF=4BN?c@>W513QxY>TZ~tvZX|A{S<+ z>hlj+#~l5S@IUVpuHCaAmH2WmXn$b=^-LoXp?&Ijc(^&9D|`Uv70ys^CH@R{28aBU z5!W$}f`Xq(9l@V8EzNDey9e*+ecsH5Z8)84j(m<2((+S#NFJLW6Ob#A<&lo#_2M-W z9CNL5&b~?wUiDRXd~kV0o94e9@9z=0W28aFDQ-QPS;D2?;r4j|3m36l2CM1%!z$(kw5~3%(M1 z{$>vezC6F-340#r^K}KgE1oZIbAvM)!Q_CRDe}W=gQDqZ23=D>G$Z7AeEo&&2or6h z067Cai6mk~o;LDOFU#^kH(7p=jDo3?jf@%%`2ywQWtYjyf1&)|Z^AlBX}f}ez@z{7 z0R_p*!2tmw0+ALIR`UYA^n>@s9DMj%l?B^HB_fIxMugG2VT=mK@=cTpgtLJS2zw1S z5rZj)E772Ohrq1Fs5n&Kl?=wIj1;dUPgzzpz^oLariwcJLm~_#2$LujOqS^M^t8!8 zYS!T6c}>cBo5g!SYU$!}G?B?|dDL;glGzqrQ9+j57}zK@qScGZLjD`_H&!Cn3>^_O z^?FdFkd?NO2}|RdXqtqMkcmn&sCCdxec*tZ)nWu)Tw~xsksbIP*dOzt$Qc?1uauJ3 z*4DBznD(K80XFM7GQN~FomU&sRYeVLo71`C=s{49>z*%v%w+yB#x5zpar%~(1|#jOgrBR^{u;PDhhH!E$Cq4i@bE!mFm|i;hpyB7 zoE8%}PGE_F<_Ze&`ZTJoA@Aeqj3KL};LvHQshLHq{5-Ba!)v1lH(5pQX?l((o5!tp*E3Z(`QJrN>zGI$m%~ec=eWU;+PvAwiC9Yr4|%^5XSyGDDz| zn`O=6JQE%FDo0Jt%!))^jz_p6R;p`wzKZs44( z1XSqzE^+`0@yTxv`?b(&WK*^0eBZmM$i75OU?eK37z~UMMmJ9Pl32HLC3u_wuBdh= zHbesZLH^e}r3@J6j!;T^I=lsnN1X=u5=uv-#LKQi43aP!0`fD3s!>^#hRey!A6m`o z!0)dRBc|}yO^1XyX}3-(nDBvtf#6^;Vo(UQz91$UQz%myube|dLH{2JLwiwrXlQ6C z?gt~Np%Z!hx-%0-2*#vN5|v!@#l^)&9`WpBx0)>XvV>TPA7q?uGyxy44;fkj{2x>;u9AfE^`^tL@m&ZofA!tZr+f9cG9i5GK07Q^FpZp#(xkvXwz7@p|U; zo1*W9dWbJ4UBfa0kN8JP1QCC^-qNAhy=L=rcNj}va1{hiAawWs?)&Vy?Z=77^C~@s zhHLy#X20HS^k^=gqWZ5TnGxp(jhP$ukhIQuUn1N@OiawfgG0p+I4em~%7_S{v$H{^LCi95PR?j zvnm-ihN^PdWX43!N|JY6lEw^Fc|?SZkEQp*OsC)H;fx$Co81-)Z<7(irNFgP>g0Es zv`zxpxnaQut5LP8T;@<5z9kYOFjKN>1qTEy$+7EU>GR{Q&~%^|4dTZm^3B@xY@y`- z-roD9ihsvrU;4xIK| zQ$%A4{WH+{t9pxE?c~XH$8p1n(USc&c_f@qHn>&`ghPaIj03fN;dixmm`F*%f$YnA z==k{KK|{!tF#qI|N-IrHshD2qHn8*G7;eR(SG%6Jd`d!xP$_DzVt;U}+^h^P>D7;r zRKm(}6q&-`hzL?7B0-^|vohU7Lp2hhNRgE2!u-=qDGnM+`-#Pr zGNFq8BH#~i%#i}2s+tlM1Cig85^1t83Ij(cWA%!)$J|Vj^wW;OK^emVj`t)xGc&3r zD*U83q{RB&CW0eQl9Zy(j%h+NfanhY{i`?P=v`PgBpF42)lhNw9|zE=QKcGU z?QW-r@9x~X*t)>EK>uBE#!fbl?SPe-fzX1N{u^e zP_~>%XW05*tKYEEJHtQwuiybM=@6dtzp?(`Owf}57>L&U?pl10<@DFN+_6meyWs!( z$pyg#z?W52P)D&34D3A27DA{N0H`#$3BarDkcc&4mrx=OSSrG?m=;-zv_)+)#Pum! zI0$Sbm+zjVrM05t%*jF_xyNiRB%n;ulI4h(Mv!&Nh9P_@GA5<6(bo7~(2^Mmz)`Hy zefvr-cCE*2JCxVV-jJFDsrMn?x(vyE%viext~I6Vyq%u>VZa ztkjSj7lR0cO4K|Og6FA*4_$VD`=L5e3Wq}*fttEQ7jr`@g|A7W4ICXnCffj#| zw~y;NQnz6+P}!OrB$=gMqR^lStgv+6EOfp3d`^efa%29bE;}LZ(}?uh0$)dk=ze%u zJd&(v%IAlg5wsNn!25hCW=`^;6 zRi)bp81^odf#7TDM`r86tHCB2plw!_pv%ydYUN_Zm^59|m}L_3K#dcFFmKcksk%!V zP=)v1Fu2ywRuv2*SE*us8hfHO`Nl2z^QbjiV2X&KCXDG8$mU=S_8(rfeqSe?jy_@t zw?H&=7QZwY{H!chY1kw3hizsj;L?GrYyBXZ9C_?Wu9-Yjxk{!?CJj9aPpPH|Wf+0- z320a~Ql)|$h^KlP?W|O)LPeuQaSw`L;oLaQq^4D+h$0mRZlIHqiV&*RKyNBBULaNG zfEB2%YjAlS!b2*Q6A-)O=w&X)ZWy7qfQbYO|Ag|d1fD;hVzIpgUfJBWyU?SPa(Ik@ z%WPR7sP&lP9}foaF>!o-ydy_)8a3;ZY^ZXK5f==Dtr?705!*b425Py?G07gfUJka$ zWG0skVDcvirLJ7xUaa)WZ%PnQBb8zjPX5ahN~vsU50}|>M5|(vkIRU1e|0x@ixIVx zQp6KcYq91Ww*#mM84>nVgu(A`DHx5tN(6Fm>w(g!O3NuTk9nzju$SFPN_?_-B`nOz}94yiyacz9{y`sCZA+_|>cqUsrz)V8$09 zmAa)ujY!+8!C?xs5Netl1{sTxgfs!xmjU4ZHx(51YFvER!p-dmZ#)@BEzGqpQcUac ziaBfHJ21RgA<~uma!$8YEKhB^!KP8X_$+Y-2!ms<9sh|1)HmlPX4#kmlUNUjrHG?h z&m6?LT2N%kzeZDkW&D}Q%%FqH6KF<{(LOJJjoL)ERyLY4)iHi0PHmv2I|Kg-CPC^WAJCFzc40O%pHqQl3=^o!U9K~^Tf^c6ImcP2 z;9%gW9`3!pkDM~36Kv(9w|^0is{-z%5L2O0pwfuo|pDYvn^uJG)&uFCJ|j zUoTOcV1isW^JQ4F-bVNH1q^<1kuwke&}if-fJHLZJz(Fcuj^FIQx~t!J$l8I5oz8U2m&9>6@U> zPvoW#E|Bbp}H6GUzxYK-#HUS-u(UbRr8;>96){2g)>{( zy(3ck{A%tvi$$JxkEOE++t1A$>EwvvUv$Mw(=8fSR3z#;6Ld=GQ$VD8=}Z3SEuU-q zmD=4p)8PzEi_WX|^X`vF-D_&wp#7bHAzYjX9Y#N_ghq`Kx09u&vUGcSDSlx@aL}Ad z6vw<$;N+YWn(GEjOj4Up0n6tD?z6Wi4BT%w?b{OEMLZXHy7%I9MwS-vtjDLY5x;g; z4V;ES*t7qdjyQj>7=5B2{vu-Q)c1@R}E--d^cAMu|xHbpk|RwfP4;E~WW z<5pJRrD_^*2jm$_sJ|}qvm5mWCQ~ZD=3Qs9T6#a6J@kC(+Uu`99VD?b!F&BH0wH69 z9sX6;sNAz%SK9w?q+VA1_CBrZd-n>zQ2`u&Rl6=DnMtU(_1|B_Bvf{~cNlJ_r|EwQ z80gJ}g!Y)S@%-E`_3^Of-Se}*fg?M=evPESW0kepkm{&U$l82xusCx6efWwQ=AEze z{L)utdUbvDYo`KUR5Pl6Gy0r{aK=-KiAdW}BY)Lq&(h57;OGbryuPf#avCtWf21gM zxKOToJe7OC+3^&GzQ&*1^Kt1|s*tOrrWQ)(x#0{A9S!z=n-E|(3xI?Ix*kpJ+LnBi zjD>o0+0f3LKKQ{woSONWKcbcs8O|RM%lj%679l@C?vAn@1^nN+fZngCrP&6Lv4RiOXhmO7Hy3vmdR()$TJqdt zb2{XFld82Q+vKFA*N5{6U9%el5UYTXb3;x?gWD~H890_qL9Cl#=~+d=(r#HP>ONWQt@gjQ?3aQ#g9B@*{Y94k6x@Tm+}ou3A?E{u{u#8l@e}~ zwa63+agOoN8XrdjZ&yTqcWa$8UcRK!C$Gb~naODExRd*;7WV$dwxMYpG9A8cz`_=m zqqx>hEvSUX>KI!hb|H}^3;`qD6o0gqhRGambgysz71tUBl?Vbed*ax-8$OxM$?351 z+!qF~-{AqNz+@uUO-1SS*3$EV*kzSW(dwh)3IpAk#-JaK(0aELy+3fyknuSX{HSH9s+X4Gi1q1pd&{AB(?IiirH2lFo)9&~OmvvK z5B#y)9Clo_jEcYFaWj-wHii`+7SlA#X_t{Np6i<*#Mq>OLRWyvE3mNr8n&>#O!Ds3 z(MU-%)WgEvY>vybifNaDr;NT5Fj%~gym|=LxtlrNn=3ovm~D?;@blIIP->{7VU6(H?Wa~RZ1M;}(|EitjmYasa&<4~m6$jyFt%NMuyOW} z8Ny!xDPVnoXA;_7p_h4#Ry9?Q7BWt44f!%Q!)&u^0yMOs<9x1I*2IM5C{8Lq9$xBg zI^c7@TA%kIc+nccJSfPq`{k&-H1G9!KVh~CG&5u5Pj+9&&4}v2l@y!3U5%P!HA|o+DdPgzfRkgC*C=qso zh=YNl`n%&84e_CaD-c7Yh`_X$0%+1B{ojZ*&pF{mIdeY)Kv2$e$; zMWlsFM*$in^sw&O6L*Ems%4gvn~P`!uOQ6i-PTK@^k2WClmlSxwz>nRS{)pg-lRX` zht?Q$e~u?e`g11tWz{36uEMZW!&!vHvQ?(vRKOM)pK&?wiP05<5cIqsGJ5Fyu9eu^$8*GO1>x0W zqV2o(yq&-3e^Mb0{t9T8)fm2epk;FGyY}s3vzN;L%To|#==ZRwsqc=tWWh8dmTqpd zCrnKci*REq9436;AqT9>c*89X!13LC2x=m+RNgU$LMbyev&S%@58P>yc)5c;9xee(DqL)naX(BUesyv0M|i1!p4C%h6!ng zXy9clt#|^I=aeCM4Efi`H1~pITbfjl?*A(mO(}A_%+9)scAdjCk8Hl2+N;E0qNfXj zJ`qfx0X@}in(KzkdX>%~ahiRkR%XV@;wc<4wV_Q5l$a&iABP7^tn{J>W$9)4oJsnZ z5romkX6bgF@)*N$yiaQ{?63qpGJSJjaaof{TGGK&*M)8{c7y5mxCyrZ`hv2!xlarU zSr7u)F^}dJ-L$#yJx%WhshxUJ`aZ9sVH1)>2~JMS^dDrG#-NtEDq}C=1hl zVni3HeT!}Q%(+VaVWWsOTMM1MW^{yt&gpe_KA#+cokP#S-|8!M=5jSuaWW#2(q-bE z<H4zMCr2Ps$^uaAIq;~-~7i>4V zI5XC+fr7MATs0-cy@d@Jqngq!`6%LPZa41tJ|%T!Yg-F{IAE~>*lYFJSUUXc13X;r z`!t{Huysqubq8pTRh}-^8fPk-M@ht_zQgnq@W&?BrNiV~GK&+k+h8;!W(r(-VPG#- zaZ+TB+M`oU%bb5D=jl6MaJVn>?$B-dP|${qIqxC}QRXcZ;&H})Hee~$D@U&Te@sq!e9SNrJonCbCHt_z`UG&j1(VGVFPG3!DuqB5p zPPf0c11`r6I#amf@Bq^C*|o`i`bKPF301`058+NqLfS?!}p8{`BO!))Bdt(4P9~5 zko$(V({iojlZUA(&+I3IZ2r1g)OQ#zafxO^zL)-se1e{4KFjx_s^sNk{w3NpZ}-tG z|IPvgesTpiIvQ_EOsxNHx@6!kbI0vB`ilH{S9#1I>egNY*w@}`aA$o|$Vid7C6>tQP zb8lT)Vib=r4YIcw$q&Oo{S4lI8W+HVJzfPILHND+*xC3xc zZ!e%3b#&1qR|23E7u(mm@|E6u*Xd2Gx^I8BGD~cKwmya-_zcZ>HfxrgHXa@3(YHM& z4L1gpJN3a+5NipchBn8kxUOxD?C?y?ts;=Wo*{LPL?fQ_$7^iY3fOE9Xl>QzZ3?uS z_j=)iG3wg{qGLXTMAl(7+kXE`#LGXejgBjxGP2bCIyB~m;5dZiHNKAnae^y`gAUABWqGnc0Ubnl}lwoOET*S$Lfy$ckJ<}MId*%HT` ztR>z%-}(0eGGnCUihk|q>sPn4!vb{_2nvyxcnQjUGb7bnhWoG#6r|2`^-av2Gn3h3 zNj3OO^3t}zvMyH{SyGzC#m{A_Jh@88tU+vU-@AX(Y<301dBhi|gATgKZ9*+?%xak& z-j8SV#m@=`84bq9V;Xqg!-%gn0Qs>spY~3t<(jw2qNUDJ*v}$sTGz31ukm+SUF(UD zTWm|ub3PMk4>`N#0Z>otT>a#!9;p&oRaRu|^!%+3I_Ha`4VLMjDy|czl*Rc}rRW`> z!E%xh*Djk?e$+mrL*QX6o}F*GDgGe_g1Xu4=WSXflB$KB1vR(NZ?*>_S&{(S$0$K% zO!Q5D^}%L0E<=t=&0=`4L2rGUs%GSMvmhcfbOn-HdzgmrHtXv=5Q(}H_|FFlWp5D* zH8*6u(s|tTDHiOnaWJh)*3g~c>Owc`FMR>t2n7hnC~(Y1h=h$`b<~T2Wg%Xv3-uIt1r&%qpeMQl(8)%rRW) zcRcTlcA2#K3&4s;=S-;Rf0b~o=61CA(eii%dEhpbB1*@zaGUq56ARcWIy+Om=_P2!FN7ix8fnf3W z-%lUBJ5D)AX~f%CfAH&Z-)98bEQuKg(6uv0B7f*QR0K3~YI>y(ET=Qd->f=CTVk|) zp%*hp$y%ISHG6Ck$+Vk!@!2En>1oxMPxOLy{BbQ1ltpJPskR+n5wTM9j!cR&hFw|L zEQBnkA&(EsE`r`KtJAES{sz_h1p;Jop7^xoy76a*(UVUFs;9G;ua~E=N_Ly?oT0~IJG>gweoDXC`agESnkFYR@^_Pb zoj*vHAbRtbu6PT2|57#>njj^2a}Lm0N*n6GgLh$#ums9(U+xkB=laok$nx--xND3a zKnmpSwrX2)t7Ck?^+D;JixN}Wt!jQhmYc^m3Ng_e#Yme4hg)4R54>o0uckWwYND1s z6~vm1%jcx0X5c9~pLwrACd*qFNKX2)Rm(qt*d@**|D~f+%Aw!xNuI@L zW3f>@)M##Yq{GWEm?P9T$cF%7>JO z@#|+tMI+ufHfl`vSJLiP37nUZ$EBl3@r7S8`F@XYFtla5e8M5lc$Qu%pJs?g>1gJ$ z#P#Wir#n9vnwsWyrP<=NRfHk2_+4mAtW2*fd?l%c=gD}+KNYf$kTk6pKM(+$2UiCD zn>+?YV;sh^BVR@fYg8Dld)$}J;<|m!7qA;^Lxvk!lyrzruxba%jtA(IK&?+GZ?lu1 zY&+(yqvV4C?Z{^x?t`Tn#i{u#bDj2YKk2<6irch18u6zUFSNR1hk((nmCGQei#=6d z9fX^SRfhyXTknT+SzKFBt6zujA60fN8?$y&l;7kY3^DFG$vwvu<+c7bSQTv!%-sm| z`n-C`Ulc>?&n%5!*&H;D{LS;c&ZZ8C%IyRLq^m3MB2?4Vr-GKt&Acb^skNN- zCi9KGhk0H~je{`xnAB2GvD?2em1^aUXwx&1QoQW6AfwT;S{k^rD()tr>mSuC1(Eno z&f_@EoqKYKS5+bStgqrJGUQe8?IMc1lvJ4BL*mvR;)BJWD{NGc`t;%=?g8o?)`EBc$|QJymRtOQ zj4N-}W(HfwHvJoh1F2(e_(VZcd`RHd30L9h-x$4Yz`*C^KFcW1W(#L{!T|UWazkS| zWht7hgroI7MM{S`kX{l&K6ZEOKtoo=(E*dvjVQ{kdfYX4V>2+Y%3@Q#zIpW~m_mlw z5nuLQr1U_$6`a47Y%zN$Y{?Ql{sMy9tJ)V`RDM7Nmiknvbhx>CV^I;L&FXj4i`p1O zL5f>c!wFlXeJz`o?}5D%wp5i64p2Mo%%%{j6zNep!7KEwyBdqeFC?S?Z({$$N^9&& zVJcB*POItJ6wAWSA*o^6{xJzGVl7l`LuB(@$z~7o2zSal1se1_kjW#uy>n}dHgy=M zfL~&*<}O{?X^S@6A>&1wa$?&dE6wH5v4XI9VEgq4z&x|AyERs|N(3 zuvlr_FEK0!w*6dxBB-7-;Ea>xzSUm5YS|V?j^dnsGBDB(WNHlj51@;ix-%ul`5GHV4xC#kU8@>2psvqG`VL1h7&N6h%Rb$x8tt6Dq z$Rq!KC8jP6y-puWN9N=g3EieAESN!v=#vuS!I6|$41#?B7F`6R>S-2w#o;l$15bjp z^PB{Xw4vLh=r$Uc2 z`^UZtb-%ozr+|gF4_*bZDm%O!NP*--1q_Zcm-!fvh6f!k6Dg<6n>}aW7`*3(?_`But*AydWUKpKyZwmj#wUIv_U=KbRbpFoJH|1AN2$&MqJDIRIlWFHt)`)7dZ)Uqi7AN8WDLB_pe@6S}?YW~(d5yGu%} zVTIY=PLaf2B~$8ToF2_veS*(VCh@0E%kr*0NA`V52D3&6!@^hOcSSM z9oBu~f`h*S+&xUdY}fo_ASQTc4k~c~cxsGrl8`G#6zeG8!$x;fIHb1IS1PO90j8sD zQx2X_8p0-R{{tI3I(RtG3dtcV+^Wg;}U}`>3ov2JVmGPL&Vrl-vE8mkJK5N%d1(KmdAf%>v33kgUy$$%9Vo zDMj<{`IYd^>zy4?10Xj%B#WfCYYA!3TOHj#ItY~}hQDUzG8XP`DLD%7Km0wqP#{Ph zwXoxjXteUP8`s1=(i=MM@kC6smU z-)tCb1tgq;n;bDz;3M0cT(SS%Qrvj!J^GGz?jp4nhF` zH>U6#2nBB12{$SXY)%Xn2)5{JkT!^gna}G=4%qnNn+)c_fBwJ$C^V@{KjsH9R+OP zeufCMu^3Szb3f5PQoCpZv_^+U0;P)f|}rE{(G)C zO{PLn`z|x=qnl}Y_@M~AVw=$mOoIPW)DG{M84_urknj?thwW~NcL9v_I395mFJhcf zD#LE#$Pa`pj+XJ);D9F3ax4pBD5g5nZ?>R?P2wLUGs8y*jvnsQj%u~xlcQM4Gtmt} zi=p9tktbx3y`fQ%p%8+Sb<;DLz554V7{qe@EpTGp06vf?C#vkIBa|D`obl;yDl~M7 zpd1JRCTq7?>4Z`Fxr0JREF;;zsbE}UI}gI_WGNgQF{kWgY&n2A{sXqe0W;-3w18J- zAO>vQ2*l(HIH=ZLA<;9c0PnYwyG-Q^h5v>?$$%-DSr92yh(bE4EP@9EMQnEG6CcJJ z!u+QQya7Zrk(piuC)uB!vM}^p?_J5sVS){d^DxUog~T9E^V@-Ddqd(tvy0_?2Ah*} z;<8E`dKV#biRdpB$_+&C6EB!jpDmAWB!EpD63~J2f`EY}20fj11BG^xcXlZOcTfOL z|C5FWRmZ*hxs*%Q9+-$KJ|uL+CM-qPf;M5DVg&d-P{{U&1113p7S&;L)--a5Et+Ld zFVshl0UW#`u&#Pgb`@vDgr6g@*QGLBP1sIhi<#PPz{2F7Scwk~swagLZ<9p zB93Y(b_cbNWFQmeT@Gejj0^sEUC@8x+)y}~P8bnbvf)#C@Jf#FV3E?C4V`VI(c|wM zs(%<%ZX9Dk94oUM8C`NM(N4JE2%x&XYU7Efh_G5-o0N_JGxk(o;-qWP$V2{<-R0?& z?6sRHg3WZSzn%61t#6Z&$|6Oi2r~FTy|Exu1uh8-CK~b+xdx?ICIG|cdtVL$A}y{U KRxM%_{C@y-D5HP? diff --git a/media/pshb_naive_cpu.png b/media/pshb_naive_cpu.png deleted file mode 100644 index 0551418b5cea20f31b96a87894aec0c0710dda01..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 26740 zcmeFYQH;rPI;?0C2jN!omuY!oma!f9%aH zZA<|G+yQIS%oS9mTSL9f3?LGnP)JU)75_|Y76ucJ1Q1da1QHMkiUc0g00D=Q5QO_f zL=#XbBC4POO8x-=zO#Eg$o|LQ{m;)%{p#F&S+C3U$=B${cED~p=s1@)%*o7T9oW!!O5 z{2Km`>1;*@4MZjaKstg+{@v>URoUfz7_A&94F)dEn|m(P_`(|MzBK|gsAhVF@F#!~ zQyl-M?>L>G`)RVUB3_xXIiP^jTZiWxu)trq`ot=1Fwic(oRvA$p!=X#w!ubUUqA)# zKc|4+6wU}Nsh^9}F7LYecvggO02DDm0OoHiX4v2Yx-iMPvpsBh6zG|00M1iC)*Fl; zUo{5K#u#pr5j%SZBvt^s^x4^$w*u{^Kn~6)hllx>hlk}j0E65Bx$lKSfkJ*CLeK$% z%s=`)Khm@x2VdZ7_jwarisfZ_x?~7Q5NNl!Tb6{SlFg?~panyp+PENi0sx z)H5FJEgzRf@wZSqh?`S9+TQ!0fI!WG6aCplErk_EIs4R!hf0a_YE0h^ZbzPn?5LP@ zmHPJzQYy77XNoy$+R8gCB#VW!rAvnMrc1_i=Bx$`#q5Rb$IOastjtcV@Qo5plMPf| zI_6)ar7Nz3cEjIE1IsDIJ5~~vlC?6F zZ8-^8X=usUxqD6{{K!u1EYz2J4lRDM>b1tXZ$35N?LgZ?=lutTOZyRtvGe;4+DGY7 z&ZYt>e$79?d025_bj_|V$4_7yQ(z@xYdwRRuUYL{t6G}t>G+Jz$}K;a7#B1iIGZI~ zQ>$Iy#bx9d74~&v_|`jh-)H7Ez?w6{;I^U3VIGdfZO!Ps#F$0pY4^s-#`+_9JygE9 ztcL8A?4sOHwpi@SeAsWphqNmjUG3j)oDYQ1YB#3*vp%a|9Nn+G%9G|3qyZ&C^leAk zsEd`O=QDL*)|3}$*fiMESw7k&JGJ)QpR_%~tq-Js_XT@iZ(PA=PG@I4W zC&+79t0$bJ97}Dpo2ER>-Xx#nK!AawLd5+Yg^xy3`z=TqV zwWf6S{(c)gthuh)ZTYV3%_0I`0a>Lv(S4Mou2{ALzOcnv&EV9L+)&_0*QMnp_4xS1 zu2aoYjlvzELg zsib-HmmIn}T4`!odP<6Y=S)r}cg$&?dQGp9aZ0rVc`SN}zob2gLuW!mM<5u(f!Z+PR&;|L>%z^&JM@m!YD;6Hne0 z+obO(;jl*tb;bwc3=uwKPr83We%UPR9!i4E98tZ}9a03*7*K`KnNbGPnov8>n@osy zq&oe(UW4Mi3YuDh+M05X;)M$RV)$~?iqf*#3gHsxyzWZY!U!f0Q#HdlLoACUGb@`i z!%0K_UycTy*32FrtFOV*xt3A7>FqwjYpA6Z*%8Gu&lBe~g5>6^$gF(sAn<^Z?vv7$ z#FxOC>Kp4G#2<6O919x*Qw2maehzvP{w9iQnoh1lvU@^jx;Ol) zJ6CpDWM||Qy9jb!2{QR@`8Q|mv`E=bYKl$y+e9O={#=9`1B zz0c6V%l>epFry`;Yo)^ZsfLLA>Bz+KVk()Z6!3qnh45o|bW1HuCCl8#rdSeKeC&L0 zRr!<+Yu%#FDXlS`S1UzF&ttLQ)6XOD9rORXa?76?UcCLd=04PSa(o||7Xa^0RAySi zN5ZVa?Dui>Bw`R^Cu8`$G1-q9?e3-aSXV&K2CokGAF1@-TM*dr*+A zxB1LHYJ(1e#%vSyi}i{hOw3H^M_oq2DIY2Il-CvMltUDemCzR?<~sA6OTUEB<>ZC* z#|dT_hA;+2h8D+d2E6-~rmQC4FT6>!C^rzju0XlrjAH4gt8^+igEx_RL_2f6nLZ`H zDFdYX6bNw*&GuLm=;oXm%^e*fg9oEcx>OpR|3+6;w`YfTh6800RqXE#JxN1LA&(bP z4OD(v37->VF=tY1g>gCm6Y?Z_zXz)f9TtlnE+ES&)o6r#0G8IHu9~1+4r+0CJ%6Tz zQ;wyPqnoy*lULlZ)47JjUDk8Ea*Bq2a5&ioIsMLcK1-_2=EeTko}v!--SuL`ql4`;#Z>`>>)j zsMSl>%(+I*V1gQu|A!dCDdGJY;dR%J= zeE@#w4~V2ci!d4?J47;M1B4pn5~MUlTts$6F5&|cIikJ5x?9q1(qRHpk{Lox#F~u?Ria)x=F)EB_+}2%@k0`W z8qi!b`;%5vi&sUw)9*ISbzzlM2bA->xA;{uLG)QlE;wFiu>ir2LZ={tz z)651}!I=-;Y&V`O^^DLKOx+ni;A!;z@PsVC%Mb`dUtRuo)9fTe`pLO1!Ny6D5TeK z(%%zt84(&`8c{Vpm)9X1D2^ojM+Qq;OdwTqT5emWK>RL*DK|38Dx51mG{MY&IVm=} zHfB2`Ai4njz2||MmI=LnwVtVQI)~oG$>hX9zuo@`;)G=v>8Ny%@9=Ff>cDz`2EC2& zl-7ibhPs~$3SAcs8__;_G&MT)KCvZ%F59 zNiPOH^QNiAIozfFvG@rVRtMHNW<1)FY-j3q5|{R#c1QoX9t$t&K!`nf{b=>hg zFwr5#CF>F4vGc6?u;}PxHjjq@gcrX!pf7YbL@b0>G+hKvw=sM@RxZJBLaOP)fPCdR4@ zPiQA>1JBU74{Y_FAGg{GB`U>~KvbT)cNyi;K} zQTF`&--#W8-&CzF?FrpO_q1LgCL>ntj&;XgCvmBHDLq8b&ChZ0mGH7~C$T!QYH{{C z7TM=NWqR+r%DY~eT*A!@KlTp~u$)nnfTCn~Zj4N!oTpF<}f?JEi-cJTN`u7FgxC~GxHd^G_LUR*`ts7pC#m@Cd~N+3C&W?FOlZQXY#)5tTIk;J+GV|WZfAdX92MJ9l003y@|9k)e zGP5xN00;miMFdsc0k3i(y;Ve)TdRbDAji9dC?LvTrBDSr^KBF%NQ!$-o*`4RHl(?7u8X-j zL3^^!|EZQubE>+0H|yu^+_0ak09OJo`CAFFBEZ8I4+VwKE5Me6{m;cBKv2{g@c$iV zhovYVlueP6V9m$+&m0t$Cb<7=robjkem)YrDiz^>|LJ#JVUFv6W~l%>F8BvZZK_lR z|L;nIq8I;J??2;%vcOPOj>;uSO8>KHfU|0VRsJ8=_^hlB>lHe8i`jg^tMz8;G|Va8 z-y0~(z?_Sfdz zY_Z*NxmXsJFw#$v^1E2B*~8%YdR*`jy-wBQm`Rf7!z462Y~8bva`%`QE3LLy1x~2~ z1Wg%V^1DCo_IkNCICi~UbzCz|({<57J|)^4&u^zL~(&WZ*uM9lv!6zml~U97~Z%k$iUoZgQT$3^4w=jwoH z(RJSTJ5=!OA)a~}rJk6JiHQXtChUkwj8@$j$H-{zRDw}S|B5uF@jgpeRh&|iam+P_nF)FOAnuCVtm_sYhhsK$7tq*! z9rN$~tXopduDQyf4Mwlo0Z5ql{TR7JAOr^wC@3f!Q?7%3&>2Wru=GV~o$r!Bq-C$G z&{7eWgSEgVx4avHuUS?3KDAo)YL6d(E}QN8D#Uese}8{GZ6BPEghcT5R)_sY%al^D zun-O&J8Q%)9HE@aJOAe`FyiLrnocb5vxZ)cZbxeTT#>kTkBCE9I1&jlqRyv>hlfb) z=dx^Bbuwu;pDJ)gIUsIDc*?A~1?*%dYt#@b*F6Uqg7dj1D52HI^Oa`b@IkIW6dYmy zQJOv-0i)BgjPJJJ&sT%iLq9bAt5c4Pg9|O98SBEe8pZkKW#{rWnTc ziMqZIslA71s1czs1W3RvfHXm12>X_EQVGJftqw(plVXn*0qL*iCn620Sjseb2RaU3 zAEfsH0UMZpf4*5-&MjwCDwjfF0AQcw`SFdl+N||AYPZ^HScy>)VPn>V=36e5io}}f zrxx#H#&*X5KzU~Spq89`z3iaVNXpC4jExa4{i=ugf|##$QOIL5xvfMXRykI=GpvX; z7FCX-X?_DsFAJQL+WxImDF{z^B4#M%bvnAfHzWU!?}shqppxI?oOrZxI^aMj)ZuNU zu3_~17UaMi@d7!jra&Z3^+6ed2uEh$o^FS0a{xHLH-j&j077!_sJ(4}eC~ZQtfT_) zuSL`X@_uTZiN-I&{IzlTdRiHY63uws4<^Q=aJ$}Yce~k!kxkF)4>}+yrrE92@A>{a z07q@zo!Tu+(dfjaau2eehbMmvC^IwOIoQfV+~a~wPi^X^^;89>Bnr%>B$<*}iNj}_ zrXJk61upn}xpolowq~B!E^NYh5Y0So;Isd{VbA|C$-HHMw^E@zA{RbZwR)=EaDB+e zuu2@JMY74;OiFnDwSbgV9}Ai?YCj>&nJy2j2usrQ>!K2Sq7yTP$pSI-AfkNUANvkk z4mwSx>pMXu$Yj#}dqktqXti6C1zx_5g*0RnOtCw@@v(gf@url;;9ZSb*18_&rE`O? zC8;zEd*08hY_lEgC*;@63h!=v49HB`*_! z39CmSSU+)c(F5swJ{y{l!*5fgFEK#l1}WjcC|XgZSvU+m!0>`ea~t+n8>W1XFj{at zTTsHhweiLgoonkfkk%*M-}%2+!-SE_(ygEq0oA{=U>WUT+=!lm0lWZ z_*H@_NdWV?yRc*Y9>aJg;BoV+^~Cgn!$))mJ}{m}K%Hup8iV69iOEqYCB52Z5OH#n zFGJsMe3#ct!zjF0pY<71MnIa(MaUsT|HdCBI5Sn@|2{Bi3JE=dsr-L^dvPL|a{*t9 zl(dKHf1Ug9e*Ry>C@M-7P08y2jT!NWzd=Lt9!Tl=zhUB6yaIxx|NqVZPkH`-D=!a}$`_4Nt5IZ)z%~Pj#Fjy=Eq0f$+Zm-q9hKNY#)c-vy1;gK?s$ftJn<~%G2N2=> z4NqzG`gm;f0qFnn_(%@FhQ@gqFZ}8I6T`k;p8rRH_g(#0CCW{H5roPg!1%9VNMwOz zinr6*0^ub8EDlE^N#F0clV3aeGnPpDD$oD*7>4hgjtFy*A(=!5+4rk;NOBN$wQc*6 zR~xO;ZNHBH7nBGP{m1n})TG87KdtD`_!~c-&h>mfYgbUdT&@Y5Y% zd*6u~8t!#^JlOSoxgO8vy6;Ey1%cad{Y!z!$jHEEv(e~qy^5mmew~-5zuIhXT%=(M z{4YWY*91OeEL#jtDGUgL;~G7Nc4q)d$lK50_w#M_@7N2)_AmGOc)oL8s#HBYJNx;% z@mrX0f;UVl!~2yK0pWjCI$R4`{6E_%*KVbIv|g^(tWu+u7qi`HNr``dx;Pk{nHd2t z+-oSQ#Fu^R9bB@e{hAtfx%c@ZXUvS<^LKMi5xH&ej>+KYScac z_boWuUXbM9Oe7o(y5e7V*6DeaqAtPed^+ne$D;G!`GfyK1b6c$JZFE;r@6dGMV}xB zP&h_MM;#veJ~iazrhnnhu+{i)q&e{|@%KK9VILOs#fx7b#lvp#mrFRFLisU;UHmU$>=Ui#6i+bQaQbu z+RSF9seZB^c-e$7h1OJFVpIi7BZb8PHmz)Z^%eznSc#jfCET?j7A+Xg;Jvmey52;8lqdDS8a5hJuBZ*%2t4F_K3^3d@yu0;Z zjebKfq5V`xj^vLWllDFxlbF!QibXyrhRgoljGy-?XIk>ZaBC$E|>G$H1f0{R`@?L zSgetCcE}>Kl^Kg%9#W*qR+8agXR($U2@S{Ocv5R$&OgZ(Jfx+vwYe%Q{xzIRh8C2| z#?)~&oRs9%HT5k<+T3QmM9G8I41m(r72$<*9qF`e1$v23Bk)$fI)e%X?Sa?$XMC2P05{LbaWS88g@$jJsUwy&R>p<(KdpMs#^L;qLJ%Zllwkt_}sYltkyDVvz4zxBa)_+^YVx1%?7ir z{U)qd#wr~csyrY^68+noY!;3-*`EpwkBQ|v4Del`ze+5w5q;GT)C}M-{BMUzGyFfF zS@zwWmwyLh;o4dNS88>+?KB9}OcW4_2^s94&X)l2um?B@-nQI!aQ!~-%(ETAUJe`O zqZQ>$@6JMzqlk=94$q`N*ouzBSgn0D8;_atX1r)+Ox?QCy2!_zp=VKBh|3 znI(>c`4*6#yMOkaxXzSd(DsVJQ+{1f*KI%a@3ZrOy-zaF9LDY@$#IOoBAYENR`|B)b1b5jpkg$s9irqGw0lD-@xD_{X3Bk>)SY;?&6zdJPBnCMe5=EP3YzN zvfcX9$+A<>vUx>7CYgT}1kdOGyk=e|lkrF35Xo;2gM!0kH2&^jWCFUo$m!?ng_(&C zu};WWL2T1?y;L^q)XDgA`jkh|1?C6@yGdA!TXy@k>Uh5Bj??8M?1nvMBwtkDd(Q|h z2&zkH+&`0$dO#ziv$GTKs)Jipp+wMh>D+@xQ~{>Jlki!zRIuN2YA#~u=Ra8UWz*^A zH&F^f*Lxk||GryPmM66hCaJiOEcE+DzdsLoKa&~EWxu%BTeHD@CO5(i&u5=U7}<(= z+P<6bbaza%`2@E&XqeBbb|%|wGJ+3WbbR*{ZkXmi>&^FpO`ik0SZ3o(`(>*~_l$W& z!MklYK>Cq4n&~f+sLC-zeS7+u13|!WaUqgm_1kZT>an8hraE4>Dgg0@Vu_N7Dk@n2 z@|!gJylkQSB%T_FvRGVk<6JA0&*wLIF1aycG@YVqTTK!T!ZlfxNkZ2$DD^em@|G(t zs0ToVNBj+s{u1&|CRh(ASpT@`*(s4uOCT0EvV8+VBTo5E%8cWPNF)o?cc}-G&lbvl zGo=@F9f!W3@0*{7)BZ5BIVGZEhZWw98bbPamN!uSm0Bm^gHpfI%C7=OR`26NmIs~8 zH=3!<6Xve*ND2mdB&0+hfkRFRp_XSs{6tX91l){7)-S3G7{%o^HKK)+ zLJ%{JpaX{(AT@08`P(h`xk{gZ<1)8L|AKx{jCRf9an6=NTVp!A#nV`%(eTdxvyMqC4m7} zrn4H7L#2vgL#3j|v-?$_g)!+SFyMdtuZdkL6f-nXHQF2s?pk+yk`5lWVK5=k z_rtFpFKgQm8ROOoP?EWLgycD3_m4>472%Y&-!iZTq9lwVevN7i0hnzIrKS%e`Wi$F zFrl)A%b*3v<9yp*-`xi@TlhBayy>gz3UH;mXi}ICCD$MPVzK^E+;fJ}NI3^o0#8VV z0%uFHBfe z_9~8oD3b_Q;B#xnUk7pgcHfrc+kpo_YTX0AKRzMfIgVp=K!^SwOr+Kr{;=r* zq!>=aGN@71XaE=lsZdm-L+JdBvkaC8Nl*i{M9}m3R{I388h(?!_K=3>GKF_2O#*tK z$#4hukc2gZ0W`e?0Vd{22!Id)ScHN2NO`*VAonE7<&p#_4zGIwqevJ#&gdxHKzR=bW(Ub4+AuPcfT9?fi5F(W>k#LFYJkfTPGTVYiB1+#-xZ zIeDL{gqtnUsqc>(X&-1ErJ~a05IB|204HI{t1+I1rxxIN!^;}HW zwrbI^obkWX4EFiSE=C!rloZAW0^$Z@<%UqeRewy4h6RWg&*T($&4Z#0WO<&11Sqh( zC3XEHW@{!`)L6Kb)EHFfw>1qy$9#dx4f~#)b~2ouR4^C~pS_57!*wWxz|wfrtimv+ zhrHnUcwOxKaXLmOL@R!atBe~_MLVv5Y#*i|alZ_8rpG>G%H5IecIBZtdRR`XAXmMD z#z9@sZ}3I8<+Uz(&SvYf%OB28-K=BUOg0M*`XYT;EzRD3)QmQcbIx=X#_~~ad1ZJx zg(soYx$t37#XwN+!vt}QT6n%!0w=^0IR|j^IwL|F;(GJUH3k^`EqN96Ab+K);=Uq3 z!DOGe3oJG)t=4VlZs-GMw-pBZx5)%Xgg8#fHBhE5Y%l|0GlQ}HNPnp|DI}*-LS&;a z%|E*;3%?Oo5@eZtl-)!I8$u4j<94^t9|SDN!K_zgCYsQM&1N#4(MAD8+V`bnhfyj& zt@l)r2pV_1ABluk*a==`wypuO-=i1um7EhRh#)!vJpnlke~*JuhXsIq-VG8rNfujm z-Lx~$uqIo@crlS9B1$mC#$n#97{;g(J>q~>Fc}d!Y*fvgClS37|Lgs!$b*^Rb&NEP zBs?IQI11Bf*!ymOsL_1JY@q+Q^rA?HSZ=(p&_NK%tg-oHn`FkmIId$nX=rJtmDye@ z!*YO;@gJi%082H1dA@W%0=Owjf4#pA^299KEe~Uw3l6LA|IJ*C!{GWJ*V3sUR6=_gk3g99OK5MB{i$o|I zHMo#)Va}svM+=~#{QeICN)%LJOl713WYrplK@kn@pX%D4?{{k&GVoo^*ZsnzN>XQ> z;yyM;FK+MG+lOiHo8v5dvkYFW!j@RbLW4R?s7rdC*`~Ltvoo1Qh9lMib1qR~Do00y z|J}X;l3GazdGpY6(qKJd^4U|=NdP#W!8@an>uzuik1^OM_8OjSezeN!tmv-(_dR;9 z_rDnPI=wD;t&wOnVCe2X;ByAA;dwY^LlY{(NuL1i%N2s|DT#R`eXzU3)e2?uRGD6K z!v4&dlAF8FD|#5iQ1U=K;snDH8)$9QY=S>Q3`JVjUA~ImWsAloV9R;!%H9lQ@~kU^T*ddROH7 z$1OZJBsX`?uXtF?+3%g9FP!mciA_2OvsvuZ*!cNxe`g#$#0fKM2Gk&^Y=|);#1aFf z1k;AO$8bsGwvX$Mvr@*^qHrWxL%^}@_wSFLpXvCJMs8RCiFs)2{%3N}VYWS*LW8n< z=x)n(Z;3%z2sOEjvD$$NU-pJOlLTv|CIF3A z%R%PPZg0SEc{ByLUPa&RHY2mlRne_tFp%Og{r>sdYW;IN8b+?SKDNJF-BHzfq1u^0 zx(`pLp9*Hc)xnLv+qPj|v=$4dT+k_vIG<=GweeZfFP4i2Iv7oTAA(l(&hraJeJ6#zqiZg}W~WM$_V zXOEJqEA|WL%cX%WO1A3XnpI@YS>bkq z#4Ei!BJG^BO{W>&>uK%}zEx|G;n8)v`QfRaY9w06%7?;2r{xw7DiDYL`TO;*RtnRE{dISo~W5{<&d?#Gw; ztpil5^tQzM@lR>NAsX$L=&i?WE;BcgjHfclK$hMwf0{XC+bith^>p>&z-YzWo2?h8 zD7By6ni-h7$E|_XF(ux=Py-@C9wN6g1b-364dK{E*NJ^MyGHdm*jAX3Ev^hI+JmD2 z9II)o)K+CnnKtLrXT!;?FIijJ|GZHSqgTbeIUq+|l0&Oa#0Ofa^^Qs!xlf2DA(P1v z5SHb;cmI};6N|QLrWIw`8iFW-i~Jy8ZV%otfw8wqRPS%c1HSC#oSbnDDV1w(sm^=t zK~V=hnOL9vg(_Ee+7=1p#@iyE@qb>y!^Aje{qOc)fjayx&f$3<5jJ8g2A{BHWaLkz zC{mSb?}}yb^8iCRI~$-85kSPn<-w@46<;n2eB=ol#47s=%w0 zi*O8#I`f2+2JR*pB5(pBWk&-70FaCUF(SqbY#pG*LZw%g2Nhy`SK1e5tD8-R;l z-h?^Hbpgji76c_77eWpu!1#CJKSz3oK?01Gac%SD@Z&s6U_u;i;erVEePoUo019wh3b;QJx% z98;dY?Z~@soy-zcvnzBCi~5oGdq)ljok{oNfq9RZ1l9KkaU0GD2Z$h_3Pw(VX@NK# zQop!I%&;u|od`YLLldN#uBm5bQ-~L-mxb4D3pjwk}OuxI358+73Z^s-=<+e-j4hgCS_t?i5q#ia=FW33ehOSBG zVr1ZpBAaYD$kfD(&=_3|@6+Ug3m+1f+m*)NavlJlo#St|K!HOTPw0|tupoSx=xJsf zaL^ZFW2zNo5?l9&nm8DOjoTv!yMiQ@8uN2wm7)#;3_~ zjKyY=O#UwNi$KTOuABKD=b6#X2uOT5CHuI0;>ApZ6#-(HI*Q7;7S#4@b^=Mb2TV2a z%gI4n1&n=Xul;q5xxdf}G)A)_oLA&{Pn1Z>_vAWVV+Sf@bz4 znKC8?IFkKkK5Zz8GtULCGZOvt(eubm)*S=jL@ft#c@a{tcN}hqqZv%~k|5U&#lB23 zhM#@8=tAWN5d9V~{HQP@g9Eibxi&21-0gQEc^p(V?w3j5XsT%zY{E2J#sA9%2re>? zt`{)%G!uvoH*gHMGBd6umx9d~9-ru{7RqwD;F03Gwt%9tvmM;$|816?+Dnb!0JZiR zI}IQvnjtW>gs?CdGNK9;{5isx=7!P7nDS>2X5O1_ph~uHKSGn?*X5VWR!U6{W*@a5F*SQ;1fe{mQ2*J$KY&3H$ASA9Nj^jy0qobbr zBq`m@#g>zS43h*zwW-~eDjHsJKVnWR8;q@UnD65uxT{`~w2uE;Kf7l=$O59J<&ir1c>+nyA zNFfY!A7DmB-O?yq`8Wke=l1iraFd+=9<2v#z$rJpsgz-g7p;^J;V_rfz=*0+O=a{r zyLJf1iv)~>q5n^Do*0^JB$1Uva3|&s7RNPvbdumdO-K>5VPFnG(R9dygoS?=kqTz> zK^7te1tpeWgbSW#ilfj(#YeBx;m74di#3F%r<6d~WRu-JE~Lbc8Grpd^O21=k{BBKI0!40yAhKBPk z!l~e=DM9ZPNq_L!V{ykyIBY1w<-QQ1wWTg^>w+3nb0fVSLUP(jN*-wet-{Ukb{-an zVa^Qw`yGNkKTi06G9Y?S=EU)1!p0>}f^eaFVN$~6OOZyEplCx7*xcH0d=0GrsAz`!qG%DICxbs!lEE&NTqq6GeX4I_zBEg*4G!<8 zg(_l47+hKt;JYO+DWvld*NNzSuSz`K@$btYGx*;6J*cbcoOPg?m8~ zGev)PGerp?34hYXl=!gb_Y>*?h`lK9IAh$601AQPilLCHYUcZAfT+A$=C z5D;*TVgYcxkS~`C8Ogs!T8WTPsv7bgxuF4UtOKT1O0$_z046coiMA&JDCqiLZ$jau zA3no`R9F6!?z>hc2Eq>CS%N&!mLbW!4$430zu8RF#lk%`MD6GteHt8~w3`$>3$SJ2 zK~VS&TLlOfD8Q|n21w^3j8kvfiDY3e=z*FlHHHpFMf#-pte?*{oMwhB+i0^~jVT&V zjDMU^d}mO1wizIULK0giBQ-#v!f~z6uOaxDY5QQVI+NGwV<6=2cP)fs+{7 zyfBr;KJmyhXzH8S4y_TG`Sl(mQzkNt7U)mGk?{(ovd;3I{L1H~7_371IBx#_Hgyq$ z<@f%OI)P~i1kb@Tydc%*9;>ulmM+Tk=ZXh!kq$Hx{}zEiNR$N(agjPJ-yJ)~Njd4Y zPg6OK0wo&aW26{NOn40!+yKGG0es*5km?DxCnfn!6;cE(3wOYgOLfukJf&GJ6-()_ zWqPF$NGlkI`GE~fYgj=igeXBdvdjW5r`$!so64TgpJo9UjSTd2APAPQ0YJ*kH0(5OI#kIXm*W_q1-l9#YsR3gecaYZ?=z9c6s>YxIR?d2wGG zvl&mHH_(F$Q*wc_j65xe?JZ4Yb$EX?t807+euff2ITouGNi~qmp-{Jtr74{3@!)76 zCkxIkuu+0q3xmgMV>MKv0xn}SlTyWw1EIaou}+@jad@S_Fv8$n*2%@PcAK%b_+V3; zlH+m>)G4EjD2D?DuL~)}l*jG|bu{{wcBV&Ls@*{wuc)zuf4CYTp_&Z_!G!p~^qd>N zG1>0w8Q%sE|5WcZ>8EO`_o+;yKQlhY6*U%864f7IhFEDcG{f$@?%6hU}_gVuce0=8-HZeQmO{ zv?|!9gUpLbA=Tz(LHrz8e#1`e$!y0vRC;*NnsWc8VU}H zeB263I2MJ%7#QG%@&8MWJ!voAo2iK)PIpc zR4|%M%<9D@jJ@aS^CQZE&A13BqfJew5b1gP`U0SRj)mYuDF!8$5>gfb3JD(2o)Rs5 z;$t4GM-3DU)=f~e0Mrx>;YxrWDg03g`H4@wCO%{xpMyy;fez4!cD3v~W0U`4FK15s|?Q!!J#(f*p?}A}YZ4^8sH*v&MDEBJVVn z$F|awd`1@2>aJ{dO;5)CayMJMEZfaLNv9L+;+(F%t5m&tXl`3h@!BR^;-)ioJ8UD4 zj`kNhhm$H_Q{EHBfbkR(`lQsB=>fsCN1~>>I-)7J?@kq5fbMgA9Q&ptvIR~cLi~v; z0;PahYl^8AfLoG8qH2>9B8jbwj>YkoYPS@{ahEDCLI#GP8KBv&#d^{{~F|Ej{_md7;}i5xDtw(_Md^2BiGg<@mJF{u?HX<)=5@{K{__ z78)iLY+8q|C?k+m84m&`Ar_a-H&(dZVCpmgSUe72yvIeS98vx;q~DteA83ySER4BO zUUkY?DsDK4dT}}$M$rG?-C|sad15YM@k6To8M||&3gtze>dK_gpGSrB;F*=1Y04}i zVfo2wPEO){|48$6BB+RrCbDQjU>1$qM(?ZU6^njGk`2@dc#dS=J!B=ycT2><+c=I+!x5eu+v_qJ;)7_4K7T zV-c97mxsp@{2OKmku(qEceo!*wdr#;?Va)KCElv77Vh&ErsKOlC$VYm&fOkkxofYr zh>q@mmJ?0b|6tM?T!#bg!2Q-r)a#nb%->Pp^5k-PjPDP%@iJG7T+$Kc70nEP9L^}& zuN`G+vhX?T2F6nUDn5zEgMla((?y0HX%>b0j|&RU8N&jQo5|+QTZA~mh|4zGufZ65 zVkPx_oM0l$^tp#sZ`l7KTft-Vx|7AWyI{>%Rdf2`9gInH3YL<06Bvr2C=7EyDscX_ z9d^h&&`9gLu2iJGZSd>d-R`T?Bx{*Df7{N*!-jJbzI-8b26Oipm=oabeNUOGv!sl@ zY#91XKxi3V(9hL0?d2GJPmH`IAH%*V7kOW5a}#z+lwHurS5x4u5dYxnSl+sw^o1w% z_rPfwvFA?oYtEWj&ZF8gyK4?>)$86k{PbDl%l#}m9z3b2yv(JevG$ERSBfnr7YNU8tok*>bmXoC}v|VH=&=Y)mE4-3TYoI8w9Apg7 zs|VG+mrNe~G~KS{PxK5FbGk$4aUP%}u z^+IHWNzgVz!Bz?-Rsv{Xzwsdb@t5K{fgVkjQj|QV!zK1i>HWZrWsHHZKsX`x1ZTNc zYzmnJy1e6tr@`mq3Ag_Tt~xP2S|C3yY||D~ou}(07X43}&)Xb-#|!>u?Zyb4o=Ix> zNR9I_Ovb;<2w&T0l=My)ecElUx>!fMU{>%y$(x1V(>dHPzn%XQ>jTUR2RG=TbczU- z2a83{Oh%`*?CkwSj9ZK)$F-S^lTAVNptuiCWmQKf(G6}KPp|tZ>$I^XIjQUADYB0C zhn9qlq=zWZ5zNkGJ6+33PVqrx#cZmyyu7|IOC7Z-Q(6@aJCy@6gZ53LOtDjj3OYHg z-EPti1I{*aN(H)T6*>MdXI;|>&5=MlMKbxrO*yr$-+r{-t4r=0-&Jg%Qxu2MxzTI5 zr8Kn6b+#k>46E?;#53ESecsJ#_e(IXrYu*^^2H;yFmz&`@2ZFJWH7i{?M{*=x!+cL zEcr`DXD!HiupBxYic@b_zc*&!46dHf)6y#F3@f>z@_AGumcxtPU|t@*#=Z7f_}z!8 zI4RsLOkTZ-b>DM{-!@1|rtuj5_S)%?_a;UH!h$3_hEKOOFln{d4vCKIEJ@wJOs zwhlfz51bA<^=I8ziD}%ehK&{2>O+$_9kyp2ei^3*$c{H%j*>v6WxgXfI8H(je>Bwib=9&3Qh8mEhg~{ZaP%dP6IR5=k4!#W zAeW|*QBz`1JPDMvo@oq7z%7dX=MhqPQlu`hOm_S2cBhjpyMJfZjnjn$7%UrJ4~67~ zj1xrx!8=OXtv+70lJ@iYhYrOAZWqs;lU%arC^ZM*QSq&oU-EC5%~{PhNNkZw8Xq%B!8_AwNrTiv8HEVlCmp`J(q<~<(29SqBX&}V(xcD?I=X8zO*`kS3&k5O`d zqO*GYdW?E|quDB=URVFNm2gt}fm>1Jv);8P-C9RlBSLmFmT`el=Py_&O)FR$j{@S( zLJ72RlDB&sr_3dhf{RDw%J9?K=4(= zMN~yv643l*3o4=6T5g`Q5TL2$;ykXk7h#@#l9B>U!?tUT<#9KvmZ!5 zMe3+yFjK%lwrHe&8pHaj!AdAxYhMMa5BiD-o=#95Rld~xBO5fvmc36m9<1b+E> z`AF(6YFt9aoG*r#;Ax}6_DVok&`$4?z#yRFgBV(Q#Dk|aV3`B?pP&T1sNhL(ppI>CT z^!w&UQ|7$;oJB7%m4>z>CMG7e`lx}aCyR3;f9wuNAOT7tZu~rEk_Q;|7=8Gka;)&W zU&&3bH(PUpH1d6MnA zZmA;|9Y+7Q>3$I7E!rl7!qTwR+h96@MyJ#E%TxR9!1(<-Y;1PB!)yBXKc97eU)EPa zavb;NH&9>7-rd;Vn|Rrou?LiZh?9v!b- zI#>w72Mg}*9tQW|Zo!=dcXtc!Zb1Se$lw+<5PZb=)`mL@+7V4VN0Q|Dc`T_hC-crC6fC4T=b2srBpU3r;{6B$v;1QGD{eX0PgLmvb6 zzsv7>=uEQ10j^)*Z|UY`f1LDRtFH#;J7vk}?dDVj__FkHdp9|fBd_>WY1Ep!;kUqz zm}FRx-m9&_hvHuO?WTPA`?RS*=>`Lo>A{*{fr3A{n&m=>3}G$zAS-ybL|bbmcH(6zcQaAzMsc1&Q#TE z698M_ys&wA6zlu0Amd2=P6=u{6VX*{Do_4+oH{GMd3eg`qbXrJbBW&TMrI9%DQKxP z%Z;pm_S#wf)!6%Z1o&fp?zf{P9uG?cgTAEmE}s7a;GZF>e}Xao%dW zoM*(jet3NSqvv`{^wnAT8+Vd+d5;ZjOrJ(gT<7oFh`wA5; zM^x0k5NZbZA-9Og6M*>?NPPG+p23PIa>Cgg1_Z7gahEk3YE(iCH_BB=y{FdQCteE) z2>}-M<|{E^=TR~b9nJZXs+*%>Ke0yYyIOB3R64Ec7uL37PN{!gahzu?M*mOqCTmZT zmX)N<56BQVLm}2kZNes+(7d+v&(6;~w)j&yY1|SR^!|y}giNB%`t!=~>->=q%dh>= zpG7Wt2FTp5;Q=IU1$?)=+d(3UBa<^P=6&v=t?s%9lT=UlTW53!?`GZ#SHEdI78d0T zSb>w*Gp?;&7G7Wb{N;YQJbuJ85xE`8GdwZ+bN|ILF4ND0@%x!Tz~xCyw>*v=pF<+o z>PX?L%|(8DtB1P{HYc*03!igPh=}tN=|&H{fdVK`?F|5tz0tTQ@UO&sTEL6kFX_C9B1sbA-hH0G2I#Ei)O-(Q7Kc^SR6B$g$Ml`^aJVg%59eg_{%{FE|{&c584Bt8u(vV&7!>o)~UVT87NU)=#lSfEQnP?s6N zm;;r7s?0pB>kHn0*~0WD*Gt~?yt)>>yvplN#n&^#7&gOWGzUjU0G?b}3M#l; zxv?`96D;&cbl+wDN81zFvSQ});C!XizhA54hHUY#&5XnI(v%0D)f!!QLTef-wUC=6 z|A+tjsUXPRm`ld?MCVl@*0tjk$(OYGofh_Zd)GH=-S*F72ZEdy6pMG1Y|le$?(pL2 z7nc9^L+5qt+xJf$GbM6M9;c1Hlju3%9D2e0YL9graiX-t6gX zE`R;gGND4l&1B~3XWW-=9b6tCEHqHFnCUXsbl&C2BQe;V;jQKiuzBzHqzxASZwm(b z@I5o%PfJ9#)9(Ui{aQG?>$n3Ao_(rPkw7IOaf9MU#{)SajmhlxD(5_RCYK!OGj=S0$hBExJq>dR2AW|lcC)nXL5O;t zxV4rei6gIE>*UQMQ>9)TkNx^*fWbE2{D8Xaw$>%sWzMapqBZlb2`OR(L4i{((riJ8J4p-Q@YQhT~l8 zI(g|r{jnM5);N)|l$>hdwpBK5s|m>HPhEyIi$l@zX`1QtEE%cg?tna?wSU^la zjFD5Annz29j*}I11RX=Wy=@m7R@;=q;4YR@XG^E3K%+UzhU@OWa}gxv|B(?V)&`c1 zx!U%p@;Uy;lp%k!RQ|Uao}4!n=`APyTXrf1%qjLJXBEzV2D^rpRt;*?o%nuZSO?_E z{y!GJTeQd0w6aw+_Fg##Klt#+Y=;xKgMnr^PEa0AHO2g<`5xZXM8-kcH~iSXI?Kl> zgoCDlZYrwp?8N)c`X!CN7!v{>!1lI59WWpp2KFPL>}HXiSRwv$rIalQ1?Eb+x))n) z2Ul8$yZgBq(2pxmlS7q-%^UBi*4}MEchrbIta!U%42d3%SzSp9CfGvaj~7jN8|MQi z9Mtsc6p16aT2?U|z(*M&DOI}Skpp$BRN7$ZlO?r68a_AQMWju;=m{sZM;IqJJrojx z0yN=mH?WDi`MDRn6)$Ny?vC9b!P?{1ecX^r%ZWo2Qg#OK%xRGwIkZI2({)@~f)@$k zv<%`q@t+6?AjC&ADfm*aI740IvX;v z6!F`_#yX1f2gZ7|Sg8oc1QkPh*7#=S@5tDrqWTdr`G@gkCK&jsS@CMS%m#7O3`jQq zgO9kSe>d9n&hyVIKb+r*=^Ykk?spH^HeBY|xY=gB6TBL#@4M4@kGwAa*!1fJuVp@P z(o-m!wum-5)D%DBl6Fwxt}Y8i=ChG*=EqB&Q6oys>+D3qgalq?DWgB(;V-Gq7{_F# zGN=0Bpp>$^7At=0JCvwa*B)agg=)O=MdbIo!CMK_<=bbhui}q~&hM{1i$7T8o+B0h zw4JOL*DB4wdc-m1y-z=%yw)+xgfgAJ`|5nZKWW+i&XEPV7omt)g6tFiw7=1XaI9{I zd!`(1>Z)}Aj(5zcioHLtx~S%5&lV(tfKvaLbWKclhKcK;fnO$hdED`8IxM!S6_$D1J>V}2vjuBkn0G~|6&^-#$CW+Tv2A&ZDV-xZ!T zmG}2VU`FKc?=q3`e@xCXz~tDU8ZX)6a#wgu;-4AA#qFm#kFKo2K zu)W@|;~@E@|2$Oub$P8lZX@py-`I?XRiS`xE0V>8>`uf{u2_%1j)cBn zp(6}+G0&aSt5@_`y_6ef8t}I7`uU{16kPvSbFWT{^#`l**qYADNu1QsTZFlGdx;Te z;iHMnkcphyDm3ADN731WvYELM|Edx=V}$-zR9$tEcN-40{R}mBAm=GHVS!tG3!@6f zb!Y{*!$V;y$|E=E!X)JK)N$S4=$fSKP44qj+e(3a!mX9{>CEJsX>H~;>fx6F$KAcf z<<`n!j;~hE56q6oOJV$f^=$_u(Zsdlj7LjM#2`eHsE=@iWy=ipaF-X;CFxQ@D%3>%V^fa(cICMj>LH z6J2EPA)lI1PnpUT;d=F@UD{lVlUy~cwKj^#nf%vBX7^@N2R4?9wX)omp54lBI7Zd7 zxiW$lSsn3tbEbdiUZt>v3yW~$pqlkvB6qaRk|qfp{nc(C3E1c`KvFI^ywWT_VW&(; zU8V^6%|w@fsxh)AB3squ-(yJr&rFYgO3e%!UPx#>r z%y4`~$Mj)UWVP2q+aw;r_L3;O1Fniu#Mk{$E^-pRZ!+UbS?<^>)*eU3eHy}o)xKA4 zB&NemSH#A}gqpAYGN)c&>G$^%^`?WE|{b&idxFzZlRYIE1W$oHT5!&(D zLq%|x#WvO-WXdDOotEr>2!LStZxM0iy+Lr7jP&;yUW6#z2jQCUh zaR4w}A+VW|CL#0z2Q*wc10xCn{>XSrq2w33|Ge3$qV8=AL2!H zg1{i>Y9Td5i%AtLe^j%D$s0ipRg}`g4~0x?4$Hi0QX6294vwG|r0K#}eJiFXGwqy^ z`dRjMNr9pqAr_;KoD{>ES1Cw)4OOzVB@JU&A+BU`tZHZ=AT~6XjIEhMo10QGW-v^O z#uz)dQK}MQ2&B^aS_P{bF$!@&(I7Q9{cA5**L=uVc zzL?_5;I&esJF=m-km^jA7v@S*2`yo{q7iir>~b8?7`jF3J~;wCL(S@P#A=oHwV|TR z^dA-hR7+`wa|}WqH1aHMtgGD2FDS^0Lifr=T{T7drBmY$Y-V!FP>7?9ahp)`mx&#U zwH17%FIzjKY^QShU=N3-Nzuazm&V60D7B>31h-LUYU_X|;KAMM zCk7(0B60xh{P~}!a|rm=@0YxG_)ex?i#mZw4}hf#mEfTu8@q`LaMm{LL4E*`*x#$H zuUjG9@xM3!{(hCCY=|Vb0K#BK-QM#&B*N6@7qytW-1$Z*N9Q#o9^&yVT2CZ+xeQW_ zA=kV^A z!eZ?Vatkw33W+g>zt8)}Q14k;GIlAbhUsHEiZ|)HK+qWS3CtN|CxSIV0o%azjCuF; zTQLl>C`xg^6^7TzM;K1sqgAQqo6GM!j&FN^u`P)ufMR*}5Kara1nxHs6H?$y%heA? zi_rfIX4QSZO!{#1t&D3DOYkDnF%oE(ToJYa9mW?xmqT#cTaqzlX~OePX+{M!I?L~; z1U7fUq%_w`q-grY`P7&x+bkk^gJEdH;aATO*N6oGg@2u6C7yXwjOK!>vTe@2Us&Sj zIDWasL|j%u_=CdkG!%zGHl-5c!|Vp_!ZI+zff0>P`6*f*f+VOyA9*5p%_iRZR_tpj zIf?blfZ<&=Vb>fHyUOmmalMsrjnBM#KgmAlHKZ$G_(I(uj88NMVKEO){0!fqzu3n< z&t+VcAQCF83+m&TXh}tF;SXXdA+edSaorT*zS2(*8Tdc^G6>i{btCw%7{^c}$y0*4 z_!R~ai#NUm@L2TqB7=)Q!mR2B2?=}=s@fbDG5P69LCU?7py;8IPD#3C^>B&@cgWYMA6Ohc_-t~WpBT1<+ABGoj$cqE$;h4I!;Ne`MAf&ZO_@FY zG(*n{;aQ{ia)BzcV%4>XHR0NXTo#kLEy^>qAaTNeH4DlE23ODXs=sXt&nV+j^wAFw zC8&uf1xbzggl8hG)wRq52X220VtFML-XSVnmufQ+GE>=i^bGCT&@nuNto8=HFXkyo zk5dE*U^Fx>T3F`Wc|KO7is5q zmsVpb5T|7jZ{%@9cVZ*O1V7?_3qa)#8>xg7KqSPhzn3cDiHt3^I~x@R-8o+VMP@%DLf?_%Xf`2}&Wd~=+_GAU{g-clD5^!j?R36hKPqXFDyPl$ z{*+|Oo6wQm0G}dQ3dD*$uun*aQXdY9W1ajNbUh_7>G%(;7ivqEWuxeik$VX}>t9%Q z+e#TgD$X19eMrI56fJMLl&uvFdpS%0E$vf!H9o#RGd+4%mOGZP8 zS(toA(W^+yYl4sT!z+`7*SqdG$Mj`$IZzEW<+^H=iQx516tpN`TKWelOHS0_7Csc^ zY2GD*Hax>Qu_hQj8`2&E1WHWHr}2SJ{Fu7aCX_MU?qQAb^kj&f%_@Yh#{i_>wh;PV z+iENv#H!a|6=Y)3;)xf;7`MKfmBTpPg*VkSo8xSMW*5w$U``#H@+o~U5L@t|Sbh~N zbD+iWvY=&29vY)9I+$z8;2`O*f&GRorL~vom=$}(Kp`cQ7TT2&dk|jv@wedTih%^( z+ci|(k_AFGRBh!qrt7q$YPvt!MyR{#D`igARDR#$qc~Mv)_v{<5}D@J^nJ@#_t>3& zAfqq{(bWKgKhG&zvO3S2ZU(+xW^PPM`dVH@~K0jGAT(vf&CS-Ru_@>HtuD5D1lxu+MJ;ni;ijqby|M($;o1{2YnH-$y zFl$g|Ug}!oR{vasMp%xBfV^wQ^iC=QpW7pOw{NY}_vTsI$r?~1^ENaY!GqK*>dD-c ztfe&}vJMD+2-@`MmlIG#!U8y=`$p&4>-_|wo`LY}r|0p383`5oFlMNc6vJLz6CtYE zDf)=2G{aSqK`mfP3r0Y@e4UIUS!P!zEhu4)GN|SKVgec?&!R*Yl(@)g^Hb$PN0Yf@ z-TMV(uHFuaXhD79oFsDAIjR74dLE^k9*!!zz8ra#hLxz5CLMBWccy5#1DsBWaZot)uM-Z=!`iC2@?7pI_`Ps7bU%>qJ zUw~WM=-)qgUxk`fUnTxT*++P``Fj1e=5w%T;FjfdzK}{L+crLxKu}W+Yz%$%Jzbp1 zsXWU9nAZX#e>p#5yFhD`l1C!+QH>#uHK5BYB~OiP#7y$i!{H+hE;#P`V%fS2IlH@c zjgBx<1XhNy3_9OnRW14gF^%NjRb7eBMx%3 zj9QVdMi+kg%{70xp{KiRfaTVQfqc9i~h#3 zX_QQhUBOLj%ikFnhcp9U6Os?LOv&3tn5AY~o(P;Wxmh zXb1`=cR&1nRNL6z;u?mPo|9@3KeR?HyL(HD$A`wWw!wi?++#k7mc!KQ*{9M()F5bh zt~RkiB4O0-WRJXlp+r43(~Fc;Zz=}-1uY=d=S2pW9*q-_;1$aD&GI@OU&vNjND%Pb z#MGc3W!Ai0l`)q_t4h9iKZFh=YNo*gwXP2bEL$#JXERTevU0I%SFBJF6W9PLvy3Vw)}o3X)fuMf7k4m$CNA^upu1KmnKi7L^{xn}R-0U#B!*G+usV;Igg0 zA=D$N7t@T+i3zBGv$Ardatu!U^ayacv!X?qZd^qwUazW)1Y>PiTCBNy%!JlMl{+mg z!}}RhCkf1zfQS&6eOSrQ9!YY_lAW1K^>FSmY=nKFW5_7nJ?^!`s#tETvMl23 z?X-Wq#vAIE*6+cEuCzpUx_FyGcOUoWD+aECJjZc#t{lrd5h;YL^_mcoSMf8nwau+f7#r0VDpZ(`|=# zLb0(hVCQFctDh49yQa{sb{OYD?+U+YPC9On#$k@Tqn6^pn<{fKSmDd}#4KWTPee%v z2S7&O>vvptPRrKc$$8w_9ylY0lB3HBHn{VA&bkiZG~CAtW@PVIt{LrR#2;iasr!G8 z)xj>hEa1KsU-dialVkX}QN2(!`czb=+Erf+=wnLAylR(9Q+7$5UC+^#II8xMd+$pZji)<@X0HnUPv#~dvFu@I@2?mmse-XZA8*a|59+N}VDj`M% zLXsvNO-=Hp5OBdJ$Xp^PBnUN?=OhFL6O1Co$nM*trt=X-KBLUJOTN7I!4M}v(ktk` z+{O{cjwEZ`iXN2bCJ(`2mKIH%q38LDZnMgf%B6L%R0HY#qm858gSLj2P9?17ThzrB zI5MWVSGszj6_7(_))G=cnf7_ok|&f#+SR89UJlABb#`2m;Z4!lB0^^J2=X+sANs{} zgjIz<@{yk24O(=(!8?=ZaI595RJ_Erm-+i`wwcj&iRxjDyj+>4e*^g~jCmeP1CmyU zI7xR7al|q4bG9fPe$%;R8|c<5=FKHv?_jF^$b^GgpplhV@%UffDI!{dV39P->n)nB z-7p4K((7HPoM21>1Tcj(cUY`Wb$2yK&QWYm?2-B$#*;olOc=`Sxoj6HOR`i4xV=Ki#~)dN^06m zPO?KKQF&tfhv+Pc3*eyQkc(KBsnBxNj50!cZXOU5u6ln6c_?cU=#)Z&1{95!OiY@S z`&1tqYxLqs@4q;~A&R~e3n*7z_S=iF=4fmMkPjUuGDTmc-Vn1E%(h&HGL99AWzN!;ALhA?8K^NlA0`e!UoJGtm8vHcHZ2;(r6f45Lg8N4JP_x1kEBP zH{_F;K;=cL*bKFz|FUtFY7n`)i=y|Ss+_|eb|FKbWZ#91$gA1lmGl>Y@yXo~Vpa)g ziwM6^W3tR1D_hn8OBPj-EnL^RRY1Re5Wynyh-#Wx8nR3<0(5sEe+n*YwLmMe2cBK? zkKWQ#k13)ID*rExH}>(0N&1ANf`rXH8!2`RqbP=lC$pr;Vh>3aAO9zcTph$;Fy(W} zfwnB(qxOIGE9RqaGA~4;zoHL81z$!nrlc2>yhdT$CP6JIyu>$H99RGV@J&imR2cvOIR$<$fd&P>=N@x+0RRYkmLejGQX(Qm ziofj4Ep5yI05_1z6bnUFndV?mb3^EOM>MjdOr>8_TKR#*!+yjxME*oXLZbfrw4h)i zWJIC9(2+z`O312cAX2{oU^lk+dzozlU2Q(L8W*P)i~5}&58j?_)*ynL$C2W1eINku z&t4((Rjczw_NH@iI{;`VRH84KJ$C`)4>eR&u#toAhO0S%%d3^}GpoAP8O^%Hi}sj_ zWz1ng>xrQPENOt1!_HohDe5~7noYiSle;5OiyeW2dk z8${9T*D;6}l@k(c^85Uh^Q&Giffex!fGP?UVDYkKjteEI2cMWd)6Gsmg_)iLaGLzG zUSoRus5Epk!E%)f+uAWCvjS{0WM-aU3$~hp+B+TX@8_QH@0Z{K26zD3uld6M!ai@p zaDGB8Uk2S@6)ys$NU@x;J&a&2@csxfgj={Tk&1CYwll$~iLsOW!ouTUVJhMHs71&V zSRGktrrkN3-p&hRuVHnO*C%;(ymsF~KpXwX`!Y$I@=J}gc4^}GmE-@aGk?~(9(e3? zpkvdQ8QdyLt5&I=C}pYZsBA5f&F9Y)Eg1bZTQHfmU^8U=!;#N%$fCr~#^T6^STETy zQTM%5*WzQOXvt;3cIY#qe=&)aQrSWs(eU8ytFw$F;BU;WhGfA zRV7Q^k`;%Of{}Qcz2i76fa=J>N^`Dn-{cdmQDu_-^1ITj6?9Yhv~MqeVK*#3`tNR? z&Os`ylbK+WPvaL@4o*x6eWQ!>;RB@RBxIrZO7}qeb4IK7vbNT0Dj`#&O4HXl))}ok z-g@E2%} zy1#qlvl($vbBOUg{KVl<;m3U$+NWDu>umjW<+>w=Q@=73nEAc@!P)h^tukRTPVQG2 zz|eA#i9TO8ayni8VNHF8flG@klkr=paI4CW=bf%wr1|crt9|vc=QZL+PK5x6&%=cU zp&NldZ$7s+|0VYgCzs#7gDPQ3-mSQ-*lu_)?aUy9T!31oIMTnBpf6cAgFLavSWV+qlU-2}Mpmcf zBy|7w{kHmj=KBc39$KXTqn}KwWs6myDA|=-lQq1O>MR=5{*shQnBDep?=Hfgt6dd& zhXP*rLV{|Fmq6jZi-VPxwxx%Z_-EF{L}L4_*0JZ*3I&&RE2#UtyTntrapv z*0r>?W}aZ~aRLd~6=xb=Bkx~-?@mq>?PLsuzA7ztz%HjBAl-v|W-@l<*FP|q#52X& z^kJiwVlHBQJlO7Wc;dLQnVsFW&4bO&tzGsf=bGgl)voG}P%-?sc)Vv`sJcdK+^#Km z9G{eTQp(5KY3j;Z%XJJSmTJxlaUn8RbS$?}nhHJH!rt%hHVEe&SsXRR`~`cjARtFRQSX=4P`~R zmG?z9NGDu_;Z?s*>8~n=dY<}0@q)?rHr{@Y+mLH#xcfd zRtFX~b`{2>y4)JhI^E{Z#`5rtT%G_Z zzu~Tu%&P3y`cIHil-3$P@yc3}gZgR28%x-1!u@#7^|{;(Vc1zEeT> z%PqKm4)ixJ9CD~ms7bbAlzNgB3Y!WqPPi%Ia^sQ`7Fg>$HS$U z$!{!IdmlUR!T#rcp(G*33n-V$`F|(t!fvO+afea|un za&x3Q-3&DxVijVyi>EIcg%mvz#qWj9amZwQE4{n7nlDg7hGj!wpRlMuBoy5H~6B4f~gt8>H;9ie0dcSJ$m7neRqV8B3LJ|4!_9+s`b1YM%eRmGOPm# z;28qDMSGBMLj^_YjA3HFO@lBH+9Bj%Z-I29`CwD~!;3s3$D(o~vm%qgR3kN^Dxn4; z$)U)gY!PqrTew#R?1PT}j5qkB|L4xs+>~L&c?633o?2gJRf%3DNC{OLb53%$Be${W zLl{$DLD*o7Xqs^lYd~~xe$1xdt512-YU1_Gi#&sR4cYSof(OAkntrNWw`@Id9hFzC zBioDlUGkIKPr6r;7~jZzhb@kN)``i&!2u?4Akwr`wa%#~vb>@-Gq@uZG=rpccW3ZH z22L7vtl)cp*@u#^h7_L+)HE1)`U%WZQOVjm(>C-XxiIpkq2}HU?hE*C%`nyV` z3f&6&vf661YMsF*jw069=HsT(W)^2!{;G@UOQs9-%VKaMFo-#z6JhG0)nOK3WT0chGQ+Zw?@%a_?F3g{6Rs2X<4_Xx zDL*tVH|`~J|s10my4WgwkW8NAeN=W|hMk_DeSijG-uRH8KEI7<8tbA%Vr(Mop0!8GPERKx0V6xPd{HAQ4#7z)$c6fwUD0ggd zoVo8}LUd$R)MlDrWFFLO_Z5-v9tM38y5$iU}LD3HX{>wnb zp7riDW()B#o#}U4n!fL_n0gqv$aaY%$&tyo@lA0|v1)M%iASorY6BYU?JZ80;+CTB zf(NCiCXKca`cataR}D>0q0X)Me;&Sl)BR==H5TbWu{HTTflqf!w`Fixi_qA+QoA1D6#GUo8Re(wHqp6~AbWIgun{Usu3Ww4Dr#OwimN{w})CA~#^ z!9)1m)I@FW0pp0h{}B%VF6PQP<57_}>zu|N<6hS!^c$3CEjKq8`*WFRzFC-(<*Dgq?uEXMDT==lABO*0`?0TRP7-(_t$Phw4MmqnPBJq;8VO#>W`MGDJCq zqiEe|^%%RXADO3L#rm&$D%+me+#-#0Uv_tQ-?$>AK*T6+T$z}IJ%o?3hXd2CvuoQ^ zk}t8_xvh_L9R3uy&0@DhS*B&xHrHp5VzfOgDlC!FV+W!OYO3s{CQyc3|DMK|*~)Nh%L0Xc%7aeS9n)jPBk94>s*d@KF>#8=LNMCJ(sj6>Kt;tEb{bZCYDlB{X|G-z_yrHDw7J)K)&&u(d)I1OoKro#A5Th zUH^XCu%OJ{zZoW6B7bhJH=pdwqmb-#==FzqMPov}1^#TF+*Hspn%i3$`O~EdSa+MtCxsoY{XFPu0yDOW9{>Z1?BF<; zc(K<|yY<&W9I3=egUyOE>at9DL_|z9myUeRkxBbICgyuUu4ekB*|J@#3^ z1R3&S5UJ8>WUbkC>p5P#veRZ>RHkj`CzS)se79ne z17k%=L2$u12nw1l8*hs-{`a(sO;L)yQ`>b@g2VKgI5SJP5b>N~4Oap4R>_I_s=DI&m)z$O6D&*94N?(Xmt4Sqi)b&C2=9c8%^ zIPCBAhZxxRLOj;*tEi|rbBf6a4H?uoYAgk9Vr!AnA3XMiCN678!IFQr2VeDA(Dbe7 z$g7|nVK83fAAu1~oT7^Nm|+zCe!V9)k&vCLvsat~U18{YCV8QdOE)z&mCXB{L`*K) zN#0SF6B;~ZkP7997Ng1F^QV<#)2&}=mS8tFB-!V6E{8R$yB__hB7+f_+bD3H>iMZT zL!kV0MCH5CE^oXvLENG6wG~4qv2i;U2;WqM*L7Rsjv!=8-+YCjE0uE95zgfb0rbGWT%k;lHINfRI#PJUvjQ_#I?i5S@KX@3Zhk*AQ zcD%yf_=imS%l|;-|1bCd2&OQP9T4!Yy1%>uJ54q#yLE*?2 z^+=KTw|WZLCGT{FR((;{(Efim%^;98MJH#&24v>4S3OBlW{JLopIg}brZK(zUU|N;v`Mb^-LMt+i6Cl|9HB^v4iBx}J`o&_Il3Ug zPW2t_j5GSZAw@KZ#DV5dq{zH$q%8G~CB})a{E5Cx;&X)=Ea?C!jyoP-)i|l>)NOd4 z1Sz_6cI4EXsV1aXMAUs8Inw^YkLHy9-|R@WK`!lX75m0~kl0+(VR)oM5bE{`ZaR`Semc1QE7Q8}ox3Y4#dMn|)2 zipGHZ+x=vq732Q3A39|p-jPjgTGrt@PU9=9l-35iVn~P`KLtH4oj!qev1H%_%)qmz zpKGQ|g6b~yA@lqS#%V-f2P3aYrrSoO)#}pmyl@~VXjy+^p2L=bR2B-6z%(QQm6w{0 zE$Ity1+B1Fqs*Y&+r3hQ{GNHjbbeF`G7nxx`d)#j5JT-XJ;(Ie>}~c_WrP#9u*#NM z?FY!l$=@aTUsz30KLlfG%B{)YQO!e z@I2EtL#DIRzfh`^OxS*MhKvf&;H0Ewi33rb^3fGY0qA(dD-F7{FIvxlncm@kcmH?3 zM2U3MHzhGSSzMe@BBZo4W@vMH^h}h-lGw_o%Ls6q zOG=zuo_5|#LqJX944z$<$J?A4Xl3n|nZC1DhsLfsb`Lj`y8}7~2oa4y>-!0-hrC`6 zQntMACSwFXm-EFURQRap60{qw2H!3ll#!MC)iAHJ%g58%tXmptsDd;+y+2=$W5 zTsPg%>Bn)0(0WarYrUL+D{i!+I6SoKtVZCh|LwfK^eluoJ^bYLY18v+l4C2A#X|mSv-2fg0m#+A>wug~{c2f@6pz>W zP&^BiqGmfvBC!KYXqZN)*N&gv0>Gv^LwC~o|g?3f#BHty2qJ*A^Vcl zooBDtV0@f7ocO^GBu8_;ZBj}-DmD0ut=tD8Qmku7#~eWgqB~SITX2!l*Uuk)!9|r6QAx3yx|aSG6AEfG&Pg6|`j@m3)0%`Q*6m z!XQOm)!x(+oTIu#VR>FRfHgxkK(uJgOMkdZkD(|ONYOi&$~>r?+N6}J3o)&SA9ccQ zSf%Uy?ip&cAD_PRBD$)kcMgZ@m$A<@B7y-0+eL41k6rjMQVOZq(!?{y=}I|x$HIzu z-}EqKW5VNa@#Taj_%m3L4$s!Ao5vguMq&)*gY*02VW}nG3x4Oa{fa`sbR<@D(3aNM zN;fBT?_bc*vxJ|sui8M$KO<3vTQ%3bizg-tH5JOt^>Ry7)zU|)C5wSFN2xquu?%on zEV-U-tSPa~DFhVCs-EkfXD<+aoX)S#B}&_u3XqpTz*zl}VS|+^K%l4z;*y&|nw+JQ zBLx_bi0L79Oq{g^RK92l!C}z?+4{sWX4i!y43Wt^vlo7n$t|Uo73KIAtzN^ASJXnslDANO-%IA#_W0uS>l0|QzWD5?C{T0^*t$#IbOd-T4kFA$#A zedF%9fF(0%q7Ic6l zPVd7ccArKQS+D>Gqvk#z{CgkA5Q?V*S`Jl1+R27#U`j3pOj6^ksi=AO#>3fC%!c~Q z)K!v(KK4#H9>u;&DCXc{;GdnNJQ}foQM9%_S9JvvJai+HaI@ zlvGqfosT-$#TGYC7Y7UoVu=bf4$Sepm7aHz+8CjcW@|BlNTsG1^pdwZK-R0gSA3WVyc;j&lavxPb{84S5P(4%-6dTeeds@& z>C6XC;(*>gyoh^AXz(pzvd2DCGCjIrmV9anv?Z(C$Y>2DLht7tAm!VdeE^MC-+4CO z7oxv9zM~5rjKGAlRYjz0-?~uWVzpwf(`M7JJxR!=APA9kH6%W$pv2)vjzfaKLHfG} z)r^>G=!TPit1XC_>NZ5uK06j{Cx=g2FqcO$@@ty!37(KYa|Do6HoM4(?So-Rnxdia zegG`Z2fz7j`$07nh=zK-Ki|9-XNTjoJ6OU+c+1-Hekb0kkyUQiYtITF;;|e}5 z-9`T<*`gg0gVVs{q;RfSVYncYKhX zSH?c&{XU73pd`Pz9ca%97d*!ZAky^rfF(vo_e0jnr-JOI;WvDDVALc_zG)JnwHe!~ zUJ{|VSSytva5o(cM?dEsw3Q>iV?wV5c>c-sx*Y{q25@@cD$}^@Z&ch>ob>Y`RB_91jGW$(W2co@pw7v zd<(R@dTHT9+70h0UPw=9)U^k3c%UL#_-=hZH7f=*@CfkYi5kVd1}a)+xTr3bzp`1n z$L&BiE06NXTZ+m-S9oQ%KZ7-4UqnJ&SuJ1frrPF1zZ;O21kthtlt9B{_Z5J8jBpF% zgEJ%q5Ca){?!O7Yji9n8GxEsn?KN*mAfyZdg-PskI`@rI%ekV8)_p#;N9uhr7(~LD9$Lt)5ZFa$s^hGw=oq)6q||0$1#|7nRG$4J z`HgS^C>GX$d;M+#sgi0?jRs0-W?8`sV>Os0=myq~HHFT`E&sL<{z32i{+#d+p_v{^ zrX4#M_^k#@RMV@jx69+%0-vY$ts4l!)$cA0b~D$gU9IW4mv>qmeQd=bu?nNLmffD@Soc(<4x7`#Y)^6LUTW_ z+C9`!T|GRD^xU_Et%oCAzOA&2+i!LRmt-@T3;sg^`x z8yUA0T(NUxdzieya`gUT&7NXl7~fcBj)OWjM9e_DyojO@CF3n_S_E9Y@UV*8^C&l5 zw|>Wd+>SHg-6;EMyle3~U37~G!tmhl&evbTX5+I~3hOYjiU$E&y(*siOc}y zX{(!HG6^YYUb{`+$14gEnD?M;%%6e26uHGnej1h92+Ve%5uX zfr=szIOTJHlWSX>WWJ#W&$``1`+$aDFUTeKK^2dKcg6i7L1M>O#GG$-^4tb&cNmPB*U-)! zB3BV{=H%yaIUXKPX0*!uSZktlh4JNVhrdM~L*(BkWiulavbX={gbH509t#oWEBv%hw?YmAy$)Vjg&&0;? zuosV0O_L^Qv>(^z>yD!Y|JpV&L1?4^je!a{6Y*i~CXge-^9jNG;&yD-TOewV>b&_< zXWF&wK#maQ=9`z_@t^rWoHvNkT`=K4prJ&wY~i6hXqlZp`v)SEVlc zw^{*UT0dH(&5Xks`xXoCL}Ig$VeBMePBC9Hn&3c%4}kG`Y4V}(2$Dp~>&+yPMz>xY zIsSB5`(0N!qwjh&mE|?~ZOZE|@m8zeTnI4mTmh$pl9Cl0~ z+pd}yanSXhk(8kJHv(uUu&RMjk^RaYH*wDEtt!3D66%iKSn2Mjf!0qvfFc1j= z>79o_*!NbU1iA8KJ$ zzosP;!g6Ru+0X`zsbqw24AFX5*N1^atRrPq zBIh0*M%okJy8*oZ2I_FYw!Vq7uS2IFqFoI*uu}74A#V|&B$mZu zfgnSj*bd{fd0(qUvYJORmd_ksz%Sl|hD9cck6q^k&txnmijK7vX)azF0G2BoDU3Px z$9PxjIP)|!o`?-QRLYbpq+4|!y9#69a@;~so*3O30)LyR79m9W8nX%9BGoyQTqz|d zKCWIlg$SP5Zp!~kQhp|r*R)|*G7|z6z$Pq+gc_&?lmoxIGF11cXn*A>ozwrCkvLI6 z6T(jvWg`0!1~=I=_nj?JYS3~>OYQMqlbkU%KBF4qcSZOq> zvLE_W)_i--i0Uc_$TbTd!8aWwWMS?mQuePKQt?;1V+ySdHrwi`S0YQ!J%_OstW^2cctjU`cz1+FHrwb4WOHq zqgEN|G~1f7Au!D~o_)gp#dk=#Mz)>x7X43jMCCA$fmKyOm%{ju-+8^knwmqtCYe8& znVndFgJTbE{2~a+Sb3H9X{+$aX(8g$1nq;dK|$_R>Tj#YMI<$M za+!{Th) zSI3F%OKn~1eoPlc>vRTNtu=FPZNXIF@bt`JrfL&F)-90R0iHcG1qFoPx4u48HYtnp zxKv7(IA>??i4cdb+Ro^O-F@EHw%jg1fLg>&4>p62M%<0~fQa-nPMGO^k03lfm@*YT zsQXJ-`TPOZPW!~)C1@Ju|M6-kfmH{u^&k zS1G|AmQ+uwd_@)@y7T~-m3y>C%+Hx) z_-0-f06IEKgNl-R*HQhWvOFwpU#Xa`ERVm|IVHvLLoF{8LhSXsH;~fDQx<`^)bFeU+kWsMm^M{-Jxo) zjY0@IIb|{ni2PHxXU^4=8e5{s)e6B6EZ3mCif#P;WXzI6MlhFhtLwKXf#h~Ks=yAI^Q#a<(DQ>YXBSr@sYG;x zBk6P-g>Sp}$7@H*IP+p;B>cLCw0)cVg>Rvs4Ll6CbE{Zv+X#Ra?Bg}sFC>#ydX6zq z%odJlyJ9Axm|FszLPQ7HS3qy>VQOARx3J*Eg5#tmiY^XB=G;x7ptQT2G3BN**)1+a zgT36)L*WuKs}*Ei^>b+H6b{oUziXoxLeHY?A3l;)?(2{D`Mk?vwLr8`lJxJHTA2bd z*4_buRKjtX2#Zl7;jfEMS|Q&N7vhW+V&e>0nh^oxhC`(XOONbOh3X;>*rXRcIEc7) zxuU0%mX)p4S!(MWG%bU_;;|d+iFS&Y?}Uue@tlb0lAud#w#h8tSz+O;AEH%* zknwEOou+MkytgOIX~bhav>?+IjFka}_TT7nm6o%%43uevPY85JeQWhFW8fRBG_({* zq47*J(HwOr1}f&96Qok6d*us{b&&b;l-<*(?Z3J-f>)&Iv=;}b4~^4ty8)}Nv!8_~x>Zc= zY6l2(IX^YRpR$_CDXsT;>^7X*b_sr6m03)muW6g@TNs?|k^HF4D2a2b_@RzX&2=}L zR&Q-iaMvR@r8$guP~v>AYIb-{I$?q5&rt)`<;S8dJtmJBa@czZBkLY2mNa~cW{i&Z znq7mx&%fle*!Zh^V`R!MB=_ z91?=@8p!0|S#@>BjK*gYC*c?Y8#VSsocxx`@rFM&b97dJ`woy9>D3rZclWB8N}hN{ zt)AZ9m_V{n=vH~V%B`H@?u#sLSYbmzbm1@4LBgatcc_siDj2(ay63pq>NHB4Z8&Ky zsh5t9e$#RGG=14WTg6*d`=c(4&2BTs%v3;WCzg+eKp4%?8^y%JTT5-=TW=)q!hpDr zBm=O6U6jY?r1d-%B`Vq4jVj+XsDahJjvbbF5qxJquF$pWl8STbKwlj z=wg128xhNS?p{pBeCzc-_72LNLFL60Q$C&5cw}Z`nBv~%ayWuv+#Fbgez^%{9?|jo zAIY(Nq`PT7Ot_DO`fuPtjO=SxruVpxo;EOQhEsDot|peM6l+?ZCQ8i}d8T3ztTTNK z;xp%-yC<=fns=|rm@6zljrbPDOuz&HB(yZ8$tkq2e-7K$_A7l)fa?RL)jMKS!qBQ^ z&Pqwfq|-(dC6D;y@Rt4E;>S;4m$Aq~8g{g%uE&S-UhJ^b?Px9qJANuzUUzFLo)$){ z<9JU@y0n*xG}70mas9S6T>IN(IUD!SSaya9{Vr3FIn0nIPZ#f<-mHXdg12~i6Rvaw3RdV>eM|0>R!|;VJ^}($|xie zhw~SC`JDYf&im4r2E2ZV3fXC1!>{MPbkCZLXAu-j{CEACP*X`B1hYLSS-4syzHut6 z4{gpe@=ICI9E%@ziycc>7s+K)ZErz&7v@z{xGmegn4bLg`;X&1y_TbJEIct^UQao+ z@~*N50*}9zQy7?>Hr@8V_4uYNwm>uC7V={nW-$;BKNmpO*PvfE(e}>_{~=ppEH`hF zHSSzx{XK7TR+kCS*I!{8nsQjlvkr9_)tQGofV%loX7*+0cy+Nbqs6knm8={Vwg{<^ z f@1`-|@AjFwGic`mIc@ADH&CnE2zTZ(a;62ETV@7I*Aq2^8B3|veG-3O2-tq;H zKcfN9cAJ&yqqpLhE2wTc!B)!J9b{DVK1rh>rLLFbwsU|vJgvP%x&gykzJ*inA@62v z&tQ05>OMW6>DjaAYdX2fR;i)a=#zFZ%hJ^mvRL$q8{$>9sdXn=tv*`TZ-N+^%6hVQ zfT{h)kuu--WCHyn?PoVX;$iqYL97Rhh*3tO)@})RwqoZ8u@(6C+O zgYq;#UTT?*{l$x37uXdi(q5B*eafp~tGQaGZ(H48=Oe@)A&(mzN5@!( znA1OV%HyMmJn1g1{h)hw_{zqM~fDe;6?<_=21T4lUs^CnjOJxfe zOS-qmSN*2;**|k1?|$1|x%_}?o$nbNG{{$ zkS?T4Zo-`ZYIQuiEv+9-puFS8-bBq#RNZ^6HXua^SHeT}n_rF^hSY^fbE7pKaysXA z?G+6awusKzLN?<**fL6@99IIvaGimI%CSjf!GIwd&^re$zVQpU`} zlRs|?#$%AF(_?&luU$d@UAB%!}O5-Uk-;}#}+eTew2@;UG4PRmfW+~6}=oz{^gaagR+OfS%- zm~v6hDO5LFZ@dj&P=Dib;^`iC=EqV|O~cc5U7VYbqjukF=lTMgu%zgWYCYrc0Ho$eu0FL2by1wnB! zDClHpG#E|YiTsk*e<6pTaTR4(sA=~8peS)txnkG%RVf(1x>AgRHwhC}+6*7&c_OUs z^>`MqYlY9=(ibUr&v1Mz%XCn|#4Id2{J6JOf8wuiO5*gNY9oL=;8O+PeQy#wUz3ow zVLQ)?yLfd~Anuy2rvzt! zff@Jn+F^Tw@#+3~&LPmCAm(QW*^19nx4LDRabZMQttDh4P-+Hkvi{;%V_o)Vf6b|JdX#$#ai1VRdBzv*6DG6OeV2h0`2NqcABeo zvFgGy3@0|7cqhy4Ti3;@)_dKh=50*<{9%qgxRsSeUV!t^@Qk!N1Dyx)hb-c;LzbJ( z<5t_^WHVq&eW?t`n7eH}D+?r!;(V}O)0o-T)7>BH*F*QM%gFke_9u$=_vKC=1#Y}uxRKXl0GX}%;INuH~Z zP9ghgG<6CVa#Y~-<)(_^fj zHh96|tyshJwDcP)!D^AeD21+sx=w$9w`tGy=+GbcTTEBZ37Gw@%MnJ2DW!}1=!MA- z^!=Y3YO%`nn!nKd-A;MFzD0@+f8QaOUWQAR;J?P~PrA9L;wrdTF#-{jt~i5kf%?Nv zSv~;j{zl6%RLP#$2~7%r%S7f?L9>IB<4^&I99%?OxY%#uqyPJDPr{R*wi1h?SCgpK zwjX2DfeFsaYyJ_3j2}SRXp2om?)4kKa(_N@4C`mM9M5kmlkiB0J~NOW85DT(gp{LJ z7_~YSYTXM_=$waI?iVW6p;N0^($d=P1S@p|%9@1UydC+;UTqD5a5fSq}w8LN{$ak**bq3OZS<8fYA0b_}K}5J3nl35Ybt+FOPZFcXPujx1!HR%<&0C z!(Gg=@oT0GTQmld#|E!H)emoc{N^>R9V4E|k8qBm2z16=S~gi@u4SJqS{aGL=z>u*(3yKE(DG=m^H7(<6;u}L~w;kjsK zNmiB{7Myt3-xFt8@jZb)$cu9o{-sKelK(c0gzO!}xIljb@GK`!5iX52YTtf0zc#+> zl9oe$*9=E%SCnoLk*loJB&s80|2q))uS?V(SM5}oKXV zx0-$HSnC-+?wnC>3f3|*Pa3OA`}A0nn@oQ~((}``ht10o8*X4QlLdpS`(In8W(DYW z=QJJ&Z3niJfF_YPU=xv1NOXjYX~X*mX65?s^{o18 zCa)i8`1k(g+WV8x)V83Rf>Q~TPh$de#qCSN+fboV9qiKS{5}A#kY6rRAgPVYd$Xps zJ@t)ay~gQ8`EjEg*z5Dd?aDI$0u9|tKMWiOwMiagpVXX)-Zzoi zx>!Zm?FT$>SmgYET&^{7kRMb+?|8G?NdwyZ6;IE0e|QF;AU|6Jr;pkI-Fj^$uj1IT z+w&dXg6AZ_!F{IBNqU*uq|EWU1=>b#$tM!zxlcwZbKsv>I&Ya`uul;M-eWaU4WNeA zuR5OywjoLy?Y6Ry6LN7SdU>K3P)@z>ds~n7&%Ng>1sc(AngmtB#btqO(aV#~BSW}* zP{Tp>UWRH6LSt28Fq+ULX7lVtvJ@%gOdZX2y&PstOiTbfy@7}*L48z*r!~eFv1 z3VaXqz<;w?YcdS^4M+F)!$K4;$6zJ277kLae0E4r$&WsO!!ae z$_0v37jSW#z~!PvIOD3E{~k(tt|IE{K%aIe8_*W2R<7RoV|Ewl#5AZk zmpeYs?>Gc%f!wZ_6X97rmo21}l*K@2hISsXiyxGd*TaFQ>}R)2Nt7j+P4wKsFtu7& zh@caUR^DstEV&fb1HVg5mQTWHTo6>^D^B+2C=;-Oy!^YCEZ*-b{Ly@^=_jRZ>h)fX zz^$4H-Zaof2Ye2J!MjU-d`VI13;67c=W$+$cofdV$J5r=O^na|iJh_}S#R_0^#7{i%;TYK-#%;@*_RniWNF4Sc4ZKz!cfMfYzY}VlXzs$GRUsR zzJ(!M)@)&{+4r4NS;APdW(gr8&pY+}-aoJVzx)2&*L8lb^E{5P4*Qvl^Ha}U>)U=} zWrrXNnE=)YaaVx^xU`Cerlb=%IQCgf7g^*k|2a*%#9*9N*UlE7UnW;tcZsB$b!Mo9 z^-zlbNR$MuGBQOX3L@S4LDS72TA)oc~x|Ct-cdBtim2DgOlcUm7WvfOmT%~QAhMYYda;W@zb~YI3fo(m1YtNx3I+>*x z9?@$8wPQ-Fm(jRpo)cN*H%|G|qkb7u_ZMk(vgWFmiQT*>!`o^vg|_(KHj}n8!vb4e z7dt7$pE*T1xKXzfGw6nD8On>epY5sv#6$$iWc!ZZbi%Gm z%i2Scy`8svO_qU&uQIPAK91`^9e|Sw9NYN3x5Z{Mk~}uH!3%%*b|37^3@|#{hnk>w zywnpF?0#lc2XL6I;D?G4ie))kXUimWsj&%XlxZ{Nd|d%Z>0Tn7LBCPJV*or0lSu#4 z)fn(7e6|6a4pr)148IGWlBVFtw^Y3ShPKv{oEzLMGAT02DZJQ?LdPs?N?Lp{6)JXK zd$^KyQvu#O&fnJL^@OR(_X~_ZmO!5o-+icw`cSiUkC(NV8X(0EY6q#cPAT=+otOWe zdQ%Y9Gs@2QxtKk*M^U4uhu&CsMRW@aSIsd-nT(H*e@lk%b9pYcqsdplY-60{Is=t= zrb%>_DL_|_?L`Pc*0j!Pz)`DiQ;@y;WduEj+Yew4Y;DX30WS7KK27-QtgI*mSo^;P z&|H*vXCNW{xH} zbQi&s6bJRwugb<)Sd7oOWYz7gB{cx=v;&VPreYGRu1y+tIREIbF3~jfuiL!XO1zPO zEFWpUDN#>Dt;N?P^T2QoXBND$Pj7s~Svk_e#se1g=xf9^TY-D3ZQeRR1u|wUjHBl6 zbC^xO`xGPdS!~N|p-I`_uY(l$6Hp;!Is8P$&&Vi5vi#4VMcYc-G{EHL!3Ol7>4Lwu zn!-h4BM<^hMgipw_5A)_^#XwgsLKj@+@p_iB0}kjan>*6+8k|kw?qGl!(w@~a~ z9ifEm;jLdIlf+bubIO=y$GtQ)a*hLRmfC2jS}^MMCbD9A&wuwBY`%0k!#=EWV>|m< z$mm@68Nap?0RP-z3{-tNT=UJoX*SwU!ruN2oH+=qQB0B?L)L@umK$Q7x@Md-J z7Zp~zz!6__z4#NLVCtb$61LpfF%!GeFehnNk*IfC_e6YN#<_ZVhU4ejXF%%5@!j(B z{5?~9G2k?dmtPs)j16(sE<#{3qO`aQQ6=K8?(U^w zZFO3d>+ky)Drj0!cQIw5H$26B$+PcBs@H4Xk}|iipN+p8sW2)(5{1inm##cEr5?a- zMDI;h+%qS=BeM;qJDnD&7}FmY6+FzC#^=m@i5kqx*Q17mzeC!v-7=*L9x9$p>%p+R z+qMbrx7W!^xuuS!58)6BecIGw2az?jn7;APviNa!j8+tIfPliQ!34%)tILbL9=M;>6Q8mul2G92|@|+7-`40J96Ve6$TK zO8}k&VWN5e6`MXxAb+63p${~#>hY!nR<1P)r|Q1BfyJHCwF|cGN@s?(aA(>edN=2o zTyP+)g@wT8R6`7oF&HIf*+qBbJkzuTQfn~$0A3^|vA|EvM;eJGkyg@EtQ5aLSn{;= zn#MJoHd=L12kyp9`TxkJ&{M1@CokA6gYx6QAJ5`9%k8LYDSS!uUN3LijYYrhrQ9E@ z$nRxL9CUQ#zQ*mknP(Kxi{+C13xP%Lj%JB&$?yJlL>G7tr)0-Nm(ju?!{wI26lv`K zC6MnCzF?Q4$}Wexp4o*9X7_^-jdDS9moGkIGdb3%3^?_I5d1v8Cf7qaQ;2qH4u}(n z%RZ3mlxKN;G;`=htdYT>((L&^->zV_C)!8?A6nCCS1Uii3O`|}Eo10xhn$b!633@1 zEkv`3e~>rI90wUxpk8yy6WOJp0YydIolO^eZa_X`O7hT`zWMQvT=B;WwQx4|*e#`9 z#RAL3?PiB+tV?`IvAbZnKp~3uU|a`6!GdfMF$+_KCOm+=(z>2w$#ivkb<9JsTjp&c4cDJ*Ol(V+fuHZc! zcvy*zJ)p((2B}>`JEXcl)`CT|NCypsJp#g0U;C`lQbg)7_=-^)HCEtFHTZ}=j< z&uVCD$fFej9-WRuDbge93N%CP+;E@4@kUP`m-L|X?iIJQBAv{^_2;T$%+E=q$S9Yz zj^HT983&m1U3skOWu)gi#SJJ^)|O=79WM;csD~88t7(0cgM}BgIfOM+HSK$OeV*th z$3x?nd7>v;pnOVpB}&A%8@iVi)+&rLVItimfcgXJyyW0RVJ^fAe3*37ZV>~PHLRM6n4roF0w(WK6_sno*mr!lF!A1J?PA7IYav%uB1>zJ0O$lzUBA zGbiX@GfZ3{l@~`X!tJ_HW^KN2ZII$bq2sw3f{*h{8 zuYIr=?DuMUVaz^R=Qsa~wgKhOXSZLY^*BQpmIP8YUlQ)l1l-TUf}>YY+y1!AOzay% zhV19aG8BWQe!E)=H*2Zc?&gMGSn}FyPZ49<(fub-L1iI*80@4E}h7dF7~?-7gNa z;f8Me*n?+Yk3P7LhG{-~vKIeTmW#rl?BF+SV$>7e4zAzx`RVs~TOivMQNd?xkQZ-v zW=+w+Ad*w|Q4L5hTQ`U{2B}gKQN^_-f`ON0)h`8{kc_DSl{6KKTyA8Vcv_`!UDQ+H zd-+ZdZ*JJrTt%YFO8pOQUvb}?*NSy48Vg|=sTs-Tq5T14soHST7?co@ zI1MnQ_uoH&{}_l-Z{(aFdo2#Yo2#2d=rODE-+(b`UZhjB-n1&1DbdnIhOAn3S_ui+ z#(mJzgxA>}=!>1anF%NCF4EIcyupux`@$0Ymd1+2l3J<&7>ydf&k8gLqHjH%`W%WK zgAlp+L}-LE-+WPFt$tdb&P?l=@WJs;uF8c0xl04bB?!wY0%TwVv?0#p#J7QnB{Lwz zJ&WN15_diSMIziM^go=HnKEfj3Wa9nUx=#I%vm7pTzy3CdlMu4HtvY|x?ag7Hz%A%0HTJrr_>x~Ke2J#v7 zlcyB_Zq~t5uTQe7{~upcGE0q~lrwA;qipv7MV0*TO3riV?}K3aKkZ}sZ_GlG6uXt; zx9(E9CH&3h%mx1~fq#5p;L`|D&wu$SK7UAcvQfnNf6I_R{pt{8*9)7!i74#Nlm;f9 ji=>9be@hhPIM5>VHt)*));UVx3l-+J&aDb{tC0T#-U&\ - signature= -""" - -import logging - -from google.appengine.ext import webapp - - -SECRET_FILE = 'hooks/fat_publish_secret.txt' - - -# Define the Hook class for testing. -if 'register' not in globals(): - class Hook(object): - pass - - -class FatPublishHandler(webapp.RequestHandler): - """Request handler for receiving fat publishes. - - Returns 204 on success, 403 on auth errors, 400 on bad feeds, 500 on - any other type of error. - """ - - secret = None - - def post(self): - topic = self.request.get('topic') - content = self.request.get('content') - signature = self.request.get('signature') - - if not (topic and content and signature): - error_message = ( - 'Fat publish must have required parameters in urlencoded format: ' - '"topic", "content", "signature"') - logging.error(error_message) - self.response.set_status(400) - self.response.out.write(error_message) - return - - logging.debug('Fat publish for topic=%s, signature=%s, size=%s', - topic, signature, len(content)) - - if not Subscription.has_subscribers(topic): - logging.debug('Ignoring fat publish because there are no subscribers.') - self.response.set_status(204) - return - - logging.info('Subscribers found. Accepting fat publish event.') - expected_signature = sha1_hmac(self.secret, content + topic) - if expected_signature != signature: - error_message = ( - 'Received fat publish with invalid signature. ' - 'expected=%s, found=%s' % (expected_signature, signature)) - logging.error(error_message) - self.response.set_status(403) - self.response.out.write(error_message) - return - - feed_record = FeedRecord.get_or_create(topic) - if parse_feed(feed_record, self.request.headers, content): - self.response.set_status(204) - else: - self.response.out.write('Could not parse or save feed updates.') - self.response.set_status(400) - - -def create_handler(shared_secret): - """Creates a FatPublishHandler sub-class with a particular shared secret. - - Args: - shared_secret: Used to verify the authenticity of fat publishes. - """ - class SpecificFatPublishHandler(FatPublishHandler): - secret = shared_secret - return SpecificFatPublishHandler - - -class FatPublishHook(Hook): - """Hook for accepting fat publishes from publishers.""" - - def __init__(self, handler): - """Initializer. - - Args: - handler: FatPublishHandler class to add for fatpinging. - """ - self.handler = handler - - def inspect(self, args, kwargs): - """Adds the FatPublishHandler to the list of request handlers.""" - args[0].append((r'/fatping', self.handler)) - return False - - -if 'register' in globals(): - # You can re-register this same hook here with different shared secrets if - # you would like to allow other publishing endpoints to do the same thing - # with separate access controls. - register(modify_handlers, FatPublishHook( - create_handler(open(SECRET_FILE).read()))) diff --git a/nonstandard/fat_publish_test.py b/nonstandard/fat_publish_test.py deleted file mode 100755 index 220455a..0000000 --- a/nonstandard/fat_publish_test.py +++ /dev/null @@ -1,166 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Tests for the fat_publish module.""" - -import logging -logging.basicConfig(format='%(levelname)-8s %(filename)s] %(message)s') -import os -import sys -import unittest - -# Run these tests from the 'hub' directory. -sys.path.insert(0, os.getcwd()) -os.chdir('../hub') -sys.path.insert(0, os.getcwd()) - -import testutil -testutil.fix_path() - -from google.appengine.ext import webapp - -import main -import fat_publish - -################################################################################ - -# Do aliasing that would happen anyways during Hook module loading. -fat_publish.sha1_hmac = main.sha1_hmac -fat_publish.FeedRecord = main.FeedRecord -fat_publish.Subscription = main.Subscription - - -class FatPingHandlerTest(testutil.HandlerTestBase): - """Tests for the FatPingHandler class.""" - - secret = 'thisismysecret' - handler_class = fat_publish.create_handler(secret) - - def setUp(self): - """Sets up the test harness.""" - testutil.HandlerTestBase.setUp(self) - self.expected_headers = { - 'Content-Length': '-1', # Used by WebOb for urlencoded POSTs. - 'Content-Type': 'application/x-www-form-urlencoded', - } - self.topic = 'http://example.com/mytopic' - self.fakefeed = 'my fake feed' - self.fakefeed_signature = '5f9418a2e221ced6a0bc1263aaebcce297438740' - self.success = False - - self.feed_record = main.FeedRecord.get_or_create(self.topic) - main.Subscription.insert('callback', self.topic, 'token', 'secret') - - def parse_feed_mock(record, headers, body): - self.assertEquals(self.feed_record.topic, record.topic) - self.assertEquals(self.expected_headers, headers) - self.assertEquals(self.fakefeed, body) - return self.success - - fat_publish.parse_feed = parse_feed_mock - - def testNoSubscribers(self): - """Tests when there are no subscribers.""" - self.success = False - main.Subscription.remove('callback', self.topic) - self.handle('post', - ('topic', self.topic), - ('content', self.fakefeed), - ('signature', self.fakefeed_signature)) - self.assertEquals(204, self.response_code()) - - def testSuccessfulParsing(self): - """Tests when parsing is successful.""" - self.success = True - self.handle('post', - ('topic', self.topic), - ('content', self.fakefeed), - ('signature', self.fakefeed_signature)) - self.assertEquals(204, self.response_code()) - - def testHeaders(self): - """Tests that request headers are preserved.""" - HEADER = 'HTTP_MY_HEADER' - self.expected_headers['My-Header'] = os.environ[HEADER] = 'cheese' - try: - self.success = True - self.expected_headers - self.handle('post', - ('topic', self.topic), - ('content', self.fakefeed), - ('signature', self.fakefeed_signature)) - self.assertEquals(204, self.response_code()) - finally: - del os.environ[HEADER] - - def testParseFails(self): - """Tests when parsing fails.""" - self.success = False - self.handle('post', - ('topic', self.topic), - ('content', self.fakefeed), - ('signature', self.fakefeed_signature)) - self.assertEquals(400, self.response_code()) - - def testBadSignature(self): - """Tests when the signature is present but invalid.""" - self.success = True - self.handle('post', - ('topic', self.topic), - ('content', self.fakefeed), - ('signature', 'bad')) - self.assertEquals(403, self.response_code()) - - def testMissingParams(self): - """Tests when parameters are missing.""" - self.success = True - # No signature. - self.handle('post', - ('topic', self.topic), - ('content', self.fakefeed)) - self.assertEquals(400, self.response_code()) - - # No topic. - self.handle('post', - ('content', self.fakefeed), - ('signature', self.fakefeed_signature)) - self.assertEquals(400, self.response_code()) - - # No content. - self.handle('post', - ('topic', self.topic), - ('signature', self.fakefeed_signature)) - self.assertEquals(400, self.response_code()) - - -class FatPublishHookTest(unittest.TestCase): - """Tests for the FatPublishHook class.""" - - def testCreateHook(self): - """Tests creating a hook.""" - fat_handler = object() - hook = fat_publish.FatPublishHook(fat_handler) - handlers = [object(), object()] - original_handlers = list(handlers) - self.assertFalse(hook.inspect((handlers,), {})) - self.assertEquals(original_handlers + [(r'/fatping', fat_handler)], - handlers) - -################################################################################ - -if __name__ == '__main__': - unittest.main() diff --git a/nonstandard/virtual_feed.py b/nonstandard/virtual_feed.py deleted file mode 100644 index fc085ea..0000000 --- a/nonstandard/virtual_feed.py +++ /dev/null @@ -1,172 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2010 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Virtual feed receiver for publishing aggregate feeds using fat pings. - -This isn't part of the PubSubHubbub spec. We have no intentions of making it to -be part of the spec. This extension hook is useful for creating a virtual -feed (e.g., a firehose feed) using an aggregation of other feeds that are -fat pinged to the hub. - -It's up to your code to connect your fat-ping request handler to the -'inject_virtual_feed' method (see fat_publish.py for one way to do it). That -function will parse your feed, extract the entries, and enqueue the virtual -feed update. Multiple fat pings delivered in this manner will be collated -together by their virtual feed topics into a combined payload, which is then -injected into the reference hub's event delivery pipeline. This collation is -useful because it controls how many HTTP requests will be sent to subscribers -to this virtual feed, and lets you make the tradeoff between delivery latency -and request overhead. -""" - -import logging - -from google.appengine.ext import db -from google.appengine.ext import webapp - -import fork_join_queue - -################################################################################ -# Constants - -VIRTUAL_FEED_QUEUE = 'virtual-feeds' - -################################################################################ - -# Define these symbols for testing. -if 'register' not in globals(): - class Hook(object): - pass - def work_queue_only(func): - return func - sha1_hash = None - - -class FeedFragment(db.Model): - """Represents a fragment of a virtual feed that will be collated. - - The Key and key_name are not used. - - Fields: - topic: The topic of the virtual feed being collated. - header_footer: The feed envelope. - entries: The ... text segments that were parsed from the - source feeds, already joined together with newlines. - format: 'rss' or 'atom'. - """ - topic = db.TextProperty() - header_footer = db.TextProperty() - entries = db.TextProperty() - format = db.TextProperty() - - -VIRTUAL_FEED_QUEUE = fork_join_queue.MemcacheForkJoinQueue( - FeedFragment, - None, - '/work/virtual_feeds', - VIRTUAL_FEED_QUEUE, - batch_size=20, - batch_period_ms=1000, - lock_timeout_ms=1000, - sync_timeout_ms=250, - stall_timeout_ms=30000, - acquire_timeout_ms=10, - acquire_attempts=50, - shard_count=1, - expiration_seconds=60) # Give up on fragments after 60 seconds. - - -def inject_virtual_feed(topic, format, header_footer, entries_map): - """Injects a virtual feed update to be collated and then delievered. - - Args: - topic: The topic URL for the virtual feed. - format: The format of the virtual feed ('rss' or 'atom'). - header_footer: The feed envelope to use for the whole virtual feed. - entries_map: Dictionary mapping feed entry IDs to strings containing - full entry payloads (e.g., from to including the tags). - - Raises: - MemcacheError if the virtual feed could not be injected. - """ - fragment = FeedFragment( - key=db.Key.from_path(FeedFragment.kind(), 'unused'), - topic=topic, - header_footer=header_footer, - entries='\n'.join(entries_map.values()), - format=format) - - # Update the name of the queue to include a hash of the topic URL. This - # allows us to use a single VIRTUAL_FEED_QUEUE instance to represent a - # different logical queue for each virtual feed topic we would like to - # collate. - VIRTUAL_FEED_QUEUE.name = 'fjq-%s-%s-' % ( - FeedFragment.kind(), sha1_hash(topic)) - work_index = VIRTUAL_FEED_QUEUE.next_index() - try: - VIRTUAL_FEED_QUEUE.put(work_index, [fragment]) - finally: - VIRTUAL_FEED_QUEUE.add(work_index) - - -class CollateFeedHandler(webapp.RequestHandler): - """Worker handler that collates virtual feed updates and enqueues them.""" - - @work_queue_only - def post(self): - # Restore the pseudo-name of the queue so we can properly pop tasks - # from it for the specific virtual feed this task is targetting. - task_name = self.request.headers['X-AppEngine-TaskName'] - VIRTUAL_FEED_QUEUE.name, rest = task_name.split('--') - VIRTUAL_FEED_QUEUE.name += '-' - - fragment_list = VIRTUAL_FEED_QUEUE.pop_request(self.request) - if not fragment_list: - logging.warning('Pop of virtual feed task %r found no fragments.', - task_name) - return - - fragment = fragment_list[0] - entry_payloads = [f.entries for f in fragment_list] - - def txn(): - event_to_deliver = EventToDeliver.create_event_for_topic( - fragment.topic, - fragment.format, - self.request.headers.get('Content-Type', 'application/atom+xml'), - fragment.header_footer, - entry_payloads, - set_parent=False, - max_failures=1) - db.put(event_to_deliver) - event_to_deliver.enqueue() - - db.run_in_transaction(txn) - logging.debug('Injected %d fragments for virtual topic %r', - len(fragment_list), fragment.topic) - - -class VirtualFeedHook(Hook): - """Adds the CollateFeedHandler to the list of request handlers.""" - - def inspect(self, args, kwargs): - args[0].append((r'/work/virtual_feeds', CollateFeedHandler)) - return False - - -if 'register' in globals(): - register(modify_handlers, VirtualFeedHook()) diff --git a/nonstandard/virtual_feed_test.py b/nonstandard/virtual_feed_test.py deleted file mode 100755 index 14f560e..0000000 --- a/nonstandard/virtual_feed_test.py +++ /dev/null @@ -1,216 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2010 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Tests for the virtual_feed module.""" - -import logging -logging.basicConfig(format='%(levelname)-8s %(filename)s] %(message)s') -import os -import sys -import unittest - -# Run these tests from the 'hub' directory. -sys.path.insert(0, os.getcwd()) -os.chdir('../hub') -sys.path.insert(0, os.getcwd()) - -import testutil -testutil.fix_path() - -from google.appengine.ext import webapp - -import main -import virtual_feed - -################################################################################ - -# Do aliasing that would happen anyways during Hook module loading.= -virtual_feed.sha1_hash = main.sha1_hash -virtual_feed.EventToDeliver = main.EventToDeliver - - -class InjectVirtualFeedTest(testutil.HandlerTestBase): - """Tests for the inject_virtual_feed function.""" - - def setUp(self): - """Sets up the test harness.""" - testutil.setup_for_testing() - self.topic = 'http://example.com/my-topic/1' - self.topic2 = 'http://example.com/my-topic/2' - self.format = 'atom' - self.header_footer = 'tag:my-id\n' - self.entries_map = { - 'one': 'first data', - 'two': 'second data', - 'three': 'third data', - } - os.environ['CURRENT_VERSION_ID'] = 'my-version.1234' - virtual_feed.VIRTUAL_FEED_QUEUE.queue_name = 'default' - - def testInsertOneFragment(self): - """Tests inserting one new fragment.""" - virtual_feed.inject_virtual_feed( - self.topic, self.format, self.header_footer, self.entries_map) - task = testutil.get_tasks('default', index=0, expected_count=1) - self.assertTrue(task['name'].startswith( - 'fjq-FeedFragment-54124f41c1ea6e67e4beacac85b9f015e6830d41--' - 'my-version-')) - results = virtual_feed.VIRTUAL_FEED_QUEUE.pop(task['name']) - self.assertEquals(1, len(results)) - fragment = results[0] - self.assertEquals(self.topic, fragment.topic) - self.assertEquals(self.header_footer, fragment.header_footer) - self.assertEquals(self.format, fragment.format) - self.assertEquals( - 'third data\n' # Hash order - 'second data\n' - 'first data', - fragment.entries) - - def testInsertMultipleFragments(self): - """Tests inserting multiple fragments on different virtual topics.""" - virtual_feed.inject_virtual_feed( - self.topic, self.format, self.header_footer, self.entries_map) - virtual_feed.inject_virtual_feed( - self.topic2, self.format, self.header_footer, self.entries_map) - - task1, task2 = testutil.get_tasks('default', expected_count=2) - self.assertTrue(task1['name'].startswith( - 'fjq-FeedFragment-54124f41c1ea6e67e4beacac85b9f015e6830d41--' - 'my-version-')) - self.assertTrue(task2['name'].startswith( - 'fjq-FeedFragment-0449375bf584a7a5d3a09b344a726dead30c3927--' - 'my-version-')) - - virtual_feed.VIRTUAL_FEED_QUEUE.name = \ - 'fjq-FeedFragment-54124f41c1ea6e67e4beacac85b9f015e6830d41-' - fragment1 = virtual_feed.VIRTUAL_FEED_QUEUE.pop(task1['name'])[0] - self.assertEquals(self.topic, fragment1.topic) - - virtual_feed.VIRTUAL_FEED_QUEUE.name = \ - 'fjq-FeedFragment-0449375bf584a7a5d3a09b344a726dead30c3927-' - fragment2 = virtual_feed.VIRTUAL_FEED_QUEUE.pop(task2['name'])[0] - self.assertEquals(self.topic2, fragment2.topic) - - -class CollateFeedHandlerTest(testutil.HandlerTestBase): - """Tests for the CollateFeedHandler class.""" - - handler_class = virtual_feed.CollateFeedHandler - - def setUp(self): - """Sets up the test harness.""" - testutil.HandlerTestBase.setUp(self) - self.topic = 'http://example.com/my-topic/1' - self.topic2 = 'http://example.com/my-topic/2' - self.format = 'atom' - self.header_footer = 'tag:my-id\n' - self.entries_map = { - 'one': 'first data', - 'two': 'second data', - 'three': 'third data', - } - os.environ['CURRENT_VERSION_ID'] = 'my-version.1234' - virtual_feed.VIRTUAL_FEED_QUEUE.queue_name = 'default' - - def testNoWork(self): - """Tests when the queue is empty.""" - os.environ['HTTP_X_APPENGINE_TASKNAME'] = ( - 'fjq-FeedFragment-54124f41c1ea6e67e4beacac85b9f01abb6830d41--' - 'my-version-42630240-2654435761-0') - self.handle('post') - - def testOneFragment(self): - """Tests when there is one fragment in the queue.""" - virtual_feed.inject_virtual_feed( - self.topic, self.format, self.header_footer, self.entries_map) - task = testutil.get_tasks('default', index=0, expected_count=1) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = task['name'] - self.handle('post') - - event_list = list(main.EventToDeliver.all()) - self.assertEquals(1, len(event_list)) - event = event_list[0] - - # No parent to ensure it's not rate limited by an entity group. - self.assertEquals(None, event.key().parent()) - - self.assertEquals(self.topic, event.topic) - self.assertEquals( - '\n' - 'tag:my-id\n\n' - 'third data\n' - 'second data\n' - 'first data\n' - '', - event.payload) - self.assertEquals('application/atom+xml', event.content_type) - self.assertEquals(1, event.max_failures) - - task = testutil.get_tasks('event-delivery', index=0, expected_count=1) - self.assertEquals(str(event.key()), task['params']['event_key']) - - def testMultipleFragments(self): - """Tests when there is more than one fragment in the queue.""" - virtual_feed.inject_virtual_feed( - self.topic, self.format, self.header_footer, self.entries_map) - virtual_feed.inject_virtual_feed( - self.topic, self.format, self.header_footer, self.entries_map) - task = testutil.get_tasks('default', index=0, expected_count=1) - os.environ['HTTP_X_APPENGINE_TASKNAME'] = task['name'] - self.handle('post') - - event_list = list(main.EventToDeliver.all()) - self.assertEquals(1, len(event_list)) - event = event_list[0] - - self.assertEquals(self.topic, event.topic) - self.assertEquals( - '\n' - 'tag:my-id\n\n' - 'third data\n' - 'second data\n' - 'first data\n' - 'third data\n' - 'second data\n' - 'first data\n' - '', - event.payload) - - def testMultipleQueues(self): - """Tests multiple virtual feeds and queues.""" - virtual_feed.inject_virtual_feed( - self.topic, self.format, self.header_footer, self.entries_map) - virtual_feed.inject_virtual_feed( - self.topic2, self.format, self.header_footer, self.entries_map) - task1, task2 = testutil.get_tasks('default', expected_count=2) - - os.environ['HTTP_X_APPENGINE_TASKNAME'] = task1['name'] - self.handle('post') - - os.environ['HTTP_X_APPENGINE_TASKNAME'] = task2['name'] - self.handle('post') - - event_list = list(main.EventToDeliver.all()) - self.assertEquals(2, len(event_list)) - self.assertEquals(self.topic, event_list[0].topic) - self.assertEquals(self.topic2, event_list[1].topic) - -################################################################################ - -if __name__ == '__main__': - unittest.main() diff --git a/presentation_gadget.xml b/presentation_gadget.xml deleted file mode 100644 index b07e102..0000000 --- a/presentation_gadget.xml +++ /dev/null @@ -1,5 +0,0 @@ - - - - - diff --git a/publisher/app.yaml b/publisher/app.yaml deleted file mode 100644 index 15b746d..0000000 --- a/publisher/app.yaml +++ /dev/null @@ -1,8 +0,0 @@ -application: pubsubhubbub-publisher1 -version: 1 -runtime: python -api_version: 1 - -handlers: -- url: .* - script: main.py diff --git a/publisher/atom.xml b/publisher/atom.xml deleted file mode 100644 index 76f1b66..0000000 --- a/publisher/atom.xml +++ /dev/null @@ -1,18 +0,0 @@ - - - Publisher example - - - {{first_message.get_zulu_time}} - {{source}} - nobody - - {% for message in messages %} - - {{message.title}} - {{source}}/{{message.key.id_or_name}} - {{message.get_zulu_time}} - {{message.content|escape}} - - {% endfor %} - diff --git a/publisher/index.yaml b/publisher/index.yaml deleted file mode 100644 index 200e0b5..0000000 --- a/publisher/index.yaml +++ /dev/null @@ -1,17 +0,0 @@ -indexes: - -# AUTOGENERATED - -# This index.yaml is automatically updated whenever the dev_appserver -# detects that a new type of query is run. If you want to manage the -# index.yaml file manually, remove the above marker line (the line -# saying "# AUTOGENERATED"). If you want to manage some indexes -# manually, move them above the marker line. The index.yaml file is -# automatically uploaded to the admin console when you next deploy -# your application using appcfg.py. - -# Unused in query history -- copied from input. -- kind: Message - properties: - - name: when - direction: desc diff --git a/publisher/input.html b/publisher/input.html deleted file mode 100644 index fd010a0..0000000 --- a/publisher/input.html +++ /dev/null @@ -1,40 +0,0 @@ - - - Publisher - - - - - -

Publisher page

- -
-
-
Title:
- -
-
-
Message:
- -
- -
-
- -

Previous messages

- -{% for message in messages %} -
-
{{message.title}}
-
- Published at {{message.get_zulu_time}}, ID: {{message.key.id_or_name}} -
-
{{message.content}}
-
-{% endfor %} - - - diff --git a/publisher/main.py b/publisher/main.py deleted file mode 100755 index c48f5f8..0000000 --- a/publisher/main.py +++ /dev/null @@ -1,92 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2007 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Simple publisher example that pings the hub after publishing.""" - -import logging -import urllib -import wsgiref.handlers - -from google.appengine.api import urlfetch -from google.appengine.ext import webapp -from google.appengine.ext.webapp import template -from google.appengine.ext import db - - -class Message(db.Model): - """A message to publish.""" - title = db.TextProperty(default='') - content = db.TextProperty(default='') - when = db.DateTimeProperty(auto_now_add=True) - - def get_zulu_time(self): - return self.when.strftime("%Y-%m-%dT%H:%M:%SZ") - - -class MainHandler(webapp.RequestHandler): - """Allows users to publish new entries.""" - - def get(self): - context = dict(messages=Message.gql('ORDER BY when DESC').fetch(20)) - self.response.out.write(template.render('input.html', context)) - - def post(self): - hub_url = self.request.get('hub') - message = Message(title=self.request.get('title'), - content=self.request.get('content')) - message.put() - - headers = {'content-type': 'application/x-www-form-urlencoded'} - post_params = { - 'hub.mode': 'publish', - 'hub.url': self.request.host_url + '/feed', - } - payload = urllib.urlencode(post_params) - try: - response = urlfetch.fetch(hub_url, method='POST', payload=payload) - except urlfetch.Error: - logging.exception('Failed to deliver publishing message to %s', hub_url) - else: - logging.info('URL fetch status_code=%d, content="%s"', - response.status_code, response.content) - self.redirect('/') - - -class FeedHandler(webapp.RequestHandler): - """Renders an Atom feed of published entries.""" - - def get(self): - messages = Message.gql('ORDER BY when DESC').fetch(20) - context = { - 'messages': messages, - 'source': self.request.host_url + '/feed', - } - if messages: - context['first_message'] = messages[0] - self.response.headers['content-type'] = 'application/xml' - self.response.out.write(template.render('atom.xml', context)) - - -def main(): - application = webapp.WSGIApplication([('/', MainHandler), - ('/feed', FeedHandler)], - debug=True) - wsgiref.handlers.CGIHandler().run(application) - - -if __name__ == '__main__': - main() diff --git a/publisher_clients/README.txt b/publisher_clients/README.txt deleted file mode 100644 index 62d5c12..0000000 --- a/publisher_clients/README.txt +++ /dev/null @@ -1,3 +0,0 @@ -This directory is for client libraries that do the publishing -("pinging") part of the pubsubhubbub protocol. - diff --git a/publisher_clients/perl-schwartz/.shipit b/publisher_clients/perl-schwartz/.shipit deleted file mode 100644 index 59b4fae..0000000 --- a/publisher_clients/perl-schwartz/.shipit +++ /dev/null @@ -1,6 +0,0 @@ -steps = FindVersion, ChangeVersion, CheckChangeLog, DistTest, Commit, Tag, MakeDist, UploadCPAN -svn.tagpattern = TheSchwartz-Worker-PubSubHubbubPublish-perl-%v - - - - diff --git a/publisher_clients/perl-schwartz/CHANGES b/publisher_clients/perl-schwartz/CHANGES deleted file mode 100644 index 501d8b6..0000000 --- a/publisher_clients/perl-schwartz/CHANGES +++ /dev/null @@ -1,6 +0,0 @@ -1.00 (2009-04-26) - - * first release. works, including batching. - - - diff --git a/publisher_clients/perl-schwartz/MANIFEST b/publisher_clients/perl-schwartz/MANIFEST deleted file mode 100644 index 391d384..0000000 --- a/publisher_clients/perl-schwartz/MANIFEST +++ /dev/null @@ -1,7 +0,0 @@ -CHANGES -demo-worker.pl -demo-insert-job.pl -lib/TheSchwartz/Worker/PubSubHubbubPublish.pm -Makefile.PL -MANIFEST This list of files -t/00-use.t diff --git a/publisher_clients/perl-schwartz/Makefile.PL b/publisher_clients/perl-schwartz/Makefile.PL deleted file mode 100644 index 380e304..0000000 --- a/publisher_clients/perl-schwartz/Makefile.PL +++ /dev/null @@ -1,13 +0,0 @@ -use ExtUtils::MakeMaker; -WriteMakefile( 'NAME' => 'TheSchwartz::Worker::PubSubHubbubPublish', - 'VERSION_FROM' => 'lib/TheSchwartz/Worker/PubSubHubbubPublish.pm', - 'PREREQ_PM' => { - 'TheSchwartz::Worker' => 0, - 'Net::PubSubHubbub::Publisher' => 0.91, - }, - ABSTRACT_FROM => 'lib/TheSchwartz/Worker/PubSubHubbubPublish.pm', - AUTHOR => 'Brad Fitzpatrick ', - ); - - - diff --git a/publisher_clients/perl-schwartz/demo-insert-job.pl b/publisher_clients/perl-schwartz/demo-insert-job.pl deleted file mode 100755 index 2241a4e..0000000 --- a/publisher_clients/perl-schwartz/demo-insert-job.pl +++ /dev/null @@ -1,34 +0,0 @@ -#!/usr/bin/perl - -use strict; -use TheSchwartz; -use Getopt::Long; - -my $n_jobs = 1; -my $hub_url = "http://pubsubhubbub.appspot.com/"; - -GetOptions("n=i" => \$n_jobs, - "hub=s" => \$hub_url, - ) or die "Unknown options."; - -my $client = TheSchwartz->new(databases => [{ - user => "root", - dsn => "dbi:mysql:theschwartz", -}]); - -for (1..$n_jobs) { - my $topic = "http://publisher.example.com/topic/" . rand() . ".atom"; - print "Submitting dummy topic $topic ...\n"; - - my $job = TheSchwartz::Job->new(funcname => 'TheSchwartz::Worker::PubSubHubbubPublish', - arg => { - hub => $hub_url, - topic_url => $topic, - }, - coalesce => $hub_url, - ); - - my $handle = $client->insert($job); - print " job handle: $handle\n"; -} - diff --git a/publisher_clients/perl-schwartz/demo-worker.pl b/publisher_clients/perl-schwartz/demo-worker.pl deleted file mode 100755 index c8638a8..0000000 --- a/publisher_clients/perl-schwartz/demo-worker.pl +++ /dev/null @@ -1,14 +0,0 @@ -#!/usr/bin/perl - -use strict; -use lib 'lib'; -use TheSchwartz; -use TheSchwartz::Worker::PubSubHubbubPublish; - -my $client = TheSchwartz->new(databases => [{ - user => "root", - dsn => "dbi:mysql:theschwartz", -}]); - -$client->can_do("TheSchwartz::Worker::PubSubHubbubPublish"); -$client->work; diff --git a/publisher_clients/perl-schwartz/lib/TheSchwartz/Worker/PubSubHubbubPublish.pm b/publisher_clients/perl-schwartz/lib/TheSchwartz/Worker/PubSubHubbubPublish.pm deleted file mode 100644 index 516e998..0000000 --- a/publisher_clients/perl-schwartz/lib/TheSchwartz/Worker/PubSubHubbubPublish.pm +++ /dev/null @@ -1,132 +0,0 @@ -=head1 NAME - -TheSchwartz::Worker::PubSubHubbubPublish - ping pubsubhubbub hub servers - -=head1 SYNOPSIS - - use TheSchwartz; - use TheSchwartz::Worker::PubSubHubbubPublish; - my $sclient = TheSchwartz->new(databases => \@Conf::YOUR_DBS); - $sclient->can_do("TheSchwartz::Worker::PubSubHubbubPublish"); - $sclient->work; # main loop of program; goes forever, pinging as needed - -=head1 DESCRIPTION - -This is a worker class for sending pings to PubSubHubbub hub servers. -See L and L for more -information. - -=head1 JOB ARGUMENTS - -When constructing a job using L's insert_job -method, construct your L instance with its -'argument' of the following form: - - { - hub => $hub_url, # the hub's endpoint URL - topic_url => $url, # Atom URL that was updated - } - -Also, if you set your L's C property to be -the hub URL, this worker will do batch pings instead, vastly reducing -the number of HTTP requests it does. - -=cut - -package TheSchwartz::Worker::PubSubHubbubPublish; -use strict; -use base 'TheSchwartz::Worker'; -use Storable; -use Net::PubSubHubbub::Publisher 0.91; - -our $VERSION = '1.00'; - -our $MAX_BATCH_SIZE = 50; - -my $keep_exit_status_for = 0; -sub set_keep_exit_status_for { $keep_exit_status_for = shift; } - -my %publisher; # $hub -> Net::PubSubHubbub::Publisher - -sub work { - my ($class, $job) = @_; - my $client = $job->handle->client; - my $hub = $job->arg->{hub}; - unless ($hub && $hub =~ m!^https?://\S+$!) { - $job->permanent_failure("Bogus hub $hub. Ignoring job."); - return; - } - - my @jobs; - my @topics; - - my $add_job = sub { - my $j = shift; - my $args = $j->arg; - unless ($args->{hub} eq $hub) { - # Each job must share the same hub. - warn "WARNING: coalesced job had different hub in its args. Skipping."; - return; - } - - push @jobs, $j; - push @topics, $args->{topic_url}; - }; - $add_job->($job); - - my $publisher = $publisher{$hub} ||= - Net::PubSubHubbub::Publisher->new(hub => $hub); - - while (@topics < $MAX_BATCH_SIZE) { - my $j = $client->find_job_with_coalescing_value(__PACKAGE__, $hub); - last unless $j; - $add_job->($j); - } - - if ($publisher->publish_update(@topics)) { - warn "Pinged $hub about topic(s): @topics.\n"; - foreach my $j (@jobs) { - $j->completed; - } - return; - } - - my $failure_reason = $publisher->last_response->status_line; - warn "Failed to ping $hub about @topics: $failure_reason\n"; - $job->failed($failure_reason); -} - -sub keep_exit_status_for { - return 0 unless $keep_exit_status_for; - return $keep_exit_status_for->() if ref $keep_exit_status_for eq "CODE"; - return $keep_exit_status_for; -} - -sub grab_for { 30 } -sub max_retries { 10 } -sub retry_delay { - my ($class, $fails) = @_; - return 30 * $fails; -} - -=head1 AUTHOR - -Brad Fitzpatrick -- brad@danga.com - -=head1 COPYRIGHT, LICENSE, and WARRANTY - -Copyright 2009, Brad Fitzpatrick. - -License to use under the same terms as Perl itself. - -This software comes with no warranty of any kind. - -=head1 SEE ALSO - -L - -L - -=cut - -1; diff --git a/publisher_clients/perl-schwartz/t/00-use.t b/publisher_clients/perl-schwartz/t/00-use.t deleted file mode 100644 index 174ff43..0000000 --- a/publisher_clients/perl-schwartz/t/00-use.t +++ /dev/null @@ -1,5 +0,0 @@ -#!/usr/bin/perl -use Test::More tests => 1; -BEGIN { - use_ok( 'TheSchwartz::Worker::PubSubHubbubPublish' ); -} diff --git a/publisher_clients/perl/.gitignore b/publisher_clients/perl/.gitignore deleted file mode 100644 index 960abec..0000000 --- a/publisher_clients/perl/.gitignore +++ /dev/null @@ -1 +0,0 @@ -svn-commit.tmp diff --git a/publisher_clients/perl/.shipit b/publisher_clients/perl/.shipit deleted file mode 100644 index d1a416d..0000000 --- a/publisher_clients/perl/.shipit +++ /dev/null @@ -1,5 +0,0 @@ -steps = FindVersion, ChangeVersion, CheckChangeLog, DistTest, Commit, Tag, MakeDist, UploadCPAN -svn.tagpattern = Net-PubSubHubbub-Publisher-perl-%v - - - diff --git a/publisher_clients/perl/ChangeLog b/publisher_clients/perl/ChangeLog deleted file mode 100644 index dcb7570..0000000 --- a/publisher_clients/perl/ChangeLog +++ /dev/null @@ -1,7 +0,0 @@ -0.91: 2009-04-26 - - * Multi-topic support; better docs. - -0.90: 2009-04-26 - - * Initial release. diff --git a/publisher_clients/perl/MANIFEST b/publisher_clients/perl/MANIFEST deleted file mode 100644 index 32e29e7..0000000 --- a/publisher_clients/perl/MANIFEST +++ /dev/null @@ -1,6 +0,0 @@ -ChangeLog -pubsubhubbub-publish -lib/Net/PubSubHubbub/Publisher.pm -Makefile.PL -MANIFEST This list of files -t/00-use.t diff --git a/publisher_clients/perl/Makefile.PL b/publisher_clients/perl/Makefile.PL deleted file mode 100644 index 607f4c7..0000000 --- a/publisher_clients/perl/Makefile.PL +++ /dev/null @@ -1,17 +0,0 @@ -#!/usr/bin/perl -use strict; -use ExtUtils::MakeMaker; - -WriteMakefile( NAME => 'Net::PubSubHubbub::Publisher', - VERSION_FROM => 'lib/Net/PubSubHubbub/Publisher.pm', - EXE_FILES => [ 'pubsubhubbub-publish' ], - PREREQ_PM => { - 'LWP::UserAgent' => 0, - }, - ABSTRACT_FROM => 'lib/Net/PubSubHubbub/Publisher.pm', - AUTHOR => 'Brad Fitzpatrick ', - ); - - - - diff --git a/publisher_clients/perl/lib/Net/PubSubHubbub/Publisher.pm b/publisher_clients/perl/lib/Net/PubSubHubbub/Publisher.pm deleted file mode 100644 index 6429ac2..0000000 --- a/publisher_clients/perl/lib/Net/PubSubHubbub/Publisher.pm +++ /dev/null @@ -1,123 +0,0 @@ -package Net::PubSubHubbub::Publisher; -use strict; -use LWP::UserAgent; -use HTTP::Request::Common; -use Carp qw(croak); - -=head1 NAME - -Net::PubSubHubbub::Publisher - client library to ping a PubSubHubbub hub - -=head1 OVERVIEW - - my $pub = Net::PubSubHubbub::Publisher->new(hub => $hub); - $pub->publish_update($atom_topic_url) or - die "Ping failed: " . $pub->last_response->status_line; - -=cut - -our $VERSION = "0.91"; - -=head1 CONSTRUCTOR - -=over 4 - -=item C(hub => $hub[, ua => $ua]) - -Takes a required hub URL, and an optional L instance. - -=back - -=cut - -sub new { - my ($class, %opts) = @_; - my $ua = delete $opts{ua}; - my $hub = delete $opts{hub}; - unless ($hub) { - croak("Required option 'hub' not set."); - } - unless ($hub =~ m!^https?://!) { - croak("Bogus hub URL of $hub"); - } - if (%opts) { - die "Unknown options: " . join(", ", sort keys %opts); - } - unless ($ua) { - $ua = LWP::UserAgent->new( - keep_alive => 1, - agent => "Net-PubSubHubbub-Publisher-perl/$VERSION", - ); - } - return bless { - ua => $ua, - hub => $hub, - }, $class; -} - -=head1 METHODS - -=over 4 - -=item C($topic_url) - -=item C(@topic_urls) - -Sends a ping that the provided Topic URL(s) has/have been updated. - -Returns true on success. If false, see C to figure out -why it failed. - -=cut - -sub publish_update { - my ($self, @urls) = @_; - croak "No URL(s) provided" unless @urls; - foreach my $url (@urls) { - croak("Bogus URL: $url") unless $url =~ m!^https?://!; - } - my @args = ("hub.mode" => "publish"); - push @args, map { ("hub.url" => $_) } @urls; - my $req = POST $self->{hub}, \@args; - my $res = $self->{last_res} = $self->{ua}->request($req); - return 1 if $res->is_success; - return 0; -} - -=item C() - -Returns the last L. Use this when C -fails to discover why it failed. - -=cut - -sub last_response { - my $self = shift; - return $self->{last_res}; -} - -1; - -=back - -=head1 COPYRIGHT & LICENSE - -This module is Copyright (c) 2009 Brad Fitzpatrick. -All rights reserved. - -You may distribute under the terms of either the GNU General Public -License or the Artistic License, as specified in the Perl README file. - -=head1 WARRANTY - -This is free software. IT COMES WITHOUT WARRANTY OF ANY KIND. - -=head1 AUTHOR - -Brad Fitzpatrick - -=head1 SEE ALSO - -L -- PubSubHubbub home - -=cut diff --git a/publisher_clients/perl/pubsubhubbub-publish b/publisher_clients/perl/pubsubhubbub-publish deleted file mode 100755 index fbb96d4..0000000 --- a/publisher_clients/perl/pubsubhubbub-publish +++ /dev/null @@ -1,48 +0,0 @@ -#!/usr/bin/perl -# -*-perl-*- - -use strict; -use lib 'lib'; -use Net::PubSubHubbub::Publisher; -use Getopt::Long; -use LWP::Simple (); - -sub usage { - my $err = shift; - if ($err) { - warn "ERROR: $err\n\n"; - } - print STDERR < [ ...] - -Pings the hub, notifying the hub that the provided 'topic_url' has -been updated. - -Options: ---hub= Which hub endpoint to ping. Defaults - to the open, reference hub, but you need to use whatever hub - that your Topic URL references. - -END - - exit(1); -} - -my $hub = "http://pubsubhubbub.appspot.com/"; -GetOptions("hub=s" => \$hub) - or usage(); - -my @topic_urls = @ARGV or usage("topic_url required."); -foreach my $url (@topic_urls) { - usage("Bogus topic URL: $url") - unless $url =~ m!^https?://\S+$!; -} - -usage("No hub provided.") - unless $hub && $hub =~ m!^https?://\S+$!; - -my $publisher = Net::PubSubHubbub::Publisher->new(hub => $hub); -unless ($publisher->publish_update(@topic_urls)) { - warn "Error pinging hub: " . $publisher->last_response->status_line; - exit(1); -} diff --git a/publisher_clients/perl/t/00-use.t b/publisher_clients/perl/t/00-use.t deleted file mode 100644 index 897cd1e..0000000 --- a/publisher_clients/perl/t/00-use.t +++ /dev/null @@ -1,8 +0,0 @@ -#!/usr/bin/perl -# -*-perl -*- - -use strict; -use Test::More tests => 1; - -use_ok("Net::PubSubHubbub::Publisher"); - diff --git a/publisher_clients/php/README.txt b/publisher_clients/php/README.txt deleted file mode 100644 index 3d27c40..0000000 --- a/publisher_clients/php/README.txt +++ /dev/null @@ -1,21 +0,0 @@ -This PHP library for PubSubHubbub was written by Josh Fraser (joshfraser.com) and is released under the Apache 2.0 License - -Usage: -// specify which hub you want to use. in this case we'll use the demo hub on app engine. -$hub_url = "http://pubsubhubbub.appspot.com/"; - -// create a new pubsubhubbub publisher -$p = new Publisher($hub_url); - -// specify the feed that has been updated -$topic_url = "http://www.onlineaspect.com"; - -// notify the hub that the specified topic_url (ATOM feed) has been updated -// alternatively, publish_update() also accepts an array of topic urls -if ($p->publish_update($topic_url)) { -    echo "$topic_url was successfully published to $hub_url"; -} else { -    echo "Ooops..."; -    print_r($p->last_response()); -} - \ No newline at end of file diff --git a/publisher_clients/php/examples/publisher_example.php b/publisher_clients/php/examples/publisher_example.php deleted file mode 100644 index 5b5ec8a..0000000 --- a/publisher_clients/php/examples/publisher_example.php +++ /dev/null @@ -1,51 +0,0 @@ -"; - -// process form -if ($_POST['sub']) { - - $hub_url = $_POST['hub_url']; - $topic_url = $_POST['topic_url']; - - // check that a hub url is specified - if (!$hub_url) { - echo "Please specify a hub url.

back"; - exit(); - } - // check that a topic url is specified - if (!$topic_url) { - echo "Please specify a topic url to publish.

back"; - exit(); - } - - // $hub_url = "http://pubsubhubbub.appspot.com/publish"; - $p = new Publisher($hub_url); - if ($p->publish_update($topic_url)) { - echo "$topic_url was successfully published to $hub_url

back"; - } else { - echo "ooops..."; - print_r($p->last_response()); - } - -} else { - - // display a primitive form for testing - echo "
"; - echo "hub url:
"; - echo "topic url:
"; - echo "
"; - echo "
"; - -} - -echo ""; - -?> \ No newline at end of file diff --git a/publisher_clients/php/library/publisher.php b/publisher_clients/php/library/publisher.php deleted file mode 100644 index f176a9b..0000000 --- a/publisher_clients/php/library/publisher.php +++ /dev/null @@ -1,86 +0,0 @@ -hub_url = $hub_url; - } - - // accepts either a single url or an array of urls - public function publish_update($topic_urls, $http_function = false) { - if (!isset($topic_urls)) - throw new Exception('Please specify a topic url'); - - // check that we're working with an array - if (!is_array($topic_urls)) { - $topic_urls = array($topic_urls); - } - - // set the mode to publish - $post_string = "hub.mode=publish"; - // loop through each topic url - foreach ($topic_urls as $topic_url) { - - // lightweight check that we're actually working w/ a valid url - if (!preg_match("|^https?://|i",$topic_url)) - throw new Exception('The specified topic url does not appear to be valid: '.$topic_url); - - // append the topic url parameters - $post_string .= "&hub.url=".urlencode($topic_url); - } - - // make the http post request and return true/false - // easy to over-write to use your own http function - if ($http_function) - return $http_function($this->hub_url,$post_string); - else - return $this->http_post($this->hub_url,$post_string); - } - - // returns any error message from the latest request - public function last_response() { - return $this->last_response; - } - - // default http function that uses curl to post to the hub endpoint - private function http_post($url, $post_string) { - - // add any additional curl options here - $options = array(CURLOPT_URL => $url, - CURLOPT_POST => true, - CURLOPT_POSTFIELDS => $post_string, - CURLOPT_USERAGENT => "PubSubHubbub-Publisher-PHP/1.0"); - - $ch = curl_init(); - curl_setopt_array($ch, $options); - - $response = curl_exec($ch); - $this->last_response = $response; - $info = curl_getinfo($ch); - - curl_close($ch); - - // all good - if ($info['http_code'] == 204) - return true; - return false; - } -} - -?> \ No newline at end of file diff --git a/publisher_clients/python/CHANGES b/publisher_clients/python/CHANGES deleted file mode 100644 index b7f18d1..0000000 --- a/publisher_clients/python/CHANGES +++ /dev/null @@ -1,2 +0,0 @@ -1.00 (2009-05-17) - * First release. diff --git a/publisher_clients/python/pubsubhubbub_publish.py b/publisher_clients/python/pubsubhubbub_publish.py deleted file mode 100644 index 9ae6e66..0000000 --- a/publisher_clients/python/pubsubhubbub_publish.py +++ /dev/null @@ -1,77 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Simple Publisher client for PubSubHubbub. - -Example usage: - - from pubsubhubbub_publish import * - try: - publish('http://pubsubhubbub.appspot.com', - 'http://example.com/feed1/atom.xml', - 'http://example.com/feed2/atom.xml', - 'http://example.com/feed3/atom.xml') - except PublishError, e: - # handle exception... - -Set the 'http_proxy' environment variable on *nix or Windows to use an -HTTP proxy. -""" - -__author__ = 'bslatkin@gmail.com (Brett Slatkin)' - -import urllib -import urllib2 - - -class PublishError(Exception): - """An error occurred while trying to publish to the hub.""" - - -URL_BATCH_SIZE = 100 - - -def publish(hub, *urls): - """Publishes an event to a hub. - - Args: - hub: The hub to publish the event to. - **urls: One or more URLs to publish to. If only a single URL argument is - passed and that item is an iterable that is not a string, the contents of - that iterable will be used to produce the list of published URLs. If - more than URL_BATCH_SIZE URLs are supplied, this function will batch them - into chunks across multiple requests. - - Raises: - PublishError if anything went wrong during publishing. - """ - if len(urls) == 1 and not isinstance(urls[0], basestring): - urls = list(urls[0]) - - for i in xrange(0, len(urls), URL_BATCH_SIZE): - chunk = urls[i:i+URL_BATCH_SIZE] - data = urllib.urlencode( - {'hub.url': chunk, 'hub.mode': 'publish'}, doseq=True) - try: - response = urllib2.urlopen(hub, data) - except (IOError, urllib2.HTTPError), e: - if hasattr(e, 'code') and e.code == 204: - continue - error = '' - if hasattr(e, 'read'): - error = e.read() - raise PublishError('%s, Response: "%s"' % (e, error)) diff --git a/publisher_clients/python/pubsubhubbub_publish_test.py b/publisher_clients/python/pubsubhubbub_publish_test.py deleted file mode 100755 index 09a185b..0000000 --- a/publisher_clients/python/pubsubhubbub_publish_test.py +++ /dev/null @@ -1,139 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Tests for the pubsubhubbub_publish module.""" - -__author__ = 'bslatkin@gmail.com (Brett Slatkin)' - -import BaseHTTPServer -import urllib -import unittest -import threading - -import pubsubhubbub_publish - - -REQUESTS = 0 - - -class RequestHandler(BaseHTTPServer.BaseHTTPRequestHandler): - def do_POST(self): - global REQUESTS - print 'Accessed', self.path - REQUESTS += 1 - - length = int(self.headers.get('content-length', 0)) - if not length: - return self.send_error(500) - body = self.rfile.read(length) - - if self.path == '/single': - if body != urllib.urlencode( - {'hub.url': 'http://example.com/feed', 'hub.mode': 'publish'}): - self.send_error(500) - self.wfile.write('Bad body. Found:') - self.wfile.write(body) - else: - self.send_response(204) - elif self.path == '/multiple': - if body != urllib.urlencode( - {'hub.url': ['http://example.com/feed', - 'http://example.com/feed2', - 'http://example.com/feed3'], - 'hub.mode': 'publish'}, doseq=True): - self.send_error(500) - self.wfile.write('Bad body. Found:') - self.wfile.write(body) - else: - self.send_response(204) - elif self.path == '/batch': - self.send_response(204) - elif self.path == '/fail': - self.send_error(400) - self.wfile.write('bad argument') - else: - self.send_error(404) - - -class PublishTest(unittest.TestCase): - - def setUp(self): - global REQUESTS - REQUESTS = 0 - self.server = BaseHTTPServer.HTTPServer(('', 0), RequestHandler) - t = threading.Thread(target=self.server.serve_forever) - t.setDaemon(True) - t.start() - self.hub = 'http://%s:%d' % ( - self.server.server_name, self.server.server_port) - self.feed = 'http://example.com/feed' - self.feed2 = 'http://example.com/feed2' - self.feed3 = 'http://example.com/feed3' - - def testSingle(self): - pubsubhubbub_publish.publish(self.hub + '/single', self.feed) - self.assertEquals(1, REQUESTS) - - def testMultiple(self): - pubsubhubbub_publish.publish(self.hub + '/multiple', - self.feed, self.feed2, self.feed3) - - def testList(self): - pubsubhubbub_publish.publish(self.hub + '/multiple', - [self.feed, self.feed2, self.feed3]) - - def testIterable(self): - pubsubhubbub_publish.publish(self.hub + '/multiple', - iter([self.feed, self.feed2, self.feed3])) - - def testBatchSizeLimit(self): - old = pubsubhubbub_publish.URL_BATCH_SIZE - try: - pubsubhubbub_publish.URL_BATCH_SIZE = 2 - pubsubhubbub_publish.publish(self.hub + '/batch', - [self.feed, self.feed2, self.feed3]) - finally: - pubsubhubbub_publish.URL_BATCH_SIZE = old - self.assertEquals(2, REQUESTS) - - def testBadHubHostname(self): - self.assertRaises( - pubsubhubbub_publish.PublishError, - pubsubhubbub_publish.publish, - 'http://asdf.does.not.resolve', self.feed) - - def testBadArgument(self): - self.assertRaises( - pubsubhubbub_publish.PublishError, - pubsubhubbub_publish.publish, - self.hub + '/fail', self.feed) - - def testBadHubUrl(self): - self.assertRaises( - pubsubhubbub_publish.PublishError, - pubsubhubbub_publish.publish, - 'not://a.url.is.this', self.feed) - - def testNotFound(self): - self.assertRaises( - pubsubhubbub_publish.PublishError, - pubsubhubbub_publish.publish, - self.hub + '/unknown', self.feed) - - -if __name__ == '__main__': - unittest.main() diff --git a/publisher_clients/python/setup.py b/publisher_clients/python/setup.py deleted file mode 100644 index 756f967..0000000 --- a/publisher_clients/python/setup.py +++ /dev/null @@ -1,36 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2009 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -from distutils.core import setup - - -LONG_DESC = ( - 'A simple, open, server-to-server web-hook-based pubsub ' - '(publish/subscribe) protocol as a simple extension to Atom. ' - 'Parties (servers) speaking the PubSubHubbub protocol can get ' - 'near-instant notifications (via webhook callbacks) when a topic ' - '(Atom URL) they\'re interested in is updated.') - -setup(name='PubSubHubbub_Publisher', - version='1.0', - description='Publisher client for PubSubHubbub', - long_description=LONG_DESC, - author='Brett Slatkin', - author_email='bslatkin@gmail.com', - url='http://code.google.com/p/pubsubhubbub/', - py_modules=['pubsubhubbub_publish'], - license="Apache 2.0") diff --git a/publisher_clients/wordpress/1.0/publisher.php b/publisher_clients/wordpress/1.0/publisher.php deleted file mode 100644 index f176a9b..0000000 --- a/publisher_clients/wordpress/1.0/publisher.php +++ /dev/null @@ -1,86 +0,0 @@ -hub_url = $hub_url; - } - - // accepts either a single url or an array of urls - public function publish_update($topic_urls, $http_function = false) { - if (!isset($topic_urls)) - throw new Exception('Please specify a topic url'); - - // check that we're working with an array - if (!is_array($topic_urls)) { - $topic_urls = array($topic_urls); - } - - // set the mode to publish - $post_string = "hub.mode=publish"; - // loop through each topic url - foreach ($topic_urls as $topic_url) { - - // lightweight check that we're actually working w/ a valid url - if (!preg_match("|^https?://|i",$topic_url)) - throw new Exception('The specified topic url does not appear to be valid: '.$topic_url); - - // append the topic url parameters - $post_string .= "&hub.url=".urlencode($topic_url); - } - - // make the http post request and return true/false - // easy to over-write to use your own http function - if ($http_function) - return $http_function($this->hub_url,$post_string); - else - return $this->http_post($this->hub_url,$post_string); - } - - // returns any error message from the latest request - public function last_response() { - return $this->last_response; - } - - // default http function that uses curl to post to the hub endpoint - private function http_post($url, $post_string) { - - // add any additional curl options here - $options = array(CURLOPT_URL => $url, - CURLOPT_POST => true, - CURLOPT_POSTFIELDS => $post_string, - CURLOPT_USERAGENT => "PubSubHubbub-Publisher-PHP/1.0"); - - $ch = curl_init(); - curl_setopt_array($ch, $options); - - $response = curl_exec($ch); - $this->last_response = $response; - $info = curl_getinfo($ch); - - curl_close($ch); - - // all good - if ($info['http_code'] == 204) - return true; - return false; - } -} - -?> \ No newline at end of file diff --git a/publisher_clients/wordpress/1.0/pubsubhubbub.php b/publisher_clients/wordpress/1.0/pubsubhubbub.php deleted file mode 100755 index 7c2c668..0000000 --- a/publisher_clients/wordpress/1.0/pubsubhubbub.php +++ /dev/null @@ -1,179 +0,0 @@ -PubSubHubbub settings page -Version: 1.1 -Author: Josh Fraser -Author Email: josh@eventvue.com -Author URI: http://www.joshfraser.com -*/ - -include("publisher.php"); - -// function that is called whenever a new post is published -function publish_to_hub($post_id) { - - // we want to notify the hub for every feed - $feed_urls = array(); - $feed_urls[] = get_bloginfo('atom_url'); - $feed_urls[] = get_bloginfo('rss_url'); - $feed_urls[] = get_bloginfo('rdf_url'); - $feed_urls[] = get_bloginfo('rss2_url'); - // remove dups (ie. they all point to feedburner) - $feed_urls = array_unique($feed_urls); - // get the address of the publish endpoint on the hub - $hub_url = get_pubsub_endpoint(); - $p = new Publisher($hub_url); - // need better error handling - if (!$p->publish_update($feed_urls, "http_post_wp")) { - print_r($p->last_response()); - } - return $post_id; -} - -function add_atom_link_tag() { - $sub_url = get_pubsub_endpoint(); - echo ''; -} - -function add_rss_link_tag() { - $sub_url = get_pubsub_endpoint(); - echo ''; -} - -function add_rdf_ns_link() { - echo 'xmlns:atom="http://www.w3.org/2005/Atom"'; -} - -// hack to add the atom definition to the RSS feed -// start capturing the feed output. this is run at priority 9 (before output) -function start_rss_link_tag() { - ob_start(); -} - -// this is run at priority 11 (after output) -// add in the xmlns atom definition link -function end_rss_link_tag() { - $feed = ob_get_clean(); - $pattern = '//i'; - $replacement = ''; - // change to - echo preg_replace($pattern, $replacement, $feed); -} - -// add a link to our settings page in the WP menu -function add_plugin_menu() { - add_options_page('PubSubHubbub Settings', 'PubSubHubbub', 8, __FILE__, 'add_settings_page'); -} - -// get the endpoints from the wordpress options table -// valid parameters are "publish" or "subscribe" -function get_pubsub_endpoint() { - $endpoint = get_option('pubsub_endpoint'); - - // if no values have been set, revert to the defaults (pubsubhubbub on app engine) - if (!$endpoint) { - $endpoint = "http://pubsubhubbub.appspot.com"; - } - return $endpoint; -} - -// write the content for our settings page that allows you to define your endpoints -function add_settings_page() { ?> -
-

Define a custom endpoint

- -
- - - - - - - - - - - -
Endpoint URL:
- - - - -

- -

- -
- -

- Thanks for using PubSubHubbub. Learn more about PubSubHubbub and author of this plugin: - - -
- -agent = "(PubSubHubbub-Publisher-WP/1.0)"; - $snoopy->submit($url,$post_vars); - $response = $snoopy->results; - // TODO: store the last_response. requires a litle refactoring work. - $response_code = $snoopy->response_code; - if ($response_code == 204) - return true; - return false; -} - - -// attach the handler that gets called every time you publish a post -add_action('publish_post', 'publish_to_hub'); -// add the link to our settings page in the WP menu structure -add_action('admin_menu', 'add_plugin_menu'); - -// add the link tag that points to the hub in the header of our template... - -// to our atom feed -add_action('atom_head', 'add_atom_link_tag'); -// to our RSS 0.92 feed (requires a bit of a hack to include the ATOM namespace definition) -add_action('do_feed_rss', 'start_rss_link_tag', 9); // run before output -add_action('do_feed_rss', 'end_rss_link_tag', 11); // run after output -add_action('rss_head', 'add_rss_link_tag'); -// to our RDF / RSS 1 feed -add_action('rdf_ns', 'add_rdf_ns_link'); -add_action('rdf_header', 'add_rss_link_tag'); -// to our RSS 2 feed -add_action('rss2_head', 'add_rss_link_tag'); -// to our main HTML header -- not sure if we want to include this long-term or not. -add_action('wp_head', 'add_atom_link_tag'); - -?> \ No newline at end of file diff --git a/publisher_clients/wordpress/1.0/readme.txt b/publisher_clients/wordpress/1.0/readme.txt deleted file mode 100644 index 767ac25..0000000 --- a/publisher_clients/wordpress/1.0/readme.txt +++ /dev/null @@ -1,43 +0,0 @@ -=== Plugin Name === -Contributors: joshfraz -Donate link: https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=5426516 -Tags: pubsubhubbub -Requires at least: 2.5 -Tested up to: 2.7 -Stable tag: /trunk/ - -A better way to tell the world when your blog is updated. - -== Description == - -This plugin that implements [the PubSubHubbub protocol](http://pubsubhubbub.googlecode.com/svn/trunk/pubsubhubbub-core-0.1.html "the PubSubHubbub protocol"). [PubSubHubbub](http://code.google.com/p/pubsubhubbub/ "PubSubHubbub") is a simple, open, server-to-server web-hook-based pubsub (publish/subscribe) protocol as a simple extension to Atom and RSS. - -Parties (servers) speaking the PubSubHubbub protocol can get near-instant notifications (via webhook callbacks) when a topic (feed URL) they're interested in is updated. - -This plugin: - -* Notifies your specified hub each time you publish a new post -* Announces your specified hub by adding `` to your template header and ATOM feed -* Adds `` to your RSS feeds along with the necessary XMLNS declaration for RSS 0.92/1.0 - -The PubSubHubbub protocol is decentralized and free. No company is at the center of this controlling it. Anybody can run a hub, or anybody can ping (publish) or subscribe using open hubs. If no custom hub is specified, this plugin will use the demonstration hub that is running on Google App Engine. - -== Installation == - -1. Upload the `pubsubhubbub` directory to your `/wp-content/plugins/` directory -2. Activate the plugin through the 'Plugins' menu in WordPress -3. Select a custom hub under your PubSubHubbub Settings (optional) - -== Frequently Asked Questions == - -= Where can I learn more about the PubSubHubbub protocol? = - -You can visit [PubSubHubbb on Google Code](http://code.google.com/p/pubsubhubbub/ "PubSubHubbb on Google Code") - -= Where can I learn more about the author of this plugin? = - -You can learn more about [Josh Fraser](http://www.joshfraser.com "Josh Fraser") at [Online Aspect](http://www.onlineaspect.com "Online Aspect") - -== Screenshots == - -1. The PubSubHubbub Settings page allows you to define custom endpoints for your chosen hub diff --git a/publisher_clients/wordpress/1.0/screenshot-1.png b/publisher_clients/wordpress/1.0/screenshot-1.png deleted file mode 100644 index 91d84af1af8e35d7eabef76e6e6cea1677c4c549..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 14558 zcmb`ubx>SQ&^L-(a0nh;f(N(Y?(R--cemh92=2k%-3jjQu#n*HEDqn24Sz8frDbU}Z7vJe(l zkQ5dsR&ca4wXik;19Jzji03!QP$U@aN>-rJ2uxCPL1mV3k)R-t+%#CJN3xj3`A)0a zGz!>>rA)p8P^4+~X=dp32@+sBI4NQlAtRH9MG&7<{@PVQ6+F84anmU^aJYbVJ9FB2 z?A-9`+GvB!Jxa4_A_ZGXq8({DxJ#|u+w8^1>A^8t3Jfab0jiX!{4fcg@G4o*i)EgsBAk( zVN~-{*s+}OoMm|4Utj9~|B)85$GG2Qlla-KSC;GuUi{Y?|Y*F|K8!b(dcl&&bpo z+|#yjs+#1gnDHGexROzpr%ab#yX$6#u!JkaTO5b>8ay-;vIpyvXh>F1ue-l+*FpLe zL1PSZ06d*{@BI>+A~GvHS%`}m5_?>9SMMv@o6N4KvL1Ov+;6ZWeu4>DLX>ygTZ zE77y&K?1=q$V$((;M>WP&vZG*+8yRAHw)UN_Ct-x=R}#TZbqW;G6N+-{4J0R!P`q{ zI)Q<`!+86EgQaEQfPoQ%Ns0)nxPzZ$!s{f=zr4mWaR&BMehh;P7Yg`j+Y%olEoNa) zJ&H(oMOk0sF}_x-Q@Q({e_E>8D(#)7XN!>w8ir&)5@YcXe~19$$ZyuYeTayQuO3O7 zsfPZB$1giq?e62BC%HDRo_!}DGZwFWCYVul2|v3F*!zRQ{k>A+yT9zJAOncOApTy6 z;6d8gkf>nbZ`UUt5LHJO@`nJ?0?ndCfA4^S*I@`Wv+)?={6~Yj{nrfC?dvi<&L`rk zF|M1@)C?MG5+lY}GfEWHb?WjOr?Wls#!m_m!?7Q~7LL?!*L(S~(i~cq7R;2E4luFo z#W@u7&^KfSQXcuL^3idi@Yx+yeq#p1^1Z8zsN?Rt5>h9<$b*|C-59^yFI>tp=ChqR>$$_PL@cy*axd=O$r`PEMBKd<7@z$# zmON!H-Q@2zagoMnO^t3zCddy6^V&0cE9x2|JyyWA1b?ugg9Hi>j!$1q&~&P#^cfq_ zHrxQ$Tl=svI%p>~G&bAzO4y4ijPQl;@%$y1o`laPy!mo9oC9adRStP9dCKChkNWyi z^30b5q0|$2bAp%?T+&>#wcfy@UOCnLjo((S2(Bq1Gb7Wmcw>i0*~H?z!T_{n^JSL7r_Ux4c~mUbhhY z=H|vqcRrma(iS@*X^}%qi|hJ$byBz_qWF+HQJUTwP|R-O@iHC|@h~8ExM9zjY>H|T zP|sRaT`Wb4x_o`SMHe^XVr z^c|zk)C!`_a==u*=vePtZF-iL*0%vlRrp7@CYwu)`10q-CaN-5t7X_pkB6Slyu%(5 z%ywhp9}8*~Nit>iR#`)%v$_1SojDyGgC27kiB|(hZP8_sSeZQaF8bd`xF~ylm%h)V zb-Y8NU$0!TrT28xCRdIVrfsZC|Ji)`64@9;y|;cPfA&I0DO!=ti*fH3Tm89MaeMuA z=N*pBoJ4o7Y@K%si-qEGB_q0Hy$*H@ES(l>q+?+y7Vo3KiQfrY!%cNa{qwQ>A|EwR z+d*9~p2Ue6gEnt4?d1NH6RT>WU){kdEnYm`Ke{iUl}t+o6=ETL)3Lccg5E zJt0trpGQ#bc;KXKEuR|vN{v3+eSAatnKZq`v*x?7&2`udNHvBOo>{+dUw->ls?vmgdA(2$xyD+$@h#_!)tfndgpncS z?Vjxg`1FO5oW`h$q&2u)>?TOzogSz)nAnAO?4Q}VJ$sAE$_hFPweI!7tN3tW%dZYZ z$RL-L6W@Cmj;+%gj7T_m=s{nl5Rcx`^O0~VO9@}seQ90Xu8}ZFeYL>fdsz6X;p*8Nu9afqQ5A@{m+uvX zD;r#3*FDN8<6775SJoU-O4oduetmHf*gU`-Q&1LvyXBhS3g8{@$+eO`5uy!;eDf7V z40FSi1$z>9@uk&OUFu7(%#4KWNGXHHL{I2hCRmmQmveaUFL-TF+L`v;`nE?*z6<5w zzNLQEq23E;3>iy7W42QJ)yMSJ@C^2&s>6m6Rcv@&PZ3K&YC3(ijlPW*Iyxtr(a8Xq zmzqeDlX`=x^%!fB@|CiddvGQ^6?1q%YVP}1s1B}pjOHv4b!DZacIKVPUXB#Zs#KyN z#G=_AAs#c|uWgNb46b@H zvan_aq3MiQ+zg>lPEWaKJ-f30fUtWiosG=+XNYQVF%s~{*4>9VS_@Lq!%2z}=6MMZ z>Kp8aQCmEqR-<(ienm@gZ^Ai8b17wiRy;;c=tkc;$J0FoY1O$4Pg0QLBw1t7RrsPE zV9UvBw(;ysk$^}qpDwNtRWLoBwfOjhL1Wbnmz2MSW-6hx9B*^qm;2vqn;((H$i%J; zMc5VrTC;c~{ilIk^rw7TYlua`(tZr05-JgF2-QWJRKB~E{6)~wJ5ON0f2-%2n;h2A9ydJKhvV5nqCI{d4;{mY z=eR3E&1piBXWV9#^2CyJ_8ughs0u0F9s7_)Fv?GgQ|@8o31PL!MLZ8Itvo_J-D&xi@oH)j*!e8e0x>ok4giRdhl*`_r3N?na;I8) z_H;s?4D+gma>spiTRm(TCYOq2xnGcd5Kp*j~GlV%PN&z%2E=79DrL{hu}QLGA~Alcdd7fo92wg&aRo z@*u-S%jubo#z8@v-5i6_ZW()O<&(uxT6XGhVzidWEaPj zpf(k}vwhhs*|Fhi3i$-VH&{bYwQ9>$luN%n)a8*V$Jx1*F;TgdZAbO6513W5Ql_-x z8sKe z!yONklw661JQOk=MY-Z9xs;sa{Mx$Cz*yR0l#fq)7oSF|G%ejUW)m&6)z2nMchZ_P zMY+zJ<$d=hlXY7@sMVLP&5U7xG)rZ}P~FpoPIID^=|UWiNPbzY!w{6t{%J z<5yrm|U3IF2JEil6NSZscnsOUb{U0jWDpaKXIC4K% zP&4dJI?0hcqG^<gX%4*U`kIkLgXH$$tF4qp$MsS+UJbfuTxs{m#PbcK?1Q}K5bCwgD=L>G_QcZ- z!b~T|g60q#y^`9WtoZ8pb_7&ktG({HXal*ct)CcOib5|%W(eeKHf=trw&fV+i>EP+m zQ&LoLq~-2e|KyRrE~?a#h|OtuWU5n5szR-DJ>Y5E+BA8tA~JlKW0d0d-NbAC?Jr60 zfD7HrgEF~*!kLV+F2cv(Vz_liG~=W32!xM}Xs+1vx^3r2w_R%n>H!7!&`N{rr@T;! z>Woi#kF-}>&@}0~9~+$P4@th8>UEqutw95yQEJOG99Od#DtT=PS!~m$a~7XxPT6g)4K59GHZ)^E7GvxI1IeW*aztUgg#Pq-5r)zy|&(PD;rLaHPqr+lVGo{EdBh<0HWZ324_G(_4Tjy(Y zxiZ8mS=H3pVCx`#pOxcNC9WQfV_iS;PQFRlU5$VN@_xHP_wu)?_TT;vLn#0w@E_D<9l7p zIY~R~aVBJQvfeV>Mf!nA+3Mvv@_nAAy>BLCsec6!cr~)@_MrWH<&}1r6H8b1>V7o|Tt0wzrGP!Ma1#1jYyM(%!EYRUs9un6}o|OGxRjFdDCI z2Nbk7)`oO0D_Rde5jF(}#t=!59F$!`lja1*D?4dEbiqoE9Pk?}pqb}ZH8oXFO%3bK z4h`4lriY8h$jM#bNO7}UjY=Q5l0KwUh{I}Uwo_V|NZ$KsDG}GYIy+83cKUv>`QW%r zZl+_p8w0($&T!qJMoB16AWSXcq_Eo$$Q``cT|wNBX}fO9kIWM$iLLKNlQ&2`OQMatZlR8n{Tp!<_3 zNr1%%%fuLw05ENhQBYUEMd#%zEXsd$CH_fH5gh!bM}X&as&IdK29s*eV-U3C}4`zOYVAjq;G zrWBz5qs2h9O*=8tA0z$gZ@-Fc{t@CIZ9@jqnqBW3%-bx3tl$d5zHMMxG5@nlBS>r; zd`5}Dzgi3Mz!9%CLgGdIr`GBl9gUs;w(3CFj}K5$?R_;L@D%f}P>1MC4nHS~%7X3@ zszPLSwDAX(lC1GT4aL@m*T{47j?4=KK%EF(Ah2x{`7>xU%3T9W2C>QI6_E)4u6}o8RQ*WnsI8rJYcGGBWiMg{o3S7@ zlwarRCDf01ZNgj@kYM85$N9SJQZPAF-ciqecGe}vvZJ|SrAoiQW9K`(t+P|tbKAJ# zY(*l7{6~jhio{b)@xxhPor?GjXO{%<@cMYQE0oMldP%HZ;ORGeUS^ZL?>K9&Fs&$# z^f0rRS{_DI`0Bc}uSPIhJ@PMNO(kW7Ag^+W9d{$6Qf`2Etz}&=-XyfHqo12dBqxDr z)OAbV-v7A~6U0fRbE{UiugS|hpZW01fUPohA8DAbr<^%P!#YDt^4Sa9F1N z5dPWN%V>PPLVW(moka{|fkmblNa+02yF!yt=|{1kSnkK$=w$Lfi(j(n~%QgM@ zMwal@;hLOhRIde~yiduGY%2-X#DHtX2+LTT9j?Kb z#%+Nvjs?aS>8s{Sx&XVs-Xtg4-8XEUr75*pGnzc1Bf%Yi%fqr-TFfZjrJX?ddVk2~ z<%#G*#x~z|x{}c^vqUpdo{Hv?Frf9?HIYq2`z5kYP+HS?a9~K}tcIb1ZQjh4aov?P zTkejsGPQ-9nKD^M^KST3k(`$O@|lB!LWu=IayqrF#BAcis!6p;S-SGY>1LHk7yY)W zvSgwI_1VU#GuY)U$F)3BPhKvCeJPFCW;ImBQD4pNs?QhC3jX5a;#09O3GHYZb*qY4 zAP@3CpPM3`V#-^+e#W2GY#>?Pe7vnz*E-kq{dENIbJ+O~>9cdwzLxKeLKRPFym{es z&rtLv@V(3#6^bv97WJ6Vqh0ta^H7Wq;AZ!dsCMF*r^8^aI!|&wsF^-ik0S@$W1;Mb zHpj|x3q{Y*tv0!qTs^e%cqb^hE&0{t*ZA`p{Ys{1Q@PsI)^M^}EN30<{Os%eVlNDh zbp6ibX%4!+uq1*UN=Mbrebw$JLnnPbfI2Kas_}fM=5h(teY}CKDM1 zoc+9OkF~fkgc#nYP^DjJI26kbu#F^z$+YDjg$0)yR$E87*RjD3&8pZ6jtd!IjTzDv z#GzJLrqhhBbMR7ApV^<1}XW}{rSqKMW9cX7_LCUxbi*#O(#Z7A2eR9%d z?Xsqqx9Z_~z-@OD?0cRDAe3K5jZD z!o2QMizS{zn9Lod4v#+=Sw%WI-rP$%ku4;$c@?uH*lM(qgydKFHUjDmiwKosZ23JT zObub62ob=e9~0q$F{dv9?kh8f#=?PXHrHcC<%s*WuE0977B*4*JsE!Q;FQ#P9Jlf69AP&N9am*3i_(dw>thB|4?F+|!dmidmY z&7ZF;WHEeGd_pp!?%cPhqZ!W+M|}ZJ+C8#H9IQ)su?ci~wSzl}#daHnJ@1@58FR?s ztG5c@*VANQ%^z0nLU&zYW@}_$^&W=(Lg}TlfNyvZO2Y2?lt~cfqcxv2uB=rNrJ+>x z92D|kZFQqD6iyvy6OMl;tJ=H*43nml}xXq%^Ne9G$PUPa` zX0StGU}5DE^xRIg#%R%;k^FAyJh{j@DYd`5S?k*0?RN0+8A!R{UJ71Q&ug&UF0J_g zXjoo>{C(A?Pv#r<^?CjZh)4bX%TZ6y;>i*LU$`n(`z`v-SFX#LayUH)nG#7yYti%8 zFURBvH53QK`bRZ-4%UOP@gdcgl)*NpR2fLLIasGu&p00jMwA_*xo#elV+VqqJbM-j z9Gp%f+Q)y&05liFjwfoWC25;2nGyZ&d;zc-uZB!gui@bQt2^jsN%!qe-dE(6-*sDM z5Xd~fkAs0>NxanpJpRHtYa)pXnF-I`p4qi;1X%QjR&Z(yN#bKtsxD6x+4t!7Ec92$ zpSM1X6iwsmo4CbT?+Pkm46@LeYl*I)RhE=IrpI1HLg>UsgzNoe)k`L!1!j%Q@eH7y zFjGId1A8^j3)jKi@y5>8)18_=7j2@*j^9)3$Nm^RK8qknx@T=tp-q-b zN>H0ox?d?^Wvlm|I4ox)S5{KYic?OBQ~s`R67#@U%RRZ#UIg&5yoF-Qw0bG*#a5oQ zMkpxCIk-WInBCf&4K1G<>SHlO$55uVa?0CfQF6Fu=3{EAW#WyX-oQR@mPt4#=gX{Wor6xOH)l2} z56?|=5XbO|IZgbOxDgLe^s|~&EY!k+>&TU>cjV21$^lx~ai&*ErTvUA#HAKxh$thD zoGPLw-p%yau&7NtQxsp%ajz5Mw}bh*1$-hW|>!KH+Eze+W~U*cuDzsIIzIScK%C`PSDpT*CAKrOZ1(z#RJvo{;D*0l7_c%ZCM z7&3l3iI0$EHd4o^Jt#mc?HN~2p-Ze7;E#a!@Xhx;OP`650{6?6QP=6}*2d=LJ9w4j zH7~ECXOM_Rl-0s%=86@A0xBR}C66#_&nJCMP4MV8zeut@kQ&-SJpACaPor|L|N6)_ z;O8bMBdl~nm0VEvmGQ?01s07quH^3SyyWQCJHm{WF2jR>*p2kwsCTNNBS;^j9%ef9 zH9Sv#20n~9n)-6uZaqQHIRMQm*Y051(9{`zUzxbESbVEj=JhDvPW4`S`0QM%;!B|) z@m%W>z!$Z)=Ud-R9_BR-+s@Z9ho-5V!jJ9zrEnPW*9=)KIqLpLh*#R*jd_QVynftY zAMpsy*IEvM*?Gyeb&Q#^d1pWCk9dRf#rrZwhUD53bOq0f#!L&Alr20waK+iX*f?UW zwJ?Ol3$BOm1|!wfzGC0g+eYNuk?n5+W;;~nO~#dROeBXd%vfscSmY|;@Z&{<^gm3F zX=x$omP~&boVjG4utmNtYHLW4hm5+(W;EHL9_Ar@J{_wXUQuPS4kPDomUh3cS@U8p zvjup5NGbUWSFU3o&j;omQ~h^^!De6|ji{tlSb(2Ra5ji6~b7R!5Kgdb$NJT=aU zhQG=vbL|Badv>Qt4rqfq<4sg6Ayzwf6%@A(Y~`b1hlJe6bNHp5&Il;^ILz1ZIbp%) zB;_}_1Wd`kk>P~J=MqofwvPeTNJAAaR=R^G*U28 z@4c<`SZ6omzt!TNBSCzS5^z~PRH#r`2#0q!kCHP7Lu1avO2@S#C8MMx*b)vcbpCoZ zw?Awc`P3*b1I)`{FHnO)_blT*U)hEvXxxESPUb6UH;YIi?voowS91Bibz(f*FL1M8 z;DNxg;rS~M9+uCjA$VZVw;wRv5y+=;>h>$|2O2Ax!StoVcZT1(Cgqa^z1rDCE)HCE z#l<+B7QP}PQ;Qk$tV2a&3fZ1`Dm^l~mA=s-nn1Xf1pIsSo4UAEKD9wbp{5U4b!7>X zDt%BR20Zkrc-!Ke&EKQoxT@{Pz6Kw=bpO8Q?Y)=CUz9g$)_c&+wZz3}JSHeNKOgBG z^)VHz*1HRy$u#*4lj-Z$Uo0XtJ-aawbm zHA2_%EW-(>LWC3x^ON2N{E(&<5&IidIOiOmI;~I2ilIf_Sm(~b^0n`!>`z`E!R4i$ z(<38dB3q13AIZOa8V&21iO63*{!Uy`{+)ylulUa1=y3A5!;sGjfIw*dYrvB=&jX>O zUtGTSnS}FZ4uZdQV`LztX`oC|MOB3wik-KuOt_I*TuqgNB=;1+CjHS^B|HGmx?UNH zCTF*7pGR4Qx9ti|>7-+wB{g4&6l3|ietIh=Un+NM>tp}Y+MDGn>?KJ`O24C}p8^tP zg?-q9rWLrAc`4}2PQ87!&)O=t4}ciD_RNy1yeAZ;z9LteQT2(}tYx+q zI)VNS;16dzyk0D;`(r-lH%?CYfiH5h0>nz|!CZ(C`1pL3Y$Ip!EyBf^+}V5^@_Z*yELj~mHQy7gp#=Lr!fd(}NA0tYE&{=W6r zS~uThd{%;XhEa~5!)@?Kc43Q1Hf0)*4P0K1Ggb~m1y&HX!!wS{Bm6t5En)e1oPlCR zg^uVsQ8L=s&JL(eILB{6VSwN&FlBuL4#X%JdIRi2pi)_0T{3MeIOl z;F(}O70YP7|Ix&2xhVgQy$nJj)Bb<%<{y{LnFiqdPZR;FH^`F8+*sw0#sa@4DgEsq z&6>cD|6+>H5Fq3;^GBSb=wHl;KOL;+BpU!x{ns8-@F0ZIH9$=4{a=Xj#Tp_Y>4Su< ztc@mE%m2WlV(`C01;o()p^#uuG8F#9#>()ypZ~$6I20gs8uPCJAegdS1;n!uUBu%b zzVk^61lE2e{nyyvzXS@^R+b{{^56Id2_Oq9iu`K~2Cn>OH7V4cf9$$Hg23&(u>TRJ z5FIpuiNquSFjId;5VQYVHhU`?!Gu32j-WB~K+K{^1OA(yls8#a0{)`vpfSbXfMQXo zzxXT&S55@UQUaw&_{R%C9`wd60`4E2OKd;`lI8!6;sORLxd&aZvO{!ojFsOxct6ps zEkgxi=|1VS$>Z-^Uf>YwaBFYnb-rmg1p@&ptNw&8^6Jx3T;4j-72DvV9?Aaklpxmy zNp{%n$a7hnpJS-PX%461ufXOg;9FmqxhqA>*@BYz0u(qg<4C~s{}~31!r=4T43}|~ zmG(X@CUW7j_OC#?zebkoc5jBJ{2zm3ycrx0wf{eZbApuIiX#3~mH-lr5`Ev_p0=u@ zMPHRHkt20KVtrFd%|q6vL&>LizE3%s7VjE??7zu>;ef|^1=vLTE)uLZc#Vp}Q?b}B zZ>*o!*eZ4+rACyt>uRGsxvT4LpQuWkdBv4IPDmw1;VsvdaYLH@o8t2>+3tLM?f47) z=muK8=heA&tXl+Wa^MGS2rHHiedjyRSiv^F^xYFr&@ZjfcehheDeY+^dfjE&viz5&UB5Y5pTeUmt?&5q~83lFC)uFiW=W`-C;xlI>goF92Re;MV@&+Ey z*3iOYc3CF@USgpFmRZ-)tTK&cEV!O^`TPh;zLi_;YozcX!JyqcqEx@F9>%7_VgZ&s znVgWc5#3c6@^m@Bi~giYE)qk9H$ba9my!F7t%?Ygk&3ox(`Z-RI zPhZOE?Da@ur;jU7q-jffO0WUOVRg*5%zV_-rVyZ=OOG5;ymG#L+<#myzTh-Y_xOxxFU; zBb^+CCz+PE^D;2=_2P1`D#P9FG5B_oitzO*^>CCb$?vBOB};r4FOI5E6Nw@D!Q;Dv zc(L^eGIpN9)^D41X@vL7l@gTMsPb_!M7p9uYh_8(wHf{cX2QIwtOJ4a)tg9_^B zo)i{3ej|V^TCrYgKe%FEUB8S_`Dc6g;iUaDSMgOkoy!O5z?Nle6EyFC3ss;Dem|&1 zEqNBp`2%olj}hR#HPlhdf4Si8@bh`z<1y>RX|E_V=OQBmu$}CA!hbnBfp21bhuBI$ zt3D;M;<7riLuS+P{z6@?ci@^-oFSVr4Qs#9OkE{V=uuq!@-yDAbX*hX11a>@>4-Ik z1XM=6Vo(ZEMy}Jna11xbuw-Wj-Vz;2jBGj%uTI`i!7-k4*kf8~ z5V&m0*>uzceO={BbXKQdFtQ0n)PvQ1-e;>aBy-HEBxc7v@6`~PrmF1~7c9y?L?6as zws!oIMhBj}Jlv&Laa8HM#G#sMlx<{t;ZpB8jf7Xk+v)GrH^+$S{M*t6j^I*QTN443 z;h!CovQe?xY_zu+PZ!P)?bDGq{M;VAm~BSD2IJMu=o`3R?#Uh8syKLulV$|tQw=FH z$xho`pQGl>d=Y$JA)J=K9A8Z8*6&8!z*=u`JMEc;a(FjdL6Qlgq|1xV=nl({O&BwL zeRi&?CkABP;C?6*|L%xUTs6MJ(UnYOei-D^M#u9lE=S9<+ z#()%$uTMg7e*ezGc+O9v%+grqqB5p{~lU{0+pN+~%Az^UrOM9aTn!og;7z_}wV z&f=Gbx9z;CH6`>O$F8$Q>tfhR81XLH_}^x4(72Q4Jf*+30`CHuQ;q*>OKoDnV%#HS zZM99WvU%$2+|a-#P8+@Zzy3L0PFn!T*W_v21!Yd;FbNCJN z5k&B4jae>#_pZAM4&g{zirRq#*FYGc+gw`DDFK|qpSpgquc2~3W`nf_Ie5-~-l3fc zpP7I96HznM{Uv$gc{sS|{tLHS(xAxnUdy?}YU(A^$|}(ffeRs&^bk{3l;Ur2T6t@5 z<8+ec-Gq#$&S)4B+>;Y_y-WIE_~C>Y@PnJX-gu=n#wx;AA5JIqPeTUht}Li=T@g@^ z9E{>`-cRWNQ@rReutx%lkgkMS#h|x%{^SQK;a~&CrVxK#7J6F%KR~%undw)Sf5!WS z0Sb&PUxT&&(F&kcQnjud_kVl$RHSwb(f^~1L1DF2^Vgq3dr&wU69Hu&G6p$V|5A%N zP+~GqXAko)w=e}AkXun!E4=$hTY}OWODxW}DulO-<*h^jL! c&tJhbq{wL_7rYliFP(u&ipq&p3K<0aA4Dimk^lez diff --git a/publisher_clients/wordpress/1.1/publisher.php b/publisher_clients/wordpress/1.1/publisher.php deleted file mode 100644 index f176a9b..0000000 --- a/publisher_clients/wordpress/1.1/publisher.php +++ /dev/null @@ -1,86 +0,0 @@ -hub_url = $hub_url; - } - - // accepts either a single url or an array of urls - public function publish_update($topic_urls, $http_function = false) { - if (!isset($topic_urls)) - throw new Exception('Please specify a topic url'); - - // check that we're working with an array - if (!is_array($topic_urls)) { - $topic_urls = array($topic_urls); - } - - // set the mode to publish - $post_string = "hub.mode=publish"; - // loop through each topic url - foreach ($topic_urls as $topic_url) { - - // lightweight check that we're actually working w/ a valid url - if (!preg_match("|^https?://|i",$topic_url)) - throw new Exception('The specified topic url does not appear to be valid: '.$topic_url); - - // append the topic url parameters - $post_string .= "&hub.url=".urlencode($topic_url); - } - - // make the http post request and return true/false - // easy to over-write to use your own http function - if ($http_function) - return $http_function($this->hub_url,$post_string); - else - return $this->http_post($this->hub_url,$post_string); - } - - // returns any error message from the latest request - public function last_response() { - return $this->last_response; - } - - // default http function that uses curl to post to the hub endpoint - private function http_post($url, $post_string) { - - // add any additional curl options here - $options = array(CURLOPT_URL => $url, - CURLOPT_POST => true, - CURLOPT_POSTFIELDS => $post_string, - CURLOPT_USERAGENT => "PubSubHubbub-Publisher-PHP/1.0"); - - $ch = curl_init(); - curl_setopt_array($ch, $options); - - $response = curl_exec($ch); - $this->last_response = $response; - $info = curl_getinfo($ch); - - curl_close($ch); - - // all good - if ($info['http_code'] == 204) - return true; - return false; - } -} - -?> \ No newline at end of file diff --git a/publisher_clients/wordpress/1.1/pubsubhubbub.php b/publisher_clients/wordpress/1.1/pubsubhubbub.php deleted file mode 100755 index 7c2c668..0000000 --- a/publisher_clients/wordpress/1.1/pubsubhubbub.php +++ /dev/null @@ -1,179 +0,0 @@ -PubSubHubbub settings page -Version: 1.1 -Author: Josh Fraser -Author Email: josh@eventvue.com -Author URI: http://www.joshfraser.com -*/ - -include("publisher.php"); - -// function that is called whenever a new post is published -function publish_to_hub($post_id) { - - // we want to notify the hub for every feed - $feed_urls = array(); - $feed_urls[] = get_bloginfo('atom_url'); - $feed_urls[] = get_bloginfo('rss_url'); - $feed_urls[] = get_bloginfo('rdf_url'); - $feed_urls[] = get_bloginfo('rss2_url'); - // remove dups (ie. they all point to feedburner) - $feed_urls = array_unique($feed_urls); - // get the address of the publish endpoint on the hub - $hub_url = get_pubsub_endpoint(); - $p = new Publisher($hub_url); - // need better error handling - if (!$p->publish_update($feed_urls, "http_post_wp")) { - print_r($p->last_response()); - } - return $post_id; -} - -function add_atom_link_tag() { - $sub_url = get_pubsub_endpoint(); - echo ''; -} - -function add_rss_link_tag() { - $sub_url = get_pubsub_endpoint(); - echo ''; -} - -function add_rdf_ns_link() { - echo 'xmlns:atom="http://www.w3.org/2005/Atom"'; -} - -// hack to add the atom definition to the RSS feed -// start capturing the feed output. this is run at priority 9 (before output) -function start_rss_link_tag() { - ob_start(); -} - -// this is run at priority 11 (after output) -// add in the xmlns atom definition link -function end_rss_link_tag() { - $feed = ob_get_clean(); - $pattern = '//i'; - $replacement = ''; - // change to - echo preg_replace($pattern, $replacement, $feed); -} - -// add a link to our settings page in the WP menu -function add_plugin_menu() { - add_options_page('PubSubHubbub Settings', 'PubSubHubbub', 8, __FILE__, 'add_settings_page'); -} - -// get the endpoints from the wordpress options table -// valid parameters are "publish" or "subscribe" -function get_pubsub_endpoint() { - $endpoint = get_option('pubsub_endpoint'); - - // if no values have been set, revert to the defaults (pubsubhubbub on app engine) - if (!$endpoint) { - $endpoint = "http://pubsubhubbub.appspot.com"; - } - return $endpoint; -} - -// write the content for our settings page that allows you to define your endpoints -function add_settings_page() { ?> -
-

Define a custom endpoint

- -
- - - - - - - - - - - -
Endpoint URL:
- - - - -

- -

- -
- -

- Thanks for using PubSubHubbub. Learn more about PubSubHubbub and author of this plugin: - - -
- -agent = "(PubSubHubbub-Publisher-WP/1.0)"; - $snoopy->submit($url,$post_vars); - $response = $snoopy->results; - // TODO: store the last_response. requires a litle refactoring work. - $response_code = $snoopy->response_code; - if ($response_code == 204) - return true; - return false; -} - - -// attach the handler that gets called every time you publish a post -add_action('publish_post', 'publish_to_hub'); -// add the link to our settings page in the WP menu structure -add_action('admin_menu', 'add_plugin_menu'); - -// add the link tag that points to the hub in the header of our template... - -// to our atom feed -add_action('atom_head', 'add_atom_link_tag'); -// to our RSS 0.92 feed (requires a bit of a hack to include the ATOM namespace definition) -add_action('do_feed_rss', 'start_rss_link_tag', 9); // run before output -add_action('do_feed_rss', 'end_rss_link_tag', 11); // run after output -add_action('rss_head', 'add_rss_link_tag'); -// to our RDF / RSS 1 feed -add_action('rdf_ns', 'add_rdf_ns_link'); -add_action('rdf_header', 'add_rss_link_tag'); -// to our RSS 2 feed -add_action('rss2_head', 'add_rss_link_tag'); -// to our main HTML header -- not sure if we want to include this long-term or not. -add_action('wp_head', 'add_atom_link_tag'); - -?> \ No newline at end of file diff --git a/publisher_clients/wordpress/1.1/readme.txt b/publisher_clients/wordpress/1.1/readme.txt deleted file mode 100644 index 767ac25..0000000 --- a/publisher_clients/wordpress/1.1/readme.txt +++ /dev/null @@ -1,43 +0,0 @@ -=== Plugin Name === -Contributors: joshfraz -Donate link: https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=5426516 -Tags: pubsubhubbub -Requires at least: 2.5 -Tested up to: 2.7 -Stable tag: /trunk/ - -A better way to tell the world when your blog is updated. - -== Description == - -This plugin that implements [the PubSubHubbub protocol](http://pubsubhubbub.googlecode.com/svn/trunk/pubsubhubbub-core-0.1.html "the PubSubHubbub protocol"). [PubSubHubbub](http://code.google.com/p/pubsubhubbub/ "PubSubHubbub") is a simple, open, server-to-server web-hook-based pubsub (publish/subscribe) protocol as a simple extension to Atom and RSS. - -Parties (servers) speaking the PubSubHubbub protocol can get near-instant notifications (via webhook callbacks) when a topic (feed URL) they're interested in is updated. - -This plugin: - -* Notifies your specified hub each time you publish a new post -* Announces your specified hub by adding `` to your template header and ATOM feed -* Adds `` to your RSS feeds along with the necessary XMLNS declaration for RSS 0.92/1.0 - -The PubSubHubbub protocol is decentralized and free. No company is at the center of this controlling it. Anybody can run a hub, or anybody can ping (publish) or subscribe using open hubs. If no custom hub is specified, this plugin will use the demonstration hub that is running on Google App Engine. - -== Installation == - -1. Upload the `pubsubhubbub` directory to your `/wp-content/plugins/` directory -2. Activate the plugin through the 'Plugins' menu in WordPress -3. Select a custom hub under your PubSubHubbub Settings (optional) - -== Frequently Asked Questions == - -= Where can I learn more about the PubSubHubbub protocol? = - -You can visit [PubSubHubbb on Google Code](http://code.google.com/p/pubsubhubbub/ "PubSubHubbb on Google Code") - -= Where can I learn more about the author of this plugin? = - -You can learn more about [Josh Fraser](http://www.joshfraser.com "Josh Fraser") at [Online Aspect](http://www.onlineaspect.com "Online Aspect") - -== Screenshots == - -1. The PubSubHubbub Settings page allows you to define custom endpoints for your chosen hub diff --git a/publisher_clients/wordpress/1.1/screenshot-1.png b/publisher_clients/wordpress/1.1/screenshot-1.png deleted file mode 100644 index 91d84af1af8e35d7eabef76e6e6cea1677c4c549..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 14558 zcmb`ubx>SQ&^L-(a0nh;f(N(Y?(R--cemh92=2k%-3jjQu#n*HEDqn24Sz8frDbU}Z7vJe(l zkQ5dsR&ca4wXik;19Jzji03!QP$U@aN>-rJ2uxCPL1mV3k)R-t+%#CJN3xj3`A)0a zGz!>>rA)p8P^4+~X=dp32@+sBI4NQlAtRH9MG&7<{@PVQ6+F84anmU^aJYbVJ9FB2 z?A-9`+GvB!Jxa4_A_ZGXq8({DxJ#|u+w8^1>A^8t3Jfab0jiX!{4fcg@G4o*i)EgsBAk( zVN~-{*s+}OoMm|4Utj9~|B)85$GG2Qlla-KSC;GuUi{Y?|Y*F|K8!b(dcl&&bpo z+|#yjs+#1gnDHGexROzpr%ab#yX$6#u!JkaTO5b>8ay-;vIpyvXh>F1ue-l+*FpLe zL1PSZ06d*{@BI>+A~GvHS%`}m5_?>9SMMv@o6N4KvL1Ov+;6ZWeu4>DLX>ygTZ zE77y&K?1=q$V$((;M>WP&vZG*+8yRAHw)UN_Ct-x=R}#TZbqW;G6N+-{4J0R!P`q{ zI)Q<`!+86EgQaEQfPoQ%Ns0)nxPzZ$!s{f=zr4mWaR&BMehh;P7Yg`j+Y%olEoNa) zJ&H(oMOk0sF}_x-Q@Q({e_E>8D(#)7XN!>w8ir&)5@YcXe~19$$ZyuYeTayQuO3O7 zsfPZB$1giq?e62BC%HDRo_!}DGZwFWCYVul2|v3F*!zRQ{k>A+yT9zJAOncOApTy6 z;6d8gkf>nbZ`UUt5LHJO@`nJ?0?ndCfA4^S*I@`Wv+)?={6~Yj{nrfC?dvi<&L`rk zF|M1@)C?MG5+lY}GfEWHb?WjOr?Wls#!m_m!?7Q~7LL?!*L(S~(i~cq7R;2E4luFo z#W@u7&^KfSQXcuL^3idi@Yx+yeq#p1^1Z8zsN?Rt5>h9<$b*|C-59^yFI>tp=ChqR>$$_PL@cy*axd=O$r`PEMBKd<7@z$# zmON!H-Q@2zagoMnO^t3zCddy6^V&0cE9x2|JyyWA1b?ugg9Hi>j!$1q&~&P#^cfq_ zHrxQ$Tl=svI%p>~G&bAzO4y4ijPQl;@%$y1o`laPy!mo9oC9adRStP9dCKChkNWyi z^30b5q0|$2bAp%?T+&>#wcfy@UOCnLjo((S2(Bq1Gb7Wmcw>i0*~H?z!T_{n^JSL7r_Ux4c~mUbhhY z=H|vqcRrma(iS@*X^}%qi|hJ$byBz_qWF+HQJUTwP|R-O@iHC|@h~8ExM9zjY>H|T zP|sRaT`Wb4x_o`SMHe^XVr z^c|zk)C!`_a==u*=vePtZF-iL*0%vlRrp7@CYwu)`10q-CaN-5t7X_pkB6Slyu%(5 z%ywhp9}8*~Nit>iR#`)%v$_1SojDyGgC27kiB|(hZP8_sSeZQaF8bd`xF~ylm%h)V zb-Y8NU$0!TrT28xCRdIVrfsZC|Ji)`64@9;y|;cPfA&I0DO!=ti*fH3Tm89MaeMuA z=N*pBoJ4o7Y@K%si-qEGB_q0Hy$*H@ES(l>q+?+y7Vo3KiQfrY!%cNa{qwQ>A|EwR z+d*9~p2Ue6gEnt4?d1NH6RT>WU){kdEnYm`Ke{iUl}t+o6=ETL)3Lccg5E zJt0trpGQ#bc;KXKEuR|vN{v3+eSAatnKZq`v*x?7&2`udNHvBOo>{+dUw->ls?vmgdA(2$xyD+$@h#_!)tfndgpncS z?Vjxg`1FO5oW`h$q&2u)>?TOzogSz)nAnAO?4Q}VJ$sAE$_hFPweI!7tN3tW%dZYZ z$RL-L6W@Cmj;+%gj7T_m=s{nl5Rcx`^O0~VO9@}seQ90Xu8}ZFeYL>fdsz6X;p*8Nu9afqQ5A@{m+uvX zD;r#3*FDN8<6775SJoU-O4oduetmHf*gU`-Q&1LvyXBhS3g8{@$+eO`5uy!;eDf7V z40FSi1$z>9@uk&OUFu7(%#4KWNGXHHL{I2hCRmmQmveaUFL-TF+L`v;`nE?*z6<5w zzNLQEq23E;3>iy7W42QJ)yMSJ@C^2&s>6m6Rcv@&PZ3K&YC3(ijlPW*Iyxtr(a8Xq zmzqeDlX`=x^%!fB@|CiddvGQ^6?1q%YVP}1s1B}pjOHv4b!DZacIKVPUXB#Zs#KyN z#G=_AAs#c|uWgNb46b@H zvan_aq3MiQ+zg>lPEWaKJ-f30fUtWiosG=+XNYQVF%s~{*4>9VS_@Lq!%2z}=6MMZ z>Kp8aQCmEqR-<(ienm@gZ^Ai8b17wiRy;;c=tkc;$J0FoY1O$4Pg0QLBw1t7RrsPE zV9UvBw(;ysk$^}qpDwNtRWLoBwfOjhL1Wbnmz2MSW-6hx9B*^qm;2vqn;((H$i%J; zMc5VrTC;c~{ilIk^rw7TYlua`(tZr05-JgF2-QWJRKB~E{6)~wJ5ON0f2-%2n;h2A9ydJKhvV5nqCI{d4;{mY z=eR3E&1piBXWV9#^2CyJ_8ughs0u0F9s7_)Fv?GgQ|@8o31PL!MLZ8Itvo_J-D&xi@oH)j*!e8e0x>ok4giRdhl*`_r3N?na;I8) z_H;s?4D+gma>spiTRm(TCYOq2xnGcd5Kp*j~GlV%PN&z%2E=79DrL{hu}QLGA~Alcdd7fo92wg&aRo z@*u-S%jubo#z8@v-5i6_ZW()O<&(uxT6XGhVzidWEaPj zpf(k}vwhhs*|Fhi3i$-VH&{bYwQ9>$luN%n)a8*V$Jx1*F;TgdZAbO6513W5Ql_-x z8sKe z!yONklw661JQOk=MY-Z9xs;sa{Mx$Cz*yR0l#fq)7oSF|G%ejUW)m&6)z2nMchZ_P zMY+zJ<$d=hlXY7@sMVLP&5U7xG)rZ}P~FpoPIID^=|UWiNPbzY!w{6t{%J z<5yrm|U3IF2JEil6NSZscnsOUb{U0jWDpaKXIC4K% zP&4dJI?0hcqG^<gX%4*U`kIkLgXH$$tF4qp$MsS+UJbfuTxs{m#PbcK?1Q}K5bCwgD=L>G_QcZ- z!b~T|g60q#y^`9WtoZ8pb_7&ktG({HXal*ct)CcOib5|%W(eeKHf=trw&fV+i>EP+m zQ&LoLq~-2e|KyRrE~?a#h|OtuWU5n5szR-DJ>Y5E+BA8tA~JlKW0d0d-NbAC?Jr60 zfD7HrgEF~*!kLV+F2cv(Vz_liG~=W32!xM}Xs+1vx^3r2w_R%n>H!7!&`N{rr@T;! z>Woi#kF-}>&@}0~9~+$P4@th8>UEqutw95yQEJOG99Od#DtT=PS!~m$a~7XxPT6g)4K59GHZ)^E7GvxI1IeW*aztUgg#Pq-5r)zy|&(PD;rLaHPqr+lVGo{EdBh<0HWZ324_G(_4Tjy(Y zxiZ8mS=H3pVCx`#pOxcNC9WQfV_iS;PQFRlU5$VN@_xHP_wu)?_TT;vLn#0w@E_D<9l7p zIY~R~aVBJQvfeV>Mf!nA+3Mvv@_nAAy>BLCsec6!cr~)@_MrWH<&}1r6H8b1>V7o|Tt0wzrGP!Ma1#1jYyM(%!EYRUs9un6}o|OGxRjFdDCI z2Nbk7)`oO0D_Rde5jF(}#t=!59F$!`lja1*D?4dEbiqoE9Pk?}pqb}ZH8oXFO%3bK z4h`4lriY8h$jM#bNO7}UjY=Q5l0KwUh{I}Uwo_V|NZ$KsDG}GYIy+83cKUv>`QW%r zZl+_p8w0($&T!qJMoB16AWSXcq_Eo$$Q``cT|wNBX}fO9kIWM$iLLKNlQ&2`OQMatZlR8n{Tp!<_3 zNr1%%%fuLw05ENhQBYUEMd#%zEXsd$CH_fH5gh!bM}X&as&IdK29s*eV-U3C}4`zOYVAjq;G zrWBz5qs2h9O*=8tA0z$gZ@-Fc{t@CIZ9@jqnqBW3%-bx3tl$d5zHMMxG5@nlBS>r; zd`5}Dzgi3Mz!9%CLgGdIr`GBl9gUs;w(3CFj}K5$?R_;L@D%f}P>1MC4nHS~%7X3@ zszPLSwDAX(lC1GT4aL@m*T{47j?4=KK%EF(Ah2x{`7>xU%3T9W2C>QI6_E)4u6}o8RQ*WnsI8rJYcGGBWiMg{o3S7@ zlwarRCDf01ZNgj@kYM85$N9SJQZPAF-ciqecGe}vvZJ|SrAoiQW9K`(t+P|tbKAJ# zY(*l7{6~jhio{b)@xxhPor?GjXO{%<@cMYQE0oMldP%HZ;ORGeUS^ZL?>K9&Fs&$# z^f0rRS{_DI`0Bc}uSPIhJ@PMNO(kW7Ag^+W9d{$6Qf`2Etz}&=-XyfHqo12dBqxDr z)OAbV-v7A~6U0fRbE{UiugS|hpZW01fUPohA8DAbr<^%P!#YDt^4Sa9F1N z5dPWN%V>PPLVW(moka{|fkmblNa+02yF!yt=|{1kSnkK$=w$Lfi(j(n~%QgM@ zMwal@;hLOhRIde~yiduGY%2-X#DHtX2+LTT9j?Kb z#%+Nvjs?aS>8s{Sx&XVs-Xtg4-8XEUr75*pGnzc1Bf%Yi%fqr-TFfZjrJX?ddVk2~ z<%#G*#x~z|x{}c^vqUpdo{Hv?Frf9?HIYq2`z5kYP+HS?a9~K}tcIb1ZQjh4aov?P zTkejsGPQ-9nKD^M^KST3k(`$O@|lB!LWu=IayqrF#BAcis!6p;S-SGY>1LHk7yY)W zvSgwI_1VU#GuY)U$F)3BPhKvCeJPFCW;ImBQD4pNs?QhC3jX5a;#09O3GHYZb*qY4 zAP@3CpPM3`V#-^+e#W2GY#>?Pe7vnz*E-kq{dENIbJ+O~>9cdwzLxKeLKRPFym{es z&rtLv@V(3#6^bv97WJ6Vqh0ta^H7Wq;AZ!dsCMF*r^8^aI!|&wsF^-ik0S@$W1;Mb zHpj|x3q{Y*tv0!qTs^e%cqb^hE&0{t*ZA`p{Ys{1Q@PsI)^M^}EN30<{Os%eVlNDh zbp6ibX%4!+uq1*UN=Mbrebw$JLnnPbfI2Kas_}fM=5h(teY}CKDM1 zoc+9OkF~fkgc#nYP^DjJI26kbu#F^z$+YDjg$0)yR$E87*RjD3&8pZ6jtd!IjTzDv z#GzJLrqhhBbMR7ApV^<1}XW}{rSqKMW9cX7_LCUxbi*#O(#Z7A2eR9%d z?Xsqqx9Z_~z-@OD?0cRDAe3K5jZD z!o2QMizS{zn9Lod4v#+=Sw%WI-rP$%ku4;$c@?uH*lM(qgydKFHUjDmiwKosZ23JT zObub62ob=e9~0q$F{dv9?kh8f#=?PXHrHcC<%s*WuE0977B*4*JsE!Q;FQ#P9Jlf69AP&N9am*3i_(dw>thB|4?F+|!dmidmY z&7ZF;WHEeGd_pp!?%cPhqZ!W+M|}ZJ+C8#H9IQ)su?ci~wSzl}#daHnJ@1@58FR?s ztG5c@*VANQ%^z0nLU&zYW@}_$^&W=(Lg}TlfNyvZO2Y2?lt~cfqcxv2uB=rNrJ+>x z92D|kZFQqD6iyvy6OMl;tJ=H*43nml}xXq%^Ne9G$PUPa` zX0StGU}5DE^xRIg#%R%;k^FAyJh{j@DYd`5S?k*0?RN0+8A!R{UJ71Q&ug&UF0J_g zXjoo>{C(A?Pv#r<^?CjZh)4bX%TZ6y;>i*LU$`n(`z`v-SFX#LayUH)nG#7yYti%8 zFURBvH53QK`bRZ-4%UOP@gdcgl)*NpR2fLLIasGu&p00jMwA_*xo#elV+VqqJbM-j z9Gp%f+Q)y&05liFjwfoWC25;2nGyZ&d;zc-uZB!gui@bQt2^jsN%!qe-dE(6-*sDM z5Xd~fkAs0>NxanpJpRHtYa)pXnF-I`p4qi;1X%QjR&Z(yN#bKtsxD6x+4t!7Ec92$ zpSM1X6iwsmo4CbT?+Pkm46@LeYl*I)RhE=IrpI1HLg>UsgzNoe)k`L!1!j%Q@eH7y zFjGId1A8^j3)jKi@y5>8)18_=7j2@*j^9)3$Nm^RK8qknx@T=tp-q-b zN>H0ox?d?^Wvlm|I4ox)S5{KYic?OBQ~s`R67#@U%RRZ#UIg&5yoF-Qw0bG*#a5oQ zMkpxCIk-WInBCf&4K1G<>SHlO$55uVa?0CfQF6Fu=3{EAW#WyX-oQR@mPt4#=gX{Wor6xOH)l2} z56?|=5XbO|IZgbOxDgLe^s|~&EY!k+>&TU>cjV21$^lx~ai&*ErTvUA#HAKxh$thD zoGPLw-p%yau&7NtQxsp%ajz5Mw}bh*1$-hW|>!KH+Eze+W~U*cuDzsIIzIScK%C`PSDpT*CAKrOZ1(z#RJvo{;D*0l7_c%ZCM z7&3l3iI0$EHd4o^Jt#mc?HN~2p-Ze7;E#a!@Xhx;OP`650{6?6QP=6}*2d=LJ9w4j zH7~ECXOM_Rl-0s%=86@A0xBR}C66#_&nJCMP4MV8zeut@kQ&-SJpACaPor|L|N6)_ z;O8bMBdl~nm0VEvmGQ?01s07quH^3SyyWQCJHm{WF2jR>*p2kwsCTNNBS;^j9%ef9 zH9Sv#20n~9n)-6uZaqQHIRMQm*Y051(9{`zUzxbESbVEj=JhDvPW4`S`0QM%;!B|) z@m%W>z!$Z)=Ud-R9_BR-+s@Z9ho-5V!jJ9zrEnPW*9=)KIqLpLh*#R*jd_QVynftY zAMpsy*IEvM*?Gyeb&Q#^d1pWCk9dRf#rrZwhUD53bOq0f#!L&Alr20waK+iX*f?UW zwJ?Ol3$BOm1|!wfzGC0g+eYNuk?n5+W;;~nO~#dROeBXd%vfscSmY|;@Z&{<^gm3F zX=x$omP~&boVjG4utmNtYHLW4hm5+(W;EHL9_Ar@J{_wXUQuPS4kPDomUh3cS@U8p zvjup5NGbUWSFU3o&j;omQ~h^^!De6|ji{tlSb(2Ra5ji6~b7R!5Kgdb$NJT=aU zhQG=vbL|Badv>Qt4rqfq<4sg6Ayzwf6%@A(Y~`b1hlJe6bNHp5&Il;^ILz1ZIbp%) zB;_}_1Wd`kk>P~J=MqofwvPeTNJAAaR=R^G*U28 z@4c<`SZ6omzt!TNBSCzS5^z~PRH#r`2#0q!kCHP7Lu1avO2@S#C8MMx*b)vcbpCoZ zw?Awc`P3*b1I)`{FHnO)_blT*U)hEvXxxESPUb6UH;YIi?voowS91Bibz(f*FL1M8 z;DNxg;rS~M9+uCjA$VZVw;wRv5y+=;>h>$|2O2Ax!StoVcZT1(Cgqa^z1rDCE)HCE z#l<+B7QP}PQ;Qk$tV2a&3fZ1`Dm^l~mA=s-nn1Xf1pIsSo4UAEKD9wbp{5U4b!7>X zDt%BR20Zkrc-!Ke&EKQoxT@{Pz6Kw=bpO8Q?Y)=CUz9g$)_c&+wZz3}JSHeNKOgBG z^)VHz*1HRy$u#*4lj-Z$Uo0XtJ-aawbm zHA2_%EW-(>LWC3x^ON2N{E(&<5&IidIOiOmI;~I2ilIf_Sm(~b^0n`!>`z`E!R4i$ z(<38dB3q13AIZOa8V&21iO63*{!Uy`{+)ylulUa1=y3A5!;sGjfIw*dYrvB=&jX>O zUtGTSnS}FZ4uZdQV`LztX`oC|MOB3wik-KuOt_I*TuqgNB=;1+CjHS^B|HGmx?UNH zCTF*7pGR4Qx9ti|>7-+wB{g4&6l3|ietIh=Un+NM>tp}Y+MDGn>?KJ`O24C}p8^tP zg?-q9rWLrAc`4}2PQ87!&)O=t4}ciD_RNy1yeAZ;z9LteQT2(}tYx+q zI)VNS;16dzyk0D;`(r-lH%?CYfiH5h0>nz|!CZ(C`1pL3Y$Ip!EyBf^+}V5^@_Z*yELj~mHQy7gp#=Lr!fd(}NA0tYE&{=W6r zS~uThd{%;XhEa~5!)@?Kc43Q1Hf0)*4P0K1Ggb~m1y&HX!!wS{Bm6t5En)e1oPlCR zg^uVsQ8L=s&JL(eILB{6VSwN&FlBuL4#X%JdIRi2pi)_0T{3MeIOl z;F(}O70YP7|Ix&2xhVgQy$nJj)Bb<%<{y{LnFiqdPZR;FH^`F8+*sw0#sa@4DgEsq z&6>cD|6+>H5Fq3;^GBSb=wHl;KOL;+BpU!x{ns8-@F0ZIH9$=4{a=Xj#Tp_Y>4Su< ztc@mE%m2WlV(`C01;o()p^#uuG8F#9#>()ypZ~$6I20gs8uPCJAegdS1;n!uUBu%b zzVk^61lE2e{nyyvzXS@^R+b{{^56Id2_Oq9iu`K~2Cn>OH7V4cf9$$Hg23&(u>TRJ z5FIpuiNquSFjId;5VQYVHhU`?!Gu32j-WB~K+K{^1OA(yls8#a0{)`vpfSbXfMQXo zzxXT&S55@UQUaw&_{R%C9`wd60`4E2OKd;`lI8!6;sORLxd&aZvO{!ojFsOxct6ps zEkgxi=|1VS$>Z-^Uf>YwaBFYnb-rmg1p@&ptNw&8^6Jx3T;4j-72DvV9?Aaklpxmy zNp{%n$a7hnpJS-PX%461ufXOg;9FmqxhqA>*@BYz0u(qg<4C~s{}~31!r=4T43}|~ zmG(X@CUW7j_OC#?zebkoc5jBJ{2zm3ycrx0wf{eZbApuIiX#3~mH-lr5`Ev_p0=u@ zMPHRHkt20KVtrFd%|q6vL&>LizE3%s7VjE??7zu>;ef|^1=vLTE)uLZc#Vp}Q?b}B zZ>*o!*eZ4+rACyt>uRGsxvT4LpQuWkdBv4IPDmw1;VsvdaYLH@o8t2>+3tLM?f47) z=muK8=heA&tXl+Wa^MGS2rHHiedjyRSiv^F^xYFr&@ZjfcehheDeY+^dfjE&viz5&UB5Y5pTeUmt?&5q~83lFC)uFiW=W`-C;xlI>goF92Re;MV@&+Ey z*3iOYc3CF@USgpFmRZ-)tTK&cEV!O^`TPh;zLi_;YozcX!JyqcqEx@F9>%7_VgZ&s znVgWc5#3c6@^m@Bi~giYE)qk9H$ba9my!F7t%?Ygk&3ox(`Z-RI zPhZOE?Da@ur;jU7q-jffO0WUOVRg*5%zV_-rVyZ=OOG5;ymG#L+<#myzTh-Y_xOxxFU; zBb^+CCz+PE^D;2=_2P1`D#P9FG5B_oitzO*^>CCb$?vBOB};r4FOI5E6Nw@D!Q;Dv zc(L^eGIpN9)^D41X@vL7l@gTMsPb_!M7p9uYh_8(wHf{cX2QIwtOJ4a)tg9_^B zo)i{3ej|V^TCrYgKe%FEUB8S_`Dc6g;iUaDSMgOkoy!O5z?Nle6EyFC3ss;Dem|&1 zEqNBp`2%olj}hR#HPlhdf4Si8@bh`z<1y>RX|E_V=OQBmu$}CA!hbnBfp21bhuBI$ zt3D;M;<7riLuS+P{z6@?ci@^-oFSVr4Qs#9OkE{V=uuq!@-yDAbX*hX11a>@>4-Ik z1XM=6Vo(ZEMy}Jna11xbuw-Wj-Vz;2jBGj%uTI`i!7-k4*kf8~ z5V&m0*>uzceO={BbXKQdFtQ0n)PvQ1-e;>aBy-HEBxc7v@6`~PrmF1~7c9y?L?6as zws!oIMhBj}Jlv&Laa8HM#G#sMlx<{t;ZpB8jf7Xk+v)GrH^+$S{M*t6j^I*QTN443 z;h!CovQe?xY_zu+PZ!P)?bDGq{M;VAm~BSD2IJMu=o`3R?#Uh8syKLulV$|tQw=FH z$xho`pQGl>d=Y$JA)J=K9A8Z8*6&8!z*=u`JMEc;a(FjdL6Qlgq|1xV=nl({O&BwL zeRi&?CkABP;C?6*|L%xUTs6MJ(UnYOei-D^M#u9lE=S9<+ z#()%$uTMg7e*ezGc+O9v%+grqqB5p{~lU{0+pN+~%Az^UrOM9aTn!og;7z_}wV z&f=Gbx9z;CH6`>O$F8$Q>tfhR81XLH_}^x4(72Q4Jf*+30`CHuQ;q*>OKoDnV%#HS zZM99WvU%$2+|a-#P8+@Zzy3L0PFn!T*W_v21!Yd;FbNCJN z5k&B4jae>#_pZAM4&g{zirRq#*FYGc+gw`DDFK|qpSpgquc2~3W`nf_Ie5-~-l3fc zpP7I96HznM{Uv$gc{sS|{tLHS(xAxnUdy?}YU(A^$|}(ffeRs&^bk{3l;Ur2T6t@5 z<8+ec-Gq#$&S)4B+>;Y_y-WIE_~C>Y@PnJX-gu=n#wx;AA5JIqPeTUht}Li=T@g@^ z9E{>`-cRWNQ@rReutx%lkgkMS#h|x%{^SQK;a~&CrVxK#7J6F%KR~%undw)Sf5!WS z0Sb&PUxT&&(F&kcQnjud_kVl$RHSwb(f^~1L1DF2^Vgq3dr&wU69Hu&G6p$V|5A%N zP+~GqXAko)w=e}AkXun!E4=$hTY}OWODxW}DulO-<*h^jL! c&tJhbq{wL_7rYliFP(u&ipq&p3K<0aA4Dimk^lez diff --git a/publisher_clients/wordpress/1.2/publisher.php b/publisher_clients/wordpress/1.2/publisher.php deleted file mode 100644 index f176a9b..0000000 --- a/publisher_clients/wordpress/1.2/publisher.php +++ /dev/null @@ -1,86 +0,0 @@ -hub_url = $hub_url; - } - - // accepts either a single url or an array of urls - public function publish_update($topic_urls, $http_function = false) { - if (!isset($topic_urls)) - throw new Exception('Please specify a topic url'); - - // check that we're working with an array - if (!is_array($topic_urls)) { - $topic_urls = array($topic_urls); - } - - // set the mode to publish - $post_string = "hub.mode=publish"; - // loop through each topic url - foreach ($topic_urls as $topic_url) { - - // lightweight check that we're actually working w/ a valid url - if (!preg_match("|^https?://|i",$topic_url)) - throw new Exception('The specified topic url does not appear to be valid: '.$topic_url); - - // append the topic url parameters - $post_string .= "&hub.url=".urlencode($topic_url); - } - - // make the http post request and return true/false - // easy to over-write to use your own http function - if ($http_function) - return $http_function($this->hub_url,$post_string); - else - return $this->http_post($this->hub_url,$post_string); - } - - // returns any error message from the latest request - public function last_response() { - return $this->last_response; - } - - // default http function that uses curl to post to the hub endpoint - private function http_post($url, $post_string) { - - // add any additional curl options here - $options = array(CURLOPT_URL => $url, - CURLOPT_POST => true, - CURLOPT_POSTFIELDS => $post_string, - CURLOPT_USERAGENT => "PubSubHubbub-Publisher-PHP/1.0"); - - $ch = curl_init(); - curl_setopt_array($ch, $options); - - $response = curl_exec($ch); - $this->last_response = $response; - $info = curl_getinfo($ch); - - curl_close($ch); - - // all good - if ($info['http_code'] == 204) - return true; - return false; - } -} - -?> \ No newline at end of file diff --git a/publisher_clients/wordpress/1.2/pubsubhubbub.php b/publisher_clients/wordpress/1.2/pubsubhubbub.php deleted file mode 100755 index cc42c1e..0000000 --- a/publisher_clients/wordpress/1.2/pubsubhubbub.php +++ /dev/null @@ -1,211 +0,0 @@ -publish_update($feed_urls, "http_post_wp")) { - // TODO: add better error handling here - } - } - return $post_id; -} - -function add_atom_link_tag() { - $hub_urls = get_pubsub_endpoints(); - foreach ($hub_urls as $hub_url) { - echo ''; - } -} - -function add_rss_link_tag() { - $hub_urls = get_pubsub_endpoints(); - foreach ($hub_urls as $hub_url) { - echo ''; - } -} - -function add_rdf_ns_link() { - echo 'xmlns:atom="http://www.w3.org/2005/Atom"'; -} - -// hack to add the atom definition to the RSS feed -// start capturing the feed output. this is run at priority 9 (before output) -function start_rss_link_tag() { - ob_start(); -} - -// this is run at priority 11 (after output) -// add in the xmlns atom definition link -function end_rss_link_tag() { - $feed = ob_get_clean(); - $pattern = '//i'; - $replacement = ''; - // change to - echo preg_replace($pattern, $replacement, $feed); -} - -// add a link to our settings page in the WP menu -function add_plugin_menu() { - add_options_page('PubSubHubbub Settings', 'PubSubHubbub', 8, __FILE__, 'add_settings_page'); -} - -// get the endpoints from the wordpress options table -// valid parameters are "publish" or "subscribe" -function get_pubsub_endpoints() { - $endpoints = get_option('pubsub_endpoints'); - $hub_urls = explode("\n",$endpoints); - - // if no values have been set, revert to the defaults (pubsubhubbub on app engine & superfeedr) - if (!$endpoints) { - $hub_urls[] = "http://pubsubhubbub.appspot.com"; - $hub_urls[] = "http://superfeedr.com/hubbub"; - } - - // clean out any blank values - foreach ($hub_urls as $key => $value) { - if (is_null($value) || $value=="") { - unset($hub_urls[$key]); - } else { - $hub_urls[$key] = trim($hub_urls[$key]); - } - } - - return $hub_urls; -} - -// write the content for our settings page that allows you to define your endpoints -function add_settings_page() { ?> -
-

Define custom hubs

- -
- - - - - - - - - - - -
Hubs (one per line)
- - - - -

- -

- -
- -

-
- Thanks for using PubSubHubbub!
- Visit these links to learn more about PubSubHubbub and the author of this plugin:
- -
- -
- -agent = "(PubSubHubbub-Publisher-WP/1.0)"; - $snoopy->submit($url,$post_vars); - $response = $snoopy->results; - // TODO: store the last_response. requires a litle refactoring work. - $response_code = $snoopy->response_code; - if ($response_code == 204) - return true; - return false; -} - -// add a settings link next to deactive / edit -function add_settings_link( $links, $file ) { - if( $file == 'pubsubhubbub/pubsubhubbub.php' && function_exists( "admin_url" ) ) { - $settings_link = '' . __('Settings') . ''; - array_unshift( $links, $settings_link ); // before other links - } - return $links; -} - -// attach the handler that gets called every time you publish a post -add_action('publish_post', 'publish_to_hub'); -// add the link to our settings page in the WP menu structure -add_action('admin_menu', 'add_plugin_menu'); - -// add the link tag that points to the hub in the header of our template... - -// to our atom feed -add_action('atom_head', 'add_atom_link_tag'); -// to our RSS 0.92 feed (requires a bit of a hack to include the ATOM namespace definition) -add_action('do_feed_rss', 'start_rss_link_tag', 9); // run before output -add_action('do_feed_rss', 'end_rss_link_tag', 11); // run after output -add_action('rss_head', 'add_rss_link_tag'); -// to our RDF / RSS 1 feed -add_action('rdf_ns', 'add_rdf_ns_link'); -add_action('rdf_header', 'add_rss_link_tag'); -// to our RSS 2 feed -add_action('rss2_head', 'add_rss_link_tag'); -// to our main HTML header -- not sure if we want to include this long-term or not. -add_action('wp_head', 'add_atom_link_tag'); - -add_filter('plugin_action_links', 'add_settings_link', 10, 2); - -?> \ No newline at end of file diff --git a/publisher_clients/wordpress/1.2/readme.txt b/publisher_clients/wordpress/1.2/readme.txt deleted file mode 100644 index b8c3457..0000000 --- a/publisher_clients/wordpress/1.2/readme.txt +++ /dev/null @@ -1,46 +0,0 @@ -=== Plugin Name === -Contributors: joshfraz -Donate link: https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=5426516 -Tags: pubsubhubbub -Requires at least: 2.5 -Tested up to: 2.8.4 -Stable tag: /trunk/ - -A better way to tell the world when your blog is updated. - -== Description == - -This [PubSubHubbub](http://code.google.com/p/pubsubhubbub/ "PubSubHubbub") plugin is a simple way to let people know in real-time when your blog is updated. PubSubHubbub is quickly gaining adoption and is already being used by Google Reader, Google Alerts, FriendFeed and more. - -This plugin: - -* Now supports multiple hubs! -* Supports all of the feed formats used by WordPress, not just ATOM and RSS2 -* Announces which hubs you are using by adding `` declarations to your template header and ATOM feed -* Adds `` to your RSS feeds along with the necessary XMLNS declaration for RSS 0.92/1.0 - -By default this plugin will ping the following hubs: -* [Demo hub on Google App Engine](http://pubsubhubbub.appspot.com "Demo hub on Google App Engine") -* [SuperFeedr](http://superfeedr.com/hubbub "SuperFeedr") - -Please contact me if you operate a hub that you would like to be included. - -== Installation == - -1. Upload the `pubsubhubbub` directory to your `/wp-content/plugins/` directory -2. Activate the plugin through the 'Plugins' menu in WordPress -3. Select custom hubs under your PubSubHubbub Settings (optional) - -== Frequently Asked Questions == - -= Where can I learn more about the PubSubHubbub protocol? = - -You can visit [PubSubHubbb on Google Code](http://code.google.com/p/pubsubhubbub/ "PubSubHubbb on Google Code") - -= Where can I learn more about the author of this plugin? = - -You can learn more about [Josh Fraser](http://www.joshfraser.com "Josh Fraser") at [Online Aspect](http://www.onlineaspect.com "Online Aspect") - -== Screenshots == - -1. The PubSubHubbub Settings page allows you to define which hubs you want to use diff --git a/publisher_clients/wordpress/1.2/screenshot-1.png b/publisher_clients/wordpress/1.2/screenshot-1.png deleted file mode 100644 index 8bbeacd06a2be3ffabe5f18399db89129672d4ac..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 40565 zcmeFY1#^^5w}u;c4^iSS#NFN932}EJ?m}FMyF%PU5{SF&M2RbLcenGfKlb#Bl*6~p=FjOup zF)?KsF)@mOG4wL%+Zv5D)KkJW9@I{ZhUEVqPyP1u(`>G zh)2-K$WVqzW2j(|CKQqtzSCCCdk3$*W>Io_>sx*Mpm!>C+Elg6lY7Z?>znJGGtMzC za0>}G@-$SrCR?R(zkP7-ymu*DthYef)I3XM+*mlgZsJ%q|my}>LOqy@z>!1nNP5AV=uJUlX* zt71{1iIFzt=k3|JxuIglAxubOP$_%b-_4|T&+J0nI$m~zeKAKI_;{a+$N{@f1P#^| z?avdx3FgQLshoGobUSVTs4b!^@Wz0$@7NJ79~_LmM@L6UVk1o(%ru*eHY|VLTfod6teB&DWV(sy5flor;?tE875xPss$c+(xNl`2orWGEW)tVU$P1Enu z!O-h18&vZb)E4v?v}=ips>#S{=!i*)X=y0Q7|aSoP+Jb#^csy?eqvqV|7Oc;bMw<@ z#(1K3?cj%NszR7ui(aO0rdXy)i&~g-vD|pqs@SP+*mD1JG5-#~R%-y4K+Z~7F3EoR zFN<{t1sCKq)MzAG1P~cka8j5cf(>;?VRXp2WQEk%`~~Bi-pIb8fpVfr0qZ0~x6y~j z75D-1Vv1eU-9$xNl;R^*yQz0dnb|Bd1KB@ECO|X%#VLgul}`HipPXWbC4TB&%Vl`- zrXpA2ZfENMp!wFcj@PdNcvvemN&Lf(l}HnRgWbI&*O9SeNT?hL1~C?&}6d}yBc1P1x;%xUcA z4exHHx2a!Mj`kjFqCX~{S4L!vcO{Y~1{pB={K)B+|KZEWVaL+L!glk#5nHhk&NJ@0 z1Ra$-8&%cuDOEMaq1xqHUmNp-`@Hm$?ZV=x>ov$$5!kILG$|huxBOc2ryMb(vo4j>$5pOTAjonZ$VIP`4ttDtY4bWWLXt zu6TxxK7mVcf;)o<+( zh_!drvdKugJ8_q3or*e_KCHwID5A)L#Y*~{?A>Jy8n zM}Xn5(W0#+3l7U^gY=J?+N`=}E8mIGg`z%Akm98M@Jn+KsTAjcVzH@(-tHQs25b;& z1Tntzn7i{w3-{9-=}UIOXzt~8tli3!w&?1c2of616yL+An7g-V`{4rMO@XT-tRnPX zl?6v=)ynr1mEVXiIAq^9ia=TPrVdJ}Smd{vsGH!KNNrkgvc;gqSW`Muj1t%g^b@|xO{w|PpBdk|w|`anx7=hfY-S^I}R z#aw58-z+KID-JF%lGaAMb+_^+E`BW%XuM`GOO3&Qrvuv>1z*3w0`n#Uo8kvUYk>p9 z$&#{519Mb{g$qIg8^eO2Va9tJBlZy{O6%g;qG^OX3B)l(st_TFLo!A36#1x(q7LsW zHVx->_v{2FBAz9(EOtfC8J8!mv!!B+=LFaHiB+^O-&*;Sy_UU;-Q8-(D%on&N@rr! zQp*M2D;bnf6=$El8qyBa6T}mlZu-r_(p=r>odt$T^U%9)-Bvj_E#xRcIn;94LjoO) zNBbLD6z3SGEE!! zkREYU@gfPiK8W7JJ_|}B>3-RLIg^4%)2g9_t?%3E+frC%SW5I8w>I>rn))i9)eq8@ z!U7WH>eC7%x;k=F`daEr!ntz+umdK87Qr0YZ1F;0th_o$7naA#7B9a4Os(H^ zvq2$vZLRPusbGk@2(O3o@ZjZqYP<)Lx_MROGP=+zAL1;quz~Z9 zr>)82vZDHI%b&r+OQ7S-L*>k_8e@*{Wcvk+C3&~(M5Ch;I(F-z?XA<>HFma!5A|lP zdxy)@$FB!QOe;F6?h=q}K^Q%-LVYoXidk6{{y!f2xdhIhuPUaNGogQtuXQA(u+T4* z>)Pycx!L7BB?=`4Aj3h?uJe|_J{uAl2aA*X4iZKN{;d9_FLnv18BErVjvhoK%r7-c z<{3{lNMp)UA;32bk^IT}tH>nobirh6-ipGZm^Ui&MExGw6>m1C9+m*CFZ(l1KgM+D zmtN(5nxXgo1-)0n3t66)IO)(ms=bjWgcfo}spkG8@tw4NJe|qIm0i!-yNmWx`Y@|h z?P&s$-sU&hmzYq&(1IpWx6p_uILmJi&_Gz{I6vPkQF79*(tOlr{V=TkLBqUZG~*~- zH_E3}w8%IqVfO`cIFim=eP1JWMzH+W=DUsHq}La{Dzyro0(ZHN`7Z=oK+?UMx(gb* z3RGZobEZWU15V%jL)}dLCBGK4u$7n$#T<|fV6sDmv$o7Iuur4Ucj+WPKJ|%QSJSIZtrY@4@PMI)P}g5wfRP>&50+y`eRt^Hs-o z(fVdw!rC!h{vpr2rv85N-m3#62Q;^A2)vnQUPX<0gmT7cQV43W$^| zc@ruGp@??mvwiiJ@5pUO$PcwLax{N$$Uj~%^1V~Ho<3M2I~jcT4)2j6Mjiykh~SQ< z)OkXpkFZuFuzRz*Qmny!+_7Gt87xxA9isn>q^?>B~{aX-sYwG|zh&oMBkyeTJri@7B0Ef_{IKn!AJ z97h>y)ORYrhP%x=bGov>oFq}di@4i`b%Zg8GLfbhQ!$cxqwXO~A*ODQJ3w@mh(jAvWOijFKs=_u<>sZy_b8$Y> zoH)*hJE z-(Io*>rinI&-=5tbH4j!rSogHdpYC-ag2Y(+bn!@0`$iMmNK>?Hb$-*3**hp&aG^w z8UxoNG&R>X(c+qECX2lGOP}h;jSCY$PCFDnEuPrSQ$0t6yNARJXS4G`rai4G3~O4? zbo2We1arz~uIbYmjm4k6Kd*m;|2REtKP2X?;LNcrv&D8ew=Yz?UMo#4xra1#Bo!ew zt$+qOdf&aeBcenG*wh~PL#*M+tZL3Wj>8yK)5PCMIx1}s_(b#<`Ja7?O(oU!?s~Nc z4-UT`(C$h@?|*7HHQ~eUX^%4vNKHqMPB*HMAmLej-53+?K`!BRL*I4mKaewtSDelVx>WnBtZEb)jW7;WsXr}#K1@j9`bRZ5% zPX|6k95^-@ERvDAappar+aeL>Yx-JE0(kpUPW(4&Xun;>Zo#gcUQE+~XUtvb&YmnB zl4rB6(?O-7>Q}-pn~(sKyN5XwYSx>MF|%rhzmofr1taJH+Zg3(!mEx zZeKrOp=~&zE&bqnq5x;8xWrs%R!~z! z(OSW-siLn>_=FRJVAVy`bL#*oX?RCzZD%krM9klR!ND@JaKXSxz+}Wl)IGqDvf-EI zf4&ZQV?VZ^iVo)_MPlpJQp>@Y#;MB2iy{x$G>T-sd>4-GcaYFWc6F?+LHWBv!kBP#( z7~8O@MDo(o6QmKW;Ay8TEw^VIJsSse-26^k(v1YevHuv5bq)1vx`zmq&bAxH)c*d5 zwMLPAI`^)04;tVJm5*C&k>3A|+wn{qn66Lr`h%_ET zY#L>ffI`lQ|L#Hn95;Lczb96`qFyRg)mB_vv&Q_Xm zDLYUrw#R`?b4-U4LRwALA8(GAU{MHg59~5}`#x$`e&9faYe@2>&Lpz{W!1k_&@$I7 z{IJ1^-@p1Y__f(-TXwaFX1M3%tb*ri5&a*hf)gg8QBjm$ssO2c6@^Y^!uVj{cCAS_ zS8dSYb!|O23q~Bjx#n|;43o1kYKuH^GrH1C2@OLmiS9#3lcxE6K0xeoCQxDJ93|$A zlEh>nXh$?7`;RAs6d+2At2_IGg=js>xDr6fd~b5pjH5A zQcMdBWkMkruO_~Vy*^!{5~niggeH*ZLsCjnA#Gz&%EsZEU<_+d2aV!oykYq8T_%xg zSz++Om&%BWlk?``u$mfn<;s5T{Aq-#11(X%#m%nXcA={EVi*P)A1X#3Gt;2ig;vbW zuwa`x0h{5&)?j>4$xW;0Wm=;0bcqVN*Y`F@rGq?)sCgzyGkTep*Q2^|Tn1!3x^y0{ zRS)txOy%{#iYM0Yb6-M1_&R6czg-K%`S~puD4Vb0dR^zsF%bPo3;vXe~58)-0x)4>_1!| zIzLif+>Q&qiu*Xf(v-1iRp|nUO6-(O#wvW49ly=`XPFO$hA*)2Wh7bpV8Rr!P^7O! z@KJseQu^*It~3sObp7{x`LXuPjWrtOnhncNh@8ZJcci>6fVa=~Ypj!XUXBY1`98Q% z2a@AoeR{)O8hkNS1uh)p*s7sGHmSYEOiSKPfFxI6(6qx(DFG z`E}_ZY!_-n^zz+Z==i#$Ae>Pt9{EmNdl>4%J*Xh(^DWoBPX%1+)6X1b0`bkcTjO>N zgQ-DHIl{=x(!|CdU>5W5%pmCxVu=K-?ZF(6tDgt+cn7`Q0>Hf(qojejG!O~3{xs1X$ zO>CA1oL|#&J$LZ(1_z(-b1g;N8 zSPqK`jEdcCSXb<6RE#5NUf*K_nu0Z7V&ozQLn8UtXCJRC0YdcE`Y{&a){9B1ya}BC zG=Z~D$Re8$Uq=)ivnejZh`iwJ#w??-=p`2#yHQ`XCt$GT#6)LizC~#C@VOm@E5qPS z5lDe*y&TY(96z4E9pBV#RqVm~DrW zGMxXW=D@m4;e)&^kNU}c&cZHr{Syk1SeR)(4! zog(|`swiQXQDrCuaTT&v{u5s!S84m??U6p z%@UD&?b5I#@~`Q#8EN%9+3F@&jAj<~@XZsrnC=ZuDYD(o?>}hsJMYL#igt%aVAn-- z^5fx`$ajzScN}KFL1c9++e(d`og4AC-zi-js0C%39tY zW~8BRmNXHK?&IM1E?bUM$)u%q-ee&2khFwCXrV@5)Zc_Ao5=~Z^ze8CL%AYx6D;wLjY?RfQLRjRPw ziV;@lco@CzRHOp?PUgCFzlY~SEsIWhkkkjYSV}>>;$;{p5!xjtydRI+wO1nZ&ovQDfxPl@951zn!W} zFT4Q6_C=ZK!REynz zBr|k-INAB&g#;d#YI($_S}*M+%|n@4ZZcEUP#Gjr_U@nRaThLdMxtrbR9dE(?uScw zrBeqvvCLP=)p&HpbY*(aDH;=X+66=kJMw8eZfr>B4sueBL?^qp^cnQj40h|-BgbME zF4n2xokEf?3Uhdad+`Lrw@4D>I9%Jmtkb;&B9+wZX?UwNFhEVpTi;fLym4isz2 z<%c=amzTdv*Ej6*29Omu$po;#V}UjnSjlgHu2EQ}nIg4he66vV5}iVks~*kZi1JpI zG21wiq#qWz?OtbvC#qLNz-99*!qyx~_!+cFrInL~XCvc;xJbxGEknhL^mgB2HtBnR z)u-x=fllRZ>mUx4oPY%p9L$?;(-kz|20_T6TJyit08lI^XF1i1$C<4=LR%t}bWc%y zCTRx}sExHe5$8i%lI4`#L~jw#X}EgS&*km?H`cbs5S<8KZ*+~U40z-~5fLLF?(H86 z89t$sN_RkI(kh!^WYgZYhp(v(8IFD~nC*JT4*Ff6lYJ`LpB zjATA{1;N%mz-p82IjLD;Lz1GMBy~$`Xufdrtfj@T7-8FfTtT;_0_&~Jrd=->`0^&c z4`j%UfK?OaBaWBp2hW+wN3QKWF_Y#l*_{{Z;i$P-E2AnEpZOh6ZQL>p`K`I6&4tdy zf_g?JQVs_;?NTqs@bc1d$R~JAs`sb`nr!Azn03VoJLW{j67@Cg>I$F2N;k6gsOYnG zzbx6ejA=fAkXR^RbsFIcMNPY{gEi|@=6<3ZvJ+OC;}{G(EsDOAM$o$R+EU-p)$YC=hAVw_Ocj^OVi zjYiLwxKV)}y|d!?Fz=8D%c($OXQ{;fCKE)OnH2?Dgy=L(o0i-}YiPpxwcaY6zODkH zG42%U=Mhy(G(o+1J6`A|qms#bq*$hGDh-$8Xpf-6K{#H*<%-&`%uuB0M+3aCGS;XG zV5I({ci7Or;GYNhyTV$`?NU_AzGMZdYyVZo6GE&iU5SsL?-8f4Zn5l#LW_PzvSO$7 ziYcMSqpGkL&1+IANlDd~4o;&VLaOLg_>$DgK#x@0+lb8R3`^0psipf7y4-O-^i5oM zxUCC6V)3_M2&J@e?o?n%I~g`rq-x9fb^M5&6_%iBGWenVd$bT!Hq1+NkBZ|l<^Alg ztCN)_E|aAPBPm>%?)XW+^FEyDlqLPAP?Ij1jzLb@uR4^gxFCHL(mU66g<7ggx0Zk|Eo!<=&)E&;B?$^0*O>->>AxR0hu%*C>S%;&j^2|cSZDY(&qh^ zo&tT6_ny1k%aP5sO!T$cFi8sZ5LJVME<|57t+V=L1s`b2KCX8LYSw)~bs4@4m}n2T zr6BZG>4{=xvXKN&w;`Ghx{wUbPnrsz9vV#ByF+-8XEj6O) zBJ|izHN}Pt)6&yf!mi@R#;hu6*|)BZjv+8M5>V^A5vI(3k&*N^@8x@UCrYNTNNFOk zG1+u`59df-qtluIJ^BNj4GKN(eqR%l8*?-^o7YD>vp9K%G(r{TM~Ord_yFhzN$2TE z__y#9pcVGEVuWE7Rp@^tCbv7BN7Ti)BOy9uAx$s*+&zgL4{?DF~|l4C-uN==1?#{2wPd#GZkhyKaWyTW&#iQ?6)fOh_0mnB$NHb0PmGp=9np2 z#sm$xVa;+)D&qX$#F>5j zjwo0z^xM2XQkwznLtDJiX0EED{8-jZQHYxzJmHVYU4pRsLnTP6K#lm!^AyIZ%O`-g7`LxGS0 zT4vGzaf(LbF9ruP{ylo$^|R`4DwBl=@VoKo%>tEwfKdQkR^RW@UqR)1n15|3HyeQK za`6Ua^8emu?kIR*v=3IRh3c@VDWeK}Dp0bIUBf-=kHVrETbcF9-6s;eoIUV%UF=w!n#NBvAu@sHk%E zz*f8yj!*@2! zOn-MgqQlFd<_Y{t>vVj)iJA1a;q-siU7#UcfnHK9E{ieXAs|5*6oN+E1y+mCn@k-~-RvYvIs77vxo&mjQZdm4JQ(Rj2hz%yoBf{=eF496SesD5%fWM#*I{Kt znP%mIL;1mfzmF-#VF4^RTiZoK7;apsLGSB>>p}8ZsBbb3nNGVP0f2Y1^N$n(rLeB* z-TiLv^b%3F!sY@1ib9d!juK^ae}pjd1tRkI<8{D_HmhkWi=}+2*i}IP0ugRoP*epQET+7OJ=3@X;5~QUa zngN7K%UC8?$FE3wubU$)2D`xCh_0& zIeqUj?ugh}i|+u=2&`8685|`Hs3CpdYmLp%a+nl^g$&#ZoP%6zKGR=BAa^^t{i~V} z%0|=K_~eHXa-7c54 zy#1-KrBhP%z4igHOGVV`xFI?UxF)aZAXVH%- zZ~{nAw^smGrujad4&QYO-|cIO1U6-F|$lgySu@NVKY1gX}bgG?P1py*SQ5gO76q7XddrZ06jA`ZDD9B z6XeSCeNGp004Q*NDxg~5vQeeWk5^cTp0>9+%jUlT)MBI^faQ>z?A%|mvVnbS77m0U zFi)VnJ2kMygXvO+|*P>GW~K8pwUZ-M0M;1a}~e-#j1hwoMFW zj$Sbo2MEVP1-MXyZYs3-I{v3b&UOh}uK_G+I20Om6gTgo)b`%}FD zgO?puTilLCLlDlFwy#QS|D++{Tu{eFGd3{M4?`M`r82DnELD2`aVOJZ2Q@i9$I`5K z;=9!}obrNW<1~C(n|K695eyrvMYxOkSVpqY=O5NT@rC?aIV6+TJT^aX z0zDw6Ysf5Bub&d(MSx77L&tL{^8;|w_C7HSi3WBQ6>MctxjbKt zFxBAzT-TWwUYSY-x6Nt4Fg0&;VNB@t33D?7lNw`&I&b`B(+{g7;E>fRZcbP!0J z1k1gqsPKFy{Yb$$I2I(GKT)B)mg?=&k4T+)5Y+P`?kyGjfZK`N!#UKA!J+;_BKEco zH=wQ5F)a%z`(bHz8b@{1XKT>Qi_hSH9l6qrD8~@>1yjX@yAa5!wBuB}ueTrG4k&xX!_fl>p1&4cW#`dV z4Vlu4&l5jg?C2n&(WOrbU5>KJ*QaYa(?-jg0%3;h`YFLt^}NsG*Vs@`wPq@#9(SWI z{abzy=1BzGD~vxGON``2UHFSFTGuQjsk6?F)?gfI(0x9Lc)iwar0RVQgdBvTG}*7| zr^;U|$w&d(QqGNHzZkw9Pnx%`}M4{ z12Kl0Eo^%v74x>+a;8M3hzTOE1o>B#x^YmhAr)!;TZpV)H7jEnL!Vlv@Kd3eJ4iO` zBUJ`-3-Y8d4q+}aZ_+f=<*}UNCd7_7V9C^qxh#3%!mE+-8)5Reijhi_NC znY>2S7jeJc5AsFGl;}LhL%37qzj*S{3$*bd>zXNfgR;`uELgpfE+nCqs9k~y0C-Ia z?dEv?s}E{ludPL}c8;p_2yjE;aB|6X8RO0B)t}3LTQ-U*_{96Eh???x^1_Sw%zc!? zASsal2|^(`*@Jm`hwnK-kdSh_;>3jRh4Fy~a7n{!To0q)zJrt;Tcy?=9lTZ&1d9s5 z^`t>A4qds8Y#x|IJB%|LOupS_ViqU+pbhd4tS4rtb`~rPOf~V#9#J>U4nGkh*{40q z|EXXcXEC`8rFmTLF0Bj{-%GBmnlQrhaV@ZZq+;C6hy}tv13cuD%+7cRvb2ue%ge&q zTZKkz2k4q<_?!CGdde#z9Grn%)faXQFgXsbOmNI-arN{x0smqJKNP!it!n#~&_dyE zB>2Nwp>&3R20l3&_B&>u_b|@&ye#7IrSI5`5*IgYf9c$~e8Qup>`yD_YOnOMsUW5*FVSe3iSF<+ zKy6HtaHr|&^suFf+H#yDIsQ-wRS z4JKOHW^d8xVMjYFp5sx8*QRnga2k=ZbRIaSQc|&RXm0)3UK8Q&@2piUaFF|r(OotU zS*bnv8ZQBJX}BS-j969e?u9kc<%jFfC3v1|M!CoM=ZkAGSzIstNhMbJ2>sc4ZAXZY zvwQ>Vs7XH>6bH$Rr&c#du2}>Zk$A_|K6Qgo%Ko<(AQ#%NLSC`M_4l5wSk#+mzkiGM zr(7ms4h#=>s-=Uc`fAzYetLqj-P@#X4rQbu$#kn#a|X9belf=3V!CJ7urix3g}T;Z zp^H!TA)VqOw6Dfu@%%`kIM_yL0ui`>w?HRYI)TiV(I?qP?d@(*W=AdM;bE^Z&6wQHZycZX9 zP~2)EwrGli-FYln%J^ei8olcH)sSM=UHFUnu*K0BAGqrle!3z^cDQ|YFP;yx(F&Yn z=<|ph$O`{qQEmJwafoy-X*h}2B-jBzs}aUr5aveA3%6-f`erg;3Nvn}#qfjYEM}-w zLPiU#?k=!7?apZq4L8VH_EE$4=Q8qX&2tRws9)`&sBt1DqBRm{xhH>KB)ND_Kv%A9e4r zFR^xthg{0s|EMvz6tMIdEAMkD{D^hi5n>9m_M*^AIDG577KzRwbqp)>ufm+9;_t1x zI0sKx z2~nQ$@2nil#?rHav~|op?vUi*5dvyr^(?7UjoGQS@SmJ&(H+O)$zc;ILGl1OAacjb zWZh-{sHup0IoawA3&FDo$^cuH{z>u}(rZ>!I%=41F*Pw?_dd?y6baXas&EwQ?jcQI z)X6vtlbX{G{?eJx3QWirf@BS)fOAi}jU;e&{;^ytwwB4%mE3M9VAmqtfl+~Ew3&Xn zWY{H~9<@Ti_=(x5KNO9FxT)!rFU4kuSc8_XX{?OBXA=t`a>v(RD(wz3iUo0U&0ru)>|?-FLCDr33?~P$U$SIE9T`XIv!_#lyfitC zki9JgH4GiL#7RMDrL*t@ge(2bX^sy!ipVMQSQP>x%GumYyd&*?(atl}SfG&1+3$vmow_xotqq$jZ`l%h7W)wqtyZ&oiwaF-)%2GBrsIBCkO2B0&=KAYk((mfJhe~JP6zj{Xhcm4c-SNq{v@bR1xAqny zjB|ZWzzm=fh(&2YUdKJx=R)SIXvowo=etS|s=eL_%+KWwt6t?m6G2zYwZ(W(kjL`Q zZ=K#+PLsvcg(~@H#$5;i3^{Mm*buKkaXPGy2KmV|)EEW-@PsK?VhkS#CcY|C$jl1m zZ@Z{!Ir&v{3>v0M+8xVm03OU?Gs~OE>`N;2z^Vo7?Sk|(+KlYkf`LKphkwiF^7Pv1G*=E(-p7DJc&lXn+1yw zK&!j2dKLq1K+?h(SS7a8MaaZM6jY>{5UQCEz^ES3Iq{auo*l9o0N;YIPtLpR?awzl zM0EQIku9d%fTBcy_Pp3?+D_4t*Ad?Zc!B)=iu;<~WL^lZ|J_CyAfhN0f#;YJvHsR; zl$4Y;5$^>}7`1CDA}AqYQP}&ue*xM&Zvfd(K4{09refj~9UCi^TCLyKY|!Cn`O9j$i1hvBmAU^( z(=L(Lhj2Onw`>ohu$io%UM8i8`%o7ruM`DP^)`(L`@!t&ped81jSgl?f%E&~JT4#= z%AN>23M7mWHz_f4C4f1&I;oeiZ~6e=&*Rm85W?wv%_g9m1Izk*DjQat%|@^bjxm+^ zMGTJKRLQ#^FEvQTtHB4u68lW3uevSS6)eBgt_@!KNR^*?E}y{;FD~tAV!Jx@YSi34 z3cmdeK!jC5kI!@fz+#;La#W6~?K{xs1`wK`)dsJCO+~ABA~ODGU9ikstP+6!$^m@Q zoC;6{=FI)nr}FRp;z-3No{vh0Sbu$)Pfyq|Jl!-kYzOf-CR(r-X z>%k0j_Z=b|e}_~)cxN=d=X)3-J0=Am^M5P6Rsc`-jHsx_mhHME{F8foU`W&-7(4GU?uxa63g*K*dEFLBdJ0n5@tH>?D*p}*P z45`3eQUTuw^wmc`a__Dx(!&TbOc+UQHb@ceso+lLc-JG9W}tkb#Nz{$H@TlYJ{Nwr zvJ22|hITv41O0vjp>kXT(n7%NVZAFz7m6fuv`Dp3wgzi|4QLG78OwykL{^y3eBWY~ z3{X1Y7N!JHCRcu2gXre61USEDDef!Y*K~W`WN$eJG~Qk<+Ej1zLLz7P*C*Ej4Ia22 zL~0f~TIoFs1+4&lU}`;sFkXRq(KCOb`4g9nNYRL~nViTV_EW&(wb(ef2;t#HVlYii zB4Q}+BEK`J7KE1{4=2;dcUWp$w8?2sMUKLD19wGdK*&p;o^OaQt50^ZGe-}eia>Mb zDqGmnJ^yAonK!$tO|sYGuqK$)R%&W5+!eePpH@>tTXzn$CB;bschB;WSz~tT;%{yy z{k}s#u?dml^vx=h?D#$&H)P^_nZ6k2uZKGYu~SjOK=Qq^5LaSS@eunz)jUfF8n&i$ z@C`t@| zk(ON!WzjCa7ht@at1*M=DIT$yt#(s6zw>Yhxn(KreG=dp=+>_OU(^&FA26lW4X0KG z!i4}@5Gludkx~O_FsA+3lXpTD6R-zMB<0B+OQ|;(R#}FmuDIOa<9lB!3KL%UA1Bvi zU?~oB)aJZ#%SwCmrdGC*91~o&Xc%bVtz?1be*!v&-VB~m8GL%*pI%4C4emh&PxAsWR7@FJ!rV8>XMh`f(j0=}sMw@rl!Zz-D;5|i9vhN?D%e$qpN+I>8E8+b>+#LpAU zUX~m>7Uo-7&Y&zg?}^l6_^gD4p3Wd^Tby@6oK0)J}ntfWBugRG2&-{D)*M{g0gI?@WeP3M-h!%z0WOu(`~)J|)I{;y{=nEFsKesEWq=sk;HMu)U$<2TTjNP`9LzoQ-=+ig?AW-kO2XyJ{*VAclBL@;K6 zjvfy?C`SFybxYtGM)(G*orl11CR`RH1keE|Aqu_5cVnrWXsCdj_JtK(MYN+to|WMJ zWu|cLn4epd#0uGjN*m|_$i6keceSi?P*ETs2`8u^WsZ5Sm6cd?{N24+o=i?}+FySR<;KY`EN6<$)D zbEtj(!+?XM0?4*E$Y_O%bA?OdoyO5K)ooejpZW#`bV3RfD4g_N2(cZ20Qx_rw<5Z7 z!IQkuGH}WEfIf5gN{)uD@{-G!{HLH^A0-8f;vE9|(|Dkn+JUhQ>#sXBw7?Q{pp3w` zcK!Fg>nf1v+L}r<|5b12NebujTbKNd|6}EUYHttVCiZqG@55g=qrjanK2X(`eASft zPg(uv=emM$-g0J?^?z@pew#>Q4a}7v`hoE8%g*osF7ODa|1y5&fA0426@P2=#dAVdN|imv=1E8S@NSK}%0jty#{ zaPup=_}?n^KOZ6m!XqktYV^ND*3)kpFs@GY?@F(YU$gd^ys8mglBnma6W2z1;}qiEH6b)D|T zot(N)DhF@F3oMDNdwV~_nsjNjJDym& zSHAqcpCBKIK(g(I*4Jm^mRK|h)Nh$GVW|8+zxZ6@Yiw>Bv-S3^K5sOvy<97SJ+5<6 zo-Qn2A4HwleV}*lzw6z?#4|RL95px}Zm`i5SpD^UFPD3NQ@ySy(UnjRwS8%p?y;ny zvL~naH^$5|gMyG4o_le=5?B2d5wNhO5w&Bj)8dtjx+||&*C86u?~Ov-lY^945ag{y zLD_3Q6kn=5G>?=XWBcAyU)Lw)7tSZ9{lTtHK29@6ZNdBb_{}9Q3PJ&bOj_rn?!rx0 ziyw~giS8}+KC#%YQobG5cTXBJLqk{yyXGvCY`Cn;v9@}0I3E|BEf`fZG}{HHMrtY# zS-0pD8vWfb&hzmuvBu(xNmAgw-HFzIP*Mqs`P47l4y!k+>(*yQcezv03Zgzi1}5o8 zrqq~RGEz`}8u3p2f0cYBK$kK9hWKbiFI2E27%KE-;g(zKc<%GOme4z)4|I&q!n~ z-Df?uT=}wHKwp)8d<50a-|pcl)0&GunQ34`Y1glIv+G1(n+8{;(`1 zHPzpCxI4F=_?!@43+#ctu|Vc?*?p}=cAb;j+I~mD)yb>Gj<=|fyZwZ2Xxlp0g9y-D8F24%khDhLgjKo6-L9cCB*Rg&Pif z<;%+=0pxP6cj>g?$!j;mPC^c=Vpk6loO6Uq@~!q0?;$pnmYuTeQWHFD&4n^>TBtx%z{sM)j6;%u@;PHcijPN9%$R^uQFx|m_$Vj z0Q6QvH0GX+mcZIb(fptq9T^9M{%?U3pee7phIRoO7W%L6$q-Z6dflV8Yd(mdSbsej zGk2^cyuD67QRNu`Ya_;!mTuq3Oe6leGliccggYS2lm!!fO?)YjzS6nv~fm7bow#!Vup+D}hUj!928W03W~oAA})*aWVbLK~tSra(*lp6p@F zm7^N$R|{7{Wy{Gzs@F31tg51}q~ERA|T?OrRFNVbR5>%))} zuPcQtASO+pj84t9+Q)ZqDBOgfvuLzlfh|j|K^>M5aE4cz7A4n#Cz+6s*T^Hq7JemP zY*TpEgFB6zn8~nZPv*0iQc_nebogvGat`ANWp&A3m+N8M*xSCfSEtomx7!H@pKl~E z@2<^WYex}NK&i!Lv+88VGZ^rL@;qIs4xzhZna^k1zUV~9TCLOcQx!S%K46QLR_VUuo(OPtK*>c%fFz5<=W#Ka#kf6?Hy1%wrGRikk`EUiKYL?UT6oE$@WtFbxZ~j7Y;^QGR zBxY*)IW8{cS3J0KrT@M?va+SxAhyGruz;Yq*DWgFuJ9ttT73pu@G8&5N3%>gvyG=_ zsoEV6E+Igg<&VV&{|Y%nI9n3(!u=*)&bO{H^y7$etB(r?F`IHgN)p*-1}+)pgW#6DfM1Gvjx7+O*NpaIr>rUdgJ+;$Y-hA_V1`&=FcO4 zofr}y1)zrP3i@=QQt-0uoJwqUYPsVM_h%@qxVheQ|gpVIbGyQ^v?64Mz9u$U}7 z_IOi|x8Af^Xs6DlocBx%mLDAPrMexu<(^2EBndt3B{q`E%j6#9=rR|OlPY>Woa_{K zp|Gvrxt2cuTZ>PQgUV)R-I?^#3Yq}&?O+!q>qki zby#&@Vl(EJ#0Yy*9Upyz{o_YubtSF_!0q@jB#P#cC;nV(0a%{(00hiSL?gvD;&bbaOsR%l-Yvg9*0XOmp-&a`F>z(BY)h{yb8rvHgW( z9Vku07NT~JVU7&c-4MP zn@Yp?lF96>NJz8JaE<%`=t}ANICn7LUyGF`z?GdpD6modXX5u;mET7<`>Ol;ud6(O zEWZagqw_x9?JZL4L|9LA_wN_-U=fBIICDPUqYo(%5@ z=Bx%rIy!QyXev4?C9TSf&CM-GaAd^D`!;u6I)@C*KOub4$KP^vB)%K6BW|BAFa_(- zKs4;^?p1m}q2Nr4PnO2&s0FsFep8Dx;b36ZT8g@@JU{$1-QVI*RA;ACl?%$&fZSxl zvn5pkJsD$Z_ImsK(hV^aO(Pxga>L~1Xyf>1vinsSaE40RB>#BZ-?4gOv)qT-`#7Y3 zZ7nQ#e1Bp2OQ)3me>0g-VM-W3kq9X9`V;wu3M2of41QEf|LP?4IgBz$eo2u3S1YnV zj4~is8U3A5{?~Z?9g6)sn)z2NIV|dh37;tQZ|3zHb~6eQ6~TYEKL5?fI)D897xNMe zfZdF;c(~|at>1)UfaJN_hd<{J>wh7(fAcY{-+T;Cy713wdx!NBcC*-Q`mBGq{toV9 z=?y9WYlPpyln4B;m3Nf>)%x*w=ox`A<=?~je+TzBOZmTp`#Y`V|E^rv=K6nU7B-O2FLPWN+sF?NN#UZ606Nwfre)!GiaNSuE)PKf8S!kn1%NrR{yk z54}!4d%VNwc*M~zSF7HKboHDxZTSz7dJ5jk$xoe!kl{_Fu(7bR?%_c5%OOd+-lz{S zh09#6yMe*xaDwkKsQDh2N0W)zaE>#iDKy^AQ2E`+N+O!n@vEYosIIx$=Dsr7KPLaJ z08Gf#Cjt{JnO`IVyffnI93N2w$)5HPPB2IWH(NPoQ+q<9^Ota2YF)F6FvtWw?yb3C znhUnsiWw^*r^VuWORmv-aNO-}nYoJr;p5dpVVX_HNIWd8uU2Qa!FOV{P^`ZKXR}ZV zM6NEaXaN~Jp04NM>v$PHwvl0w@{Sg^xjRlg8U&2=Ls;P;3VDJAtmn|<6}~llPokOp zHN%OqOaa@$5&78?m7cv`6`k9yiI_L<*U44A{W`P~uMPdES=ukb-@>vwE~ou?>nm%n z|4<_f-%;9?wRR-Y z!oloMYbOu(b~JC}$+NAOu$*oT)uNq|1n={dpWS03G7z_WQ2=%h0MN>&BvLZ z9=dDmFqwj|`Snvg}edOvnm{_G5B z>)U(bx(1bWANpae-Evu?U4$!(D8R9u<$F!&IdfkLU_Mzq6ZvGEk=zYaM*YqVVDX}K zl7&Eab=lJR2ZV+1a&+X0`CN$8qJ=V}1Qd*F%oY!j$PNMS7hh*wW(vy>8MjVmn`x>| zM`1b@YtH6XHq#-kpNh>5jUczK7X@z{Jg!<``9#>BAJ6-1?w>`UO^wFNjGb)_kevuM ztvYknTf3f27XXyrI4YJLuR<|vsiPFyJr)Q?;5<#y7K4a1ovdbyp^Menva;(p$|My! z?TN6;h()+aW>1gL$Px?npX(man~H$E7-2 zXa2{oI!;qB%$7V`uOObl>w!Cg#e9310?g#*7b{#NLE7p)rdzdJSZ+dTyleAvttpEk zpBE(+5z>aV`+bylJT$V)jV<%$cqJM-BD%U*&`tZ){){3^({19Dum=2NNlGkt~KVU~MZp}$=yeb#~=la&Aad+7ZMiLWhC zp>bTr-rjzG8V4rKQ*UPA2@Mq$OlO9UPB;r*gJnwqHgD#nlPZe8 zmWP{v$o8Fp6@luF4|JDzMw@?`GC%q}IUTD(x8V?T-&eaOJzC4U>FIIY3j}ytk5T=k z=BerrR5_Syh5V{Ego(3$!Sd2!f<-OF4l>PpD~AbzMkV3CSbw;5VS_DrV{K!3jz7p{(2IIzG+;W`%@O_r)u%@F<9y|s-TIn(Zxji6{-F?5 zIjhE4n!`e^sK|UdO9>LLBfJ*M9Gew<@>+C5hNDsTSH+g%yFN{5@HEY|8R41K7QG0V?9#{f#u^_JkAx{ zrE}1yt(O)%*iM2z$K6vR626jobFAB1WOZ%910w zpX!b6Kzy{A)X{FKGp$adK|-(Q4DJ4@G_dNe8gg~OCHS~_G5+1ca*Gj%QQ0q=Anh~4 z91coGnNuo+frgs0W{7SRLa(pSbNvDBY^z@@w4g&YY^U!X=ND$#(V7VJ%wI2(b8Z*1F%Ymi zfTTj4Wf)ck?okfMYKOwtRLeDQ@P}8msHz_SPU3{2(cjW{H7I_6PFxbG*-;Y@ZqI91 z)V{hJ6fjgWCn9JVigltCco!3Qx_sKGPHjAq>8n_$Ju=S44#+bKGnf#Z;ZiY{&v#$< z3voHQ3sD9?KGS*obqrcaEh=y-IA89G-fuLR?L_9Ytz(%U%(~csb0@SKsLAPjf8;v7 zrrBU6BU{p{mp1c_NJq-T_o$u~R!5IXi<^qP7gF+NqnlI!>AWfvrjr)9u@c(mPJx05 zN8T}&>BaFln%MZ1`>xcppEbJn6NPb+$*0QoPYFF8Qk=YK9M|C=@h1Tf#T~#Ru#GNF z(U*6;^_Hvdrk)4AwUwQ#{ArAj=6g+;f=ibt^j!0RKWan7V7%~uP8!6TZTR!RB=M5mRlwm5Zul3@l8a~~u z0oB`n&>%IpL4bUQ4VDWq^y!$g?Vu{^OZJSEksC~@>>zKyUR%+KHt5%Vf_hqLHyRY3aF z->{e5Y2Gx&Mlv%w`R854*4eSRd&GEdUO4O;ZDk%MT0IRcEW?fkv(j6qk^636E;_XDmZVo@=E9j2uS_|h=^n-Wm2V?3| zV_>QtN*s;vY6aAHut>knNTRj>4HcYkVvs)kEleg2tMylebiKvjn!Z9J==CkOYVK=I zxDbc`i*x`vTXWaF>Hc}?>~V9T{K==k z9^LOQgB6?FhuwN38i3~M>=cohkt|cFf1);9qh1S4WO>RH?((_-v%uulROWUyzEA$9 znIsLy2QI)wiO&jK4<<{prn3HY12AyJBdoBRcLa2;p*Lgall}bJX z+2Y`kw-d6*9s#nAt;P2>-kqoyBKq$Ulm6~En1qo9VC_BGg_R^*Jgj7vN`+R1Wb8+N zY#0N|y5JH_#LW^s(#|vugEt6GfEQqTW_4bNX=}W$&7II8cjA*VJUG$R;IE+Tt#Y-S zb#SvcTb-osat5=eMfxXhgADTGB;45xB#n)49+%l*)vyb z>l@hAUW8+ETvm&t0Y!ZgxYtMQrx5caiW^O%R^%^sk6K9YXQ=;!f&G=pVKgYcXh=)5 zw7+hz_UNr()|tu-^}?C`d|5N5;NsdWi}oF#s@%bRYgqDTrU2c-ub1cz7T&vsvYJn~ zumw=r-fp=-DtJCHeV4Oti~W+Vab=Z66`T6;goS~;5tirAWj()fhuGN0u_lf>TtW?DU;jxyagsrb`8=$DdU^$#L9x+qoF(ex&jL~YE0xI)j6ItGIr z_z0Fe__vu_Bwrd%-0KnmbpfLX1o`IoOQwzqQT$aK7^^m@XphnYp?Ok?wIB1HY)wbbUOD|KT|Au=Z8b9&%(n?iAQrfLHlAg|1$unE zkK>N-@Eov3NPvO1XAILBk^Yqo`$>%IpH>OiFnko#r3B}Tb{F~OU;5BW=5NqM$n8$( znhD(c)I&4OE7(9D+3OH-#QSG7zAs@`YN~ZYNzT)Ex9CJK9U$HzR3w)L=ELZR+g0;p zgXbQN-`94<2BdgZj!pbL8=BxCd2x%r(Kzxb$Q_dZS4Ob#`{!~h@iP(^M1)v}tVn z^mMTnxIbPf${P3Z9Q{U$xyoU^+zLxJmuj@}b{8zDzhUCPzFpViQDWw(vjzqzn;3T1 za>CMi?}oNnwNH-Ud)*RLa4XqzW0G)|Y>{vYJ-T6DR6qIQTP##S`iUke=3%5hu+rD% zI>VLPXf#=W6e#+^c=Wb2FdC+Vm#;)~ukpAl$@>Il@qauU$lCo`{NDFqtP9w1Qui^j z;ZQm@H)xfFkI{0T@h5^rxwc06@Ig-&(bGoS+EdkS>j~b{nM@jItKCL`ZQCPpG`IKu zPu1_p*9$Dukj^gA!lOqh($i|iK)MlkIUD_H$>xfR)jRlNDHt zEs$2d^`YW%A(Ov545J~&Qo`c}kqNOV_0e{!x-Z$XP5~#9^Uj!7l?bDm+mIuBCu^dyWWb-F#vraOiG( zvD+76g|4#)$PPB@Zuo@+khUI}&Y?WcckDDr2bIxR`~%+$0BrtjPhF(YgV_oQ#B|HX zdhNWZ5AcDdAna_YGM&luG5GYpXM3K9;J*^U0Gf5^z=zvwwfQpjjNLh3)_bDiZ}gVh znt{>Gm@w9f+M)ZMolc|9E*R}ix+cUhok??kaS>Lw+M$)u!)7>!wI_lF4MsOn&XbBu znkleJ9Nn*^U%yuTD%)ITwHHKl;b9(?o+{v}qp0Xm?aM;!slhvdoh=jGLlN!Nx*njY zs_P9IPADy>QnZ>>sx%sp4=XR6uC=s0Y1O5a({fgE{`O%a-Lyu8`m9WS?KeZE#fN;9 zahU8iLMhh-#2%n6Di_<455S5Qe4i`Tb=V$MF#QVW@C2*&GMXh+X@4br!apJ1 zbL)mC`UGHIx$h=Hq4yc-C2!75BBnc+V_rN)zKr!=0*878sK&_ ze7tD$MOQ%!#F<-_^%)bV7SnWy1dn;9ev}MCAJZ|?_!Jyfg{UL>yK)elN&uCb`uMXLwWUCD&I#hQ619TL&r*c z^E6~K--e%;b#*=n_@6Vge!x#K7zU$_m!3W6kV1C%yu^A`BYZYdF-AS%`q87VIXf7c(M zfp+v&N%$z`ql^{fX9V{#iPAEePZE9M_=IWUaVkn3_=ZFxf|sv)!46)jp%uHnJukg9;+<3EzpzZ7>s%kfY?FlEwEbvx0kLC~y<0 zw=ST;*3sASqW-e%3^wDw!F(jam*Os*PKn+~TcFQ8$yqbX(S;*LkU{>eY($~GOwEjh zu7_amBbC20RwWbs2C^EJfwzR9$-_JQE$X;pyW7cE?>agV2gPjeC|Pml6r1e)IjvJ$ ztr>j{S zR30tXHF)fNz)85$aBXx8qJqi-ej_=jHV0MR+62 zo$%~lli^DY;<0X*-7pndOZG<}?W}jjJIe)-B{&ioZP^855?!-*o$Sq+#u06S_BE*! zBBWBwUFBX`7tlRlG(t<>>+A1_eH%b;7p-@XvUBkvR8gALA@|?>Oe|&ueMwz?S|carGB<@` z0e5r@&;Dwd0`?6&=WB8`-?vM<@>uqt#loa?oQ~A|WaUN@%Lym$44B(bcfSGH!8(dI zPFs~6Tl&h+J*4vT!-@)KRF;R^N%uW=5|UP3eTCwrHkayWYApeToMjh1m_l(V6YH>& zX(M?OQ9lGW>s%A3pxYU7vo-u}zu9F%bbVNh~;B z?$s@&!y#*}=_tOyU{%J)mv3^70UbX>dLrWFs@ot|7(t=YA|-#uEetrkKi?^hA`=?d z&Lo3+W-)Bp=UkKIlp+c}Kio?)=4~#RXimtf`9Q+q`*22+XFdC#>a`3%5Y*H8reizF zSZwkqqjE9ao(urm@MEtlTST-0n&DvI(;>6UA0Be>?5eWTn59bXnJW1#c?!6rJ$<-% zbiaTq9REdkZk7*~(-C3*!4^y{&H4lk(rVir8Jv5z@bx0r%qHg}L~7v-WWf;DZugo7%4H1A{uU&5u3De;r+ZDPmrwzw+3>Hci@6wbbJf#yhc1Wzvrn&l> zB3yX+$Ri4#y#|oOLS$oojZJY$gXz}K;+q#h7n~qC**dBJUHU1>76Trmf6p z>$k$V#kX?Fg7FN`)yapbikr*k-AtgYNzh+&{5%oy(l_+bqTes`;&6FyseXinw~ksn zO&l|oeXmo49ad(J<`k+ZkG?Ofco@mVTW>b?vgFe|$XgZZxVx=GMDrU(Y9^JeWTc%7 zVgHA?bki*NcpmwgLXuSWBjJE9Hu;;YQ6f29Zgu(An};4nCQ$Wqt~f<5802Uk{CWQK zfSdq#z?R_ccC+byM%zuNEkMgh1bd-kCRI~)=vg)2!AI)@D6Yj^%j?^#O52M;3i(*> z19k?r_iHc*cwA852SRJx=2%a-MPAQwe!K$x$XGDfDmRaJIbHLKit$W%r`ZUX_xgoE)}RWz1*Ji zned33SN;)|AfU-9x0hyf{L!I#w^_t^fY0U)EP%imi_?j_re*WN1aYu=Y+2$41Y9sa zw6%Ja3j>c4*{oHgs)E7TNn97Kw`{Pa#95XP)}jJJ=C5yeXTOJp8T&bouB8ZTc`Z(g zlsSyB-`*kCLqtZ>scIdOo+ULec~9l)J_DMS{*|C2guprwRZupyajyaUqJwc#=80w& zm=JqRTorO5EW-+`(U!RfhUesIf2Fw6>?rS#;GU5qf#AuA*Oj%X%#?wsPv_}!ba}YU zlG`RGkBT>XQup!;m^J2GJ*;kkp|zTQkQ!fOjeVcrDLJ1Fmw0if-`1u9Or%J<2-wZB z=OphmIlc}IlhUWb8yV^h!g&8fdR@^u6FQA5!;iG}@#t{5_PcN4^Kscxp612wm)}cA z=_+Mh7#5`tc2RpF7A%HPRN#}B>I zxX%damzg{LmU^qVOyG8JrWQy&9vr8xIoMX$Pb!rrs$XzZHSrF(4qT0_16gbWd3rL? zMWOFzIA<@|Iw$CKsZ3bNWQi5Z)M7h#lTT9Cmm?1L8~5f8NY~zn&-^!d29r@dv>Aye z&>y#{Z;^ZC^5?($Z&8Z3=+Db&S(K=m6mSzGE0uo|qb`i6^SF*A0%&9jk5VlP^(8I- zlG>g69<8{l;Vcj$+Idt?i+yLI!Q|-{475d55ElJX zkwGNTCt&Z7fRhdP;xQWGmI^*v1ve|xNtUha#0s1GyT~5uqb%|pXmoQeL98zJTRtT} z1e{;taBMr;Q(Fzcuc8%(NBQ!*vDhzI2C_z9&c{o7uK;WK=eK2Sy)P94(otf6{qsLR z_{+UCqoGaWH%jEY3Y}SF9*-&ejW>< zvvOeksi&&d&<%c&{G%)Q1OyG_;e{i>``sSVQrC16=<=#4{)NghVkDKy)f%zwE~ZN{ z@M{iz>QhOMDU#}uP}ad2NUrye%@*{65pBzO7W5ku(CIKZK`ctk7l_zp; z7uTIGTsICiyv-gatt-n%RYx+x?LlYP$)iJ}8OukYW{d@+>1J&^hX0KCUjv+gpp8EK zia2S3lM-J!ionb=yE4RgaZCb$sKB|P>SL=_S$@n7Vg=D zSgB02QHD})XH_p{i|XcTk>1*k!cT~yheDxEw+BmB@e$8G7b|t&V}$L~aDFP!WIIgI z-BKODWGF5kVW{kr&>uZd4VLH-z>OnM`L$C8u6X-B&>?lfb>JjyqPp?Dy6Z$S+yVfK zo^kWkZu3DTJM~T7bJ2w#`f37)Fn8%f9%wuRY| z?(B9N|1KRM?d%)9{v}hl6~0rD zvD@MH-fbo~CK{8P9G%4}(f5gm^P*6He4_&z%edyvETL9#NKH$JYWVQx@mZ80SKg=P zIu>&LG~Mw^H!o46;^>*5zAJV1`k{dZ)d67-tIab1?CZ&u-z%FHfO$*=9c9mQ^$~j7 z#x%7kh$J*At1OLZyRuW&+#b}n9+T6i`)Im7J7JP&k~H76lycCB*g-p;jQbu=%Fz8_VgP8o<42By9U*nSdR+Z%w12dO7>x*s+X8*vE2I z#g))LCRsFMMq^(}FHNU@P;5nymX)2q{cf_z$1+9$>h_iFV;fCdEIu>+q+^#@ zwEGr_m86QW5?&ggW>x`StYfl=}eWw&Lb(FNoNW_+>!Um0TLgMqu z`0`#M^O@$~W*24zTI91!cNn@yzibQmg!bg3$C8O@d2Cpygq`O*J3C{Iqa20mDqIE_ z&srIME-7kvT@U-YN{cLF72f@Q>evM(jY3BvC+K6|>C|GC^(c81UI_EhF}rwEbT?Xj zklq`>4=5-O+rcgg07i(z=lY-nVdY za`{5ORK+D&J>Ph-v9<*q)~je3dc>FACi*|uIg_r){Ix-5nO zu761NA%9xX=a**$UzDQOiO9A-P&KJLj_RqyMTQ`5c8pF19>v&J*v1R&J+Qu5fM z5FBIHP%wR#9GQ0^OFdssDIPrS0+8sz3Nd+y!RQG=P$V^qUr(EoHK%A2AewNSCiJ(B zW!D3P?B4_Na$>Ys#e6Wd3jaV4HvSbR!`KePnQNp6X2urTMG>Q{ADWWS4&joqxiCeCxOsh@*>@xr1xe!q=pDZS%(@IUzf`f_ z#8F`2Q8yvk->@lhFi2YL7gh3w*2L*yw!YU@mxLN6yZVS*FD{36UE?7;HZr9!Qa1W#bIobd#Q-z#HOWK2AfF?JpV$4Mn{qYaG5VG5g9|BUuDOLdN^eYI9-2ODx4K z10)5TRowPX_exDb6*J}cuRI<8!j}Je`0N7&*6KI#@bL5l5KV&enh@}(hZLzXlBR}` z7j+Jw6xT9f)%&7WI}$X67NiGKs%WB6f&)-n^FJOl9C0i4A zA6Etzq@sTodbaRA0@^T;%K-Bq3;~bgR0_L~&CbsH|E`5~W2T$E8*rXG+`{3B9rVWA znVqLOI~Tg-EE;Vn^`dpNrd3}LL+T&fDC{qXLg3`U*E~ku(GIA{8Jd;kjIZ`z^-q}D z{`y$2rl|5Xb{6kDel9UHKl6qZ15Zcpt8e-7>@)))Gfr7rD3z;lOEXJ~WhikLMEI-3 zCa%$k?@81sH6y5ca$|*0LhjV*%R)1LeI?Kr9_jJXJI`|}ok!(=Z($dRY(`ESGArGP zv491><{chdjnd^O05KFoVdyMfj^Xja|Jt39Z3-#C$+mbx!v-^waNBy)p_L2FCUi?#GN%Q_&q z*ohA{58w8s+ePC=^_$m*qU}^UtBuiw-^$O2Ep%6K$r3cIY^<=(thjx+VmLVg9eh6W zUQz8qLoJ@4UNkLdr#*0!JqmP1tGQoI*xRQRU?ldB6y1-%*$8+HZN3<`)V7jQ8Nap) z-i`~Dx{8$Du%!69MqEWjuN_F_lhOI5bQjI@;hxr9>0ISpH_9__9eAoE^mSzfl#2KSD7pD&()t=M`+l zd7_-VN?uEn_z|tk{BXBnPehu5mBuX6S!6R^%;;+|lS0$ohWX^!QWV!`xF-HCErJ#@ zSb$&^K)}`Bv~TvqiicClz$m+j`JF0{oU}A*t|`uFI^?FTK!0_USS}x@&orqV#v<;Q zNi*mgB2ahg(YrVDaaCVNs{ep}^z-!z*-2C=G1Ck*{f05^4hHm`?^#etI5R&x*L(=` zF~2Sp$Bxvf6!r-l8;zeO*5ZM#R@;z?)j2B>NPs8`Tg*gf;VfrFOAE`BH(D(;4*^VVT|r?VeaBNu6@Y1;QG5t``#!;v@T)q!5|LK!DDDqyj*4-M}@b0!ipz`20nrA_)5VeV~) zpZkOFNStap*t$uNm?Fz%(3!rYzlzXICD41$PAWw&{AsQC3t8mt8**ORcQVrxOW@|E zM^R#?plGi@?A>IApUbdn;@D|IC7lFQ$Qqn_J)#Z_LW(C8i<;vJ(zopnduX6WUgPyg zB~mvVbLe+Kl~Cwk9ll$Mia(0_HM&`H7l?nsp)6NQEFm#)oCh(?gs|S-+!BK-dEATR zs`5mjqgNVRCZgWzmt_wq*Hx+&bgp$jg38@;w6-sLlCT|zg93jfm{ZJRTn)!7%X^-5 zVk@<0p^$}VU(Y7we*a;i9H_@sGX*LBXkH%oYQTJ@;s{+La!{?!!B0xgyu7MnWhs11 zZ+T&#+J=EKU52hDUbWiGvF^0GN-fa#Qs99%XH_!w;3LQ7IvJf#VUNUR4=g#JJ?f3*K28gfAt^**YR4ll-WSzAsR+Pxz_huCjdYvl1c-OrBybguy+D>c#3Qf79t!r7vh0jFQc&Ph2kIeJq^M$nC{yhoZ zpJz|aUA9fgQ&b2$JJkI%i^`-|^goHekTbA-RH;1Zn8hxC4SErvRthv2?8J<7I(>nss zMHqZH7(O_FY47GKpF8{(mxI)B#(o6={GyeD zq~pnp`Sa+j=PW=ka8f~zE{QD9kND_sT)EpkJ;s=FBL3XnH&yko+%nN}f!5O0mTse{ znQ|8!ZBrwh61Lna8d~a&cHs-N^MzXR&o>WMc78GgoXJ)2(K*?)Km#mrqC!<+%d84pnn}p4hI;83Dzri=TJ63+5C- zQ?wwjrPwaMX(U(cc}XIBGd0*OVs(4tjBhCfq6|d*e3!tCQ{ZG|^su5d8}qhxEq2_1 zY!snXh1gjcpu+`p+%lUd+PKqN;Qc?jO4W=hqt;FcjDt zZT}P6375kKI@GgkiTr=pB?VwpO|h$@$qJHaqj7vpVospDyqK<`JU2O8wlNt_e=vV2 zJ3E;ZSUMYdF*min9T1Lz;UJsA$8F;3q~uz)Qq2;n=;=?$e{Y@lZd2neA?y^*sA;Leb>&9IeHW zp7xuYx9daZEwLwRob%0h6ubH^9YJ0@x_7LV*}2T1#wQp+*x%pJRoe`URQQd$b{1|E z*q~MPm2LBV{Z7zo99Pc>*JI*6150Wlft)9x>-UG7aYq=iv0WhzCAb+|do2@*w%R6O z*DI{)^y#qmZnvpvR1ryfYiGuL_q&}41p?!DtL&nCLuC&TgJVpD_LY*1qEFv*`H-7q zQe&G3uID&Ju*_h{B3f8=&gzdZCqN1G*Sn`8y?ta9GcX`g9t_XA2M32yCnYAL+}?VW zZ6{`VqfJ{}jBZ!$y>~`XL5bn3yz}m3dwxh5if>Q^dzH=s4&qP^VMAc)) zI@FVHcP_SRRc=ev4j%Ufv&J!nJr}%BWaC764;egZD+pLI7UL;^!V1x0ND8z+Nc zs}(fB9vQn)!jyhg?bp*;SAM-K(ikzgZNEqj=e^gXa8+a64rY;2^G0G~qBv15qFUNJ z{WgQ(lM?IdUB}_cs94ygzfqrO*i}k z6B5gI^hHcTi;CQ{qhX}YEi3O4C%FaPlwZ~obAHPx6p}8~HMqPG8(})6z8Y zY(mRQY(Xtlx_{o|vN?Ldu&c}&_$O5JO6 z<#y}sP7xQd3tqqIy=KNlLf^34-u|z*6j9I13&O|+G5&|ax2v!#ug#AZuY(_-nq6^t z->xxQTimU8D6B%u`!Ve$>Ec&NLeb9p+RkZu+N$xl=|WnU4@1o(4x#DRnQ2Ety;HAW zS<84xg(iubN3xrJ0l?5d|XC>6$i zx~oS?c(5RQ1sj6Mp|QHE1hNlimL}hfJ*5p9l$K({Sx^l{dp8rQ5f>{bi@)1Z{)BUP z#TNCx?6pOnGN-?OouTt#H?U`BmCw#Gd*m55fA3iWemv%LZ^0&8cIJ<(5a>gkQ2NgV zPI_CahF=H!n+wq!6%B*2t;?wyEsB(7A1efyOO)t6uX*_7d#pd{hf6mJB$y9AfrgMsXSlRe6=4mYh>gOO zNC~Z#iP!L0azUS&vuV89arEsDs`OY$PyOGA0jLVWw-hv)h=9P6SV4&Der z|COToHSpJbeOB}7l&zohZ&d%?0#6_Qm9?SLe;m$au>gF$Ue|47At5gw)*`LqCz}zX zgI@&oc+S~CED6-vU6|+Gam1n;RbSK-)lfnjTSi!7K#sV?5p@`u_Colf5ylAK>**V3 zoDVjAP!sGK=vh?^#Yo@_WrFRT9iyOn=|YdKbCapyLCkl|?e9&K7j^YTRPjxVjx;c6 z@Woj^B0a&+7c;(2w9hN@s?pMazLD2r|Am9n$?qaZ`Us>2v@vx?Ixw4ad6~b#MO5EgSrq6 zG4qK>oLXCVf|3d{HQ$e*b{G6F-8$+Ep`Zq=Uq!g8=v5F+6sm)zHy z*~0UKt!GjSKl_R`i%TpCAp0l7B-7y~R-~ee^Enguc zd{Fjhh|UJR3w|6foeW@XZ4G=eOsQOfOPEn6^O2tfm)9&a*zN7+SN}jO`%MfT@4Ild zVMT?a7Cl4?Gg>?RkU4&ICnX*XA9sSCd6ysxuDAw^H}-b=A|18e^c#8ST_{H+knv*v zsoSt;G;aW-&xiYVZZ|is{iJwnu>I-O(+I=y-_x7+efpo%<1KQXF;)GDy=FGUaFjg} zaj>`rvAZ#)>#J;T&9u!=0(Ghjmh>^dE{z_v%c@avh~5UbDyoGU{4n>a`K$}Uf8By? z2jKp}81Jn*OONOd!L1)8rcm&`tSNK(n7+Rg@cIAQ75~MPD!%WO3E8Hw*#7Q)OS{z~ ztjBNMJ#QHK_e>8H`>9XMJfh;y=(^86!)<+TTD+|ML#b1WLF=APeY*TfQueA%v2TjK z7ifFs1+3{2d&4cx@JNf7TWfjazfT7jaT@P2tbd~ut&nx+e+1k^IO>g|4_s4EiwffOpTlUOt#>4IX zJ=5PC=--g-zjLqNPTbT?aUS1kv-v+$Gc~LfV*ft4u0Fxot@F=y?qds8Zyf#y@5U`z zxl{7|M*+DfpB}LA+e~3DPkA)aNMofqo4K)31+)Vty0&2b^S#OJ>+eVvzbSgSZh5M8 zP~Ac|$*GFKsbRO5eCrAVuJk!h*{!){#T>R@8o*w+-_6grlV#WX6uQ~S>V7;UP%>Ng z!6r+i+9Ri{KWsQ!d9e9tilxyJY5!&WeiX-4d4AoWC)YM9yY;VDO^7*f>0{^w#G!uh z1jJ2K(X9D-yd}J~=1k!+{{G*8UhlIg6bIFUhnVzQM9$4}VlTZvGeCa%dA@i);DxJ| zG0iJ&F7A*PRZqQiyMDo)ddH6A!Ix{o?mXFDnc z-h$}(^}qPfs;H>+a237o;sY+36L{)!S38`5sORip&RPHWM;gVMJI9{k}^5{Ebt*xy~3sbC~ejb*jyxxP?CPGHVx!wg109 zcja1z-VDw46K6@hEdNkhf9i68IbT^jxAejIAFEEBb?FjTtUJ=wcFxKCkL!{gPu_WN z7uQ^Sa$Im)XkGe;KazhKlp0psT)ZJBowVvxs@4pNQ)gSNr%x?EA_mLtc@d2>ZuB%X zFidT~f7QqGU%}#2g*QDKU%NcGeoeY>ef!BJ`>elL&0u>D>meT~)d0;k6do(B2(nal zWZ3#?E3faN_`*e;@c!YBd91snro^8=er)I62Tb$)rkU?x;GYleX*S+dS`hK&PV}?0 zl|jf;0OvV?^AE<$C$T#rdWsi7^8(+m86U3%t)_v_7JLD9Gi#rPd~$$wSAY^#pm~9N zRnIK)VIBkaT}(UD(0Kzrp@SG)L-z7`)Jfy)}2gbFW z1{&9;RM{6Hf(4`!I9YS9HyU~El0!Do6Iv02x@fs2x}klRZVI1K9&}flH+BjR0rhub_url = $hub_url; - } - - // accepts either a single url or an array of urls - public function publish_update($topic_urls, $http_function = false) { - if (!isset($topic_urls)) - throw new Exception('Please specify a topic url'); - - // check that we're working with an array - if (!is_array($topic_urls)) { - $topic_urls = array($topic_urls); - } - - // set the mode to publish - $post_string = "hub.mode=publish"; - // loop through each topic url - foreach ($topic_urls as $topic_url) { - - // lightweight check that we're actually working w/ a valid url - if (!preg_match("|^https?://|i",$topic_url)) - throw new Exception('The specified topic url does not appear to be valid: '.$topic_url); - - // append the topic url parameters - $post_string .= "&hub.url=".urlencode($topic_url); - } - - // make the http post request and return true/false - // easy to over-write to use your own http function - if ($http_function) - return $http_function($this->hub_url,$post_string); - else - return $this->http_post($this->hub_url,$post_string); - } - - // returns any error message from the latest request - public function last_response() { - return $this->last_response; - } - - // default http function that uses curl to post to the hub endpoint - private function http_post($url, $post_string) { - - // add any additional curl options here - $options = array(CURLOPT_URL => $url, - CURLOPT_POST => true, - CURLOPT_POSTFIELDS => $post_string, - CURLOPT_USERAGENT => "PubSubHubbub-Publisher-PHP/1.0"); - - $ch = curl_init(); - curl_setopt_array($ch, $options); - - $response = curl_exec($ch); - $this->last_response = $response; - $info = curl_getinfo($ch); - - curl_close($ch); - - // all good - if ($info['http_code'] == 204) - return true; - return false; - } -} - -?> \ No newline at end of file diff --git a/publisher_clients/wordpress/1.3/pubsubhubbub.php b/publisher_clients/wordpress/1.3/pubsubhubbub.php deleted file mode 100755 index f0f5f7f..0000000 --- a/publisher_clients/wordpress/1.3/pubsubhubbub.php +++ /dev/null @@ -1,221 +0,0 @@ -publish_update($feed_urls, "http_post_wp")) { - // TODO: add better error handling here - } - } - return $post_id; -} - -function add_atom_link_tag() { - $hub_urls = get_pubsub_endpoints(); - foreach ($hub_urls as $hub_url) { - echo ''; - } -} - -function add_rss_link_tag() { - $hub_urls = get_pubsub_endpoints(); - foreach ($hub_urls as $hub_url) { - echo ''; - } -} - -function add_rdf_ns_link() { - echo 'xmlns:atom="http://www.w3.org/2005/Atom"'; -} - -// hack to add the atom definition to the RSS feed -// start capturing the feed output. this is run at priority 9 (before output) -function start_rss_link_tag() { - ob_start(); -} - -// this is run at priority 11 (after output) -// add in the xmlns atom definition link -function end_rss_link_tag() { - $feed = ob_get_clean(); - $pattern = '//i'; - $replacement = ''; - // change to - echo preg_replace($pattern, $replacement, $feed); -} - -// add a link to our settings page in the WP menu -function add_plugin_menu() { - add_options_page('PubSubHubbub Settings', 'PubSubHubbub', 8, __FILE__, 'add_settings_page'); -} - -// get the endpoints from the wordpress options table -// valid parameters are "publish" or "subscribe" -function get_pubsub_endpoints() { - $endpoints = get_option('pubsub_endpoints'); - $hub_urls = explode("\n",$endpoints); - - // if no values have been set, revert to the defaults (pubsubhubbub on app engine & superfeedr) - if (!$endpoints) { - $hub_urls[] = "http://pubsubhubbub.appspot.com"; - $hub_urls[] = "http://superfeedr.com/hubbub"; - } - - // clean out any blank values - foreach ($hub_urls as $key => $value) { - if (is_null($value) || $value=="") { - unset($hub_urls[$key]); - } else { - $hub_urls[$key] = trim($hub_urls[$key]); - } - } - - return $hub_urls; -} - -// write the content for our settings page that allows you to define your endpoints -function add_settings_page() { ?> -
-

Define custom hubs

- -
- - - - - - - - - - - - - - - -
Hubs (one per line)
- - - - -

- -

- -
- -

-
- Thanks for using PubSubHubbub!
- Visit these links to learn more about PubSubHubbub and the author of this plugin:
- -
- -
- -agent = "(PubSubHubbub-Publisher-WP/1.0)"; - $snoopy->submit($url,$post_vars); - $response = $snoopy->results; - // TODO: store the last_response. requires a litle refactoring work. - $response_code = $snoopy->response_code; - if ($response_code == 204) - return true; - return false; -} - -// add a settings link next to deactive / edit -function add_settings_link( $links, $file ) { - if( $file == 'pubsubhubbub/pubsubhubbub.php' && function_exists( "admin_url" ) ) { - $settings_link = '' . __('Settings') . ''; - array_unshift( $links, $settings_link ); // before other links - } - return $links; -} - -// attach the handler that gets called every time you publish a post -add_action('publish_post', 'publish_to_hub'); -// add the link to our settings page in the WP menu structure -add_action('admin_menu', 'add_plugin_menu'); - -// keep WPMU happy -add_action('admin_init', 'register_my_settings'); -function register_my_settings() { - register_setting('my_settings_group','pubsub_endpoints'); -} - -// add the link tag that points to the hub in the header of our template... - -// to our atom feed -add_action('atom_head', 'add_atom_link_tag'); -// to our RSS 0.92 feed (requires a bit of a hack to include the ATOM namespace definition) -add_action('do_feed_rss', 'start_rss_link_tag', 9); // run before output -add_action('do_feed_rss', 'end_rss_link_tag', 11); // run after output -add_action('rss_head', 'add_rss_link_tag'); -// to our RDF / RSS 1 feed -add_action('rdf_ns', 'add_rdf_ns_link'); -add_action('rdf_header', 'add_rss_link_tag'); -// to our RSS 2 feed -add_action('rss2_head', 'add_rss_link_tag'); -// to our main HTML header -- not sure if we want to include this long-term or not. -add_action('wp_head', 'add_atom_link_tag'); - -add_filter('plugin_action_links', 'add_settings_link', 10, 2); - -?> \ No newline at end of file diff --git a/publisher_clients/wordpress/1.3/readme.txt b/publisher_clients/wordpress/1.3/readme.txt deleted file mode 100644 index bbc5ac1..0000000 --- a/publisher_clients/wordpress/1.3/readme.txt +++ /dev/null @@ -1,54 +0,0 @@ -=== Plugin Name === -Contributors: joshfraz -Donate link: https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=5426516 -Tags: pubsubhubbub -Requires at least: 2.5 -Tested up to: 2.9.1 -Stable tag: /trunk/ - -A better way to tell the world when your blog is updated. - -== Description == - -This [PubSubHubbub](http://code.google.com/p/pubsubhubbub/ "PubSubHubbub") plugin is a simple way to let people know in real-time when your blog is updated. PubSubHubbub is quickly gaining adoption and is already being used by Google Reader, Google Alerts, FriendFeed and more. - -This plugin: - -* Now supports multi-user installations! -* Supports multiple hubs! -* Supports all of the feed formats used by WordPress, not just ATOM and RSS2 -* Announces which hubs you are using by adding `` declarations to your template header and ATOM feed -* Adds `` to your RSS feeds along with the necessary XMLNS declaration for RSS 0.92/1.0 - -By default this plugin will ping the following hubs: - -* [Demo hub on Google App Engine](http://pubsubhubbub.appspot.com "Demo hub on Google App Engine") -* [SuperFeedr](http://superfeedr.com/hubbub "SuperFeedr") - -Please contact me if you operate a hub that you would like to be included as a default option. - -== Installation == - -1. Upload the `pubsubhubbub` directory to your `/wp-content/plugins/` directory -2. Activate the plugin through the 'Plugins' menu in WordPress -3. Select custom hubs under your PubSubHubbub Settings (optional) - -Note: PHP 5.0 or better is required. - -== Frequently Asked Questions == - -= Where can I learn more about the PubSubHubbub protocol? = - -You can visit [PubSubHubbb on Google Code](http://code.google.com/p/pubsubhubbub/ "PubSubHubbb on Google Code") - -= Where can I learn more about the author of this plugin? = - -You can learn more about [Josh Fraser](http://www.joshfraser.com "Josh Fraser") at [Online Aspect](http://www.onlineaspect.com "Online Aspect") - -= Does this plugin work with MU? = - -Multi-user support was added in version 1.3 - -== Screenshots == - -1. The PubSubHubbub Settings page allows you to define which hubs you want to use diff --git a/publisher_clients/wordpress/1.3/screenshot-1.png b/publisher_clients/wordpress/1.3/screenshot-1.png deleted file mode 100644 index 8bbeacd06a2be3ffabe5f18399db89129672d4ac..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 40565 zcmeFY1#^^5w}u;c4^iSS#NFN932}EJ?m}FMyF%PU5{SF&M2RbLcenGfKlb#Bl*6~p=FjOup zF)?KsF)@mOG4wL%+Zv5D)KkJW9@I{ZhUEVqPyP1u(`>G zh)2-K$WVqzW2j(|CKQqtzSCCCdk3$*W>Io_>sx*Mpm!>C+Elg6lY7Z?>znJGGtMzC za0>}G@-$SrCR?R(zkP7-ymu*DthYef)I3XM+*mlgZsJ%q|my}>LOqy@z>!1nNP5AV=uJUlX* zt71{1iIFzt=k3|JxuIglAxubOP$_%b-_4|T&+J0nI$m~zeKAKI_;{a+$N{@f1P#^| z?avdx3FgQLshoGobUSVTs4b!^@Wz0$@7NJ79~_LmM@L6UVk1o(%ru*eHY|VLTfod6teB&DWV(sy5flor;?tE875xPss$c+(xNl`2orWGEW)tVU$P1Enu z!O-h18&vZb)E4v?v}=ips>#S{=!i*)X=y0Q7|aSoP+Jb#^csy?eqvqV|7Oc;bMw<@ z#(1K3?cj%NszR7ui(aO0rdXy)i&~g-vD|pqs@SP+*mD1JG5-#~R%-y4K+Z~7F3EoR zFN<{t1sCKq)MzAG1P~cka8j5cf(>;?VRXp2WQEk%`~~Bi-pIb8fpVfr0qZ0~x6y~j z75D-1Vv1eU-9$xNl;R^*yQz0dnb|Bd1KB@ECO|X%#VLgul}`HipPXWbC4TB&%Vl`- zrXpA2ZfENMp!wFcj@PdNcvvemN&Lf(l}HnRgWbI&*O9SeNT?hL1~C?&}6d}yBc1P1x;%xUcA z4exHHx2a!Mj`kjFqCX~{S4L!vcO{Y~1{pB={K)B+|KZEWVaL+L!glk#5nHhk&NJ@0 z1Ra$-8&%cuDOEMaq1xqHUmNp-`@Hm$?ZV=x>ov$$5!kILG$|huxBOc2ryMb(vo4j>$5pOTAjonZ$VIP`4ttDtY4bWWLXt zu6TxxK7mVcf;)o<+( zh_!drvdKugJ8_q3or*e_KCHwID5A)L#Y*~{?A>Jy8n zM}Xn5(W0#+3l7U^gY=J?+N`=}E8mIGg`z%Akm98M@Jn+KsTAjcVzH@(-tHQs25b;& z1Tntzn7i{w3-{9-=}UIOXzt~8tli3!w&?1c2of616yL+An7g-V`{4rMO@XT-tRnPX zl?6v=)ynr1mEVXiIAq^9ia=TPrVdJ}Smd{vsGH!KNNrkgvc;gqSW`Muj1t%g^b@|xO{w|PpBdk|w|`anx7=hfY-S^I}R z#aw58-z+KID-JF%lGaAMb+_^+E`BW%XuM`GOO3&Qrvuv>1z*3w0`n#Uo8kvUYk>p9 z$&#{519Mb{g$qIg8^eO2Va9tJBlZy{O6%g;qG^OX3B)l(st_TFLo!A36#1x(q7LsW zHVx->_v{2FBAz9(EOtfC8J8!mv!!B+=LFaHiB+^O-&*;Sy_UU;-Q8-(D%on&N@rr! zQp*M2D;bnf6=$El8qyBa6T}mlZu-r_(p=r>odt$T^U%9)-Bvj_E#xRcIn;94LjoO) zNBbLD6z3SGEE!! zkREYU@gfPiK8W7JJ_|}B>3-RLIg^4%)2g9_t?%3E+frC%SW5I8w>I>rn))i9)eq8@ z!U7WH>eC7%x;k=F`daEr!ntz+umdK87Qr0YZ1F;0th_o$7naA#7B9a4Os(H^ zvq2$vZLRPusbGk@2(O3o@ZjZqYP<)Lx_MROGP=+zAL1;quz~Z9 zr>)82vZDHI%b&r+OQ7S-L*>k_8e@*{Wcvk+C3&~(M5Ch;I(F-z?XA<>HFma!5A|lP zdxy)@$FB!QOe;F6?h=q}K^Q%-LVYoXidk6{{y!f2xdhIhuPUaNGogQtuXQA(u+T4* z>)Pycx!L7BB?=`4Aj3h?uJe|_J{uAl2aA*X4iZKN{;d9_FLnv18BErVjvhoK%r7-c z<{3{lNMp)UA;32bk^IT}tH>nobirh6-ipGZm^Ui&MExGw6>m1C9+m*CFZ(l1KgM+D zmtN(5nxXgo1-)0n3t66)IO)(ms=bjWgcfo}spkG8@tw4NJe|qIm0i!-yNmWx`Y@|h z?P&s$-sU&hmzYq&(1IpWx6p_uILmJi&_Gz{I6vPkQF79*(tOlr{V=TkLBqUZG~*~- zH_E3}w8%IqVfO`cIFim=eP1JWMzH+W=DUsHq}La{Dzyro0(ZHN`7Z=oK+?UMx(gb* z3RGZobEZWU15V%jL)}dLCBGK4u$7n$#T<|fV6sDmv$o7Iuur4Ucj+WPKJ|%QSJSIZtrY@4@PMI)P}g5wfRP>&50+y`eRt^Hs-o z(fVdw!rC!h{vpr2rv85N-m3#62Q;^A2)vnQUPX<0gmT7cQV43W$^| zc@ruGp@??mvwiiJ@5pUO$PcwLax{N$$Uj~%^1V~Ho<3M2I~jcT4)2j6Mjiykh~SQ< z)OkXpkFZuFuzRz*Qmny!+_7Gt87xxA9isn>q^?>B~{aX-sYwG|zh&oMBkyeTJri@7B0Ef_{IKn!AJ z97h>y)ORYrhP%x=bGov>oFq}di@4i`b%Zg8GLfbhQ!$cxqwXO~A*ODQJ3w@mh(jAvWOijFKs=_u<>sZy_b8$Y> zoH)*hJE z-(Io*>rinI&-=5tbH4j!rSogHdpYC-ag2Y(+bn!@0`$iMmNK>?Hb$-*3**hp&aG^w z8UxoNG&R>X(c+qECX2lGOP}h;jSCY$PCFDnEuPrSQ$0t6yNARJXS4G`rai4G3~O4? zbo2We1arz~uIbYmjm4k6Kd*m;|2REtKP2X?;LNcrv&D8ew=Yz?UMo#4xra1#Bo!ew zt$+qOdf&aeBcenG*wh~PL#*M+tZL3Wj>8yK)5PCMIx1}s_(b#<`Ja7?O(oU!?s~Nc z4-UT`(C$h@?|*7HHQ~eUX^%4vNKHqMPB*HMAmLej-53+?K`!BRL*I4mKaewtSDelVx>WnBtZEb)jW7;WsXr}#K1@j9`bRZ5% zPX|6k95^-@ERvDAappar+aeL>Yx-JE0(kpUPW(4&Xun;>Zo#gcUQE+~XUtvb&YmnB zl4rB6(?O-7>Q}-pn~(sKyN5XwYSx>MF|%rhzmofr1taJH+Zg3(!mEx zZeKrOp=~&zE&bqnq5x;8xWrs%R!~z! z(OSW-siLn>_=FRJVAVy`bL#*oX?RCzZD%krM9klR!ND@JaKXSxz+}Wl)IGqDvf-EI zf4&ZQV?VZ^iVo)_MPlpJQp>@Y#;MB2iy{x$G>T-sd>4-GcaYFWc6F?+LHWBv!kBP#( z7~8O@MDo(o6QmKW;Ay8TEw^VIJsSse-26^k(v1YevHuv5bq)1vx`zmq&bAxH)c*d5 zwMLPAI`^)04;tVJm5*C&k>3A|+wn{qn66Lr`h%_ET zY#L>ffI`lQ|L#Hn95;Lczb96`qFyRg)mB_vv&Q_Xm zDLYUrw#R`?b4-U4LRwALA8(GAU{MHg59~5}`#x$`e&9faYe@2>&Lpz{W!1k_&@$I7 z{IJ1^-@p1Y__f(-TXwaFX1M3%tb*ri5&a*hf)gg8QBjm$ssO2c6@^Y^!uVj{cCAS_ zS8dSYb!|O23q~Bjx#n|;43o1kYKuH^GrH1C2@OLmiS9#3lcxE6K0xeoCQxDJ93|$A zlEh>nXh$?7`;RAs6d+2At2_IGg=js>xDr6fd~b5pjH5A zQcMdBWkMkruO_~Vy*^!{5~niggeH*ZLsCjnA#Gz&%EsZEU<_+d2aV!oykYq8T_%xg zSz++Om&%BWlk?``u$mfn<;s5T{Aq-#11(X%#m%nXcA={EVi*P)A1X#3Gt;2ig;vbW zuwa`x0h{5&)?j>4$xW;0Wm=;0bcqVN*Y`F@rGq?)sCgzyGkTep*Q2^|Tn1!3x^y0{ zRS)txOy%{#iYM0Yb6-M1_&R6czg-K%`S~puD4Vb0dR^zsF%bPo3;vXe~58)-0x)4>_1!| zIzLif+>Q&qiu*Xf(v-1iRp|nUO6-(O#wvW49ly=`XPFO$hA*)2Wh7bpV8Rr!P^7O! z@KJseQu^*It~3sObp7{x`LXuPjWrtOnhncNh@8ZJcci>6fVa=~Ypj!XUXBY1`98Q% z2a@AoeR{)O8hkNS1uh)p*s7sGHmSYEOiSKPfFxI6(6qx(DFG z`E}_ZY!_-n^zz+Z==i#$Ae>Pt9{EmNdl>4%J*Xh(^DWoBPX%1+)6X1b0`bkcTjO>N zgQ-DHIl{=x(!|CdU>5W5%pmCxVu=K-?ZF(6tDgt+cn7`Q0>Hf(qojejG!O~3{xs1X$ zO>CA1oL|#&J$LZ(1_z(-b1g;N8 zSPqK`jEdcCSXb<6RE#5NUf*K_nu0Z7V&ozQLn8UtXCJRC0YdcE`Y{&a){9B1ya}BC zG=Z~D$Re8$Uq=)ivnejZh`iwJ#w??-=p`2#yHQ`XCt$GT#6)LizC~#C@VOm@E5qPS z5lDe*y&TY(96z4E9pBV#RqVm~DrW zGMxXW=D@m4;e)&^kNU}c&cZHr{Syk1SeR)(4! zog(|`swiQXQDrCuaTT&v{u5s!S84m??U6p z%@UD&?b5I#@~`Q#8EN%9+3F@&jAj<~@XZsrnC=ZuDYD(o?>}hsJMYL#igt%aVAn-- z^5fx`$ajzScN}KFL1c9++e(d`og4AC-zi-js0C%39tY zW~8BRmNXHK?&IM1E?bUM$)u%q-ee&2khFwCXrV@5)Zc_Ao5=~Z^ze8CL%AYx6D;wLjY?RfQLRjRPw ziV;@lco@CzRHOp?PUgCFzlY~SEsIWhkkkjYSV}>>;$;{p5!xjtydRI+wO1nZ&ovQDfxPl@951zn!W} zFT4Q6_C=ZK!REynz zBr|k-INAB&g#;d#YI($_S}*M+%|n@4ZZcEUP#Gjr_U@nRaThLdMxtrbR9dE(?uScw zrBeqvvCLP=)p&HpbY*(aDH;=X+66=kJMw8eZfr>B4sueBL?^qp^cnQj40h|-BgbME zF4n2xokEf?3Uhdad+`Lrw@4D>I9%Jmtkb;&B9+wZX?UwNFhEVpTi;fLym4isz2 z<%c=amzTdv*Ej6*29Omu$po;#V}UjnSjlgHu2EQ}nIg4he66vV5}iVks~*kZi1JpI zG21wiq#qWz?OtbvC#qLNz-99*!qyx~_!+cFrInL~XCvc;xJbxGEknhL^mgB2HtBnR z)u-x=fllRZ>mUx4oPY%p9L$?;(-kz|20_T6TJyit08lI^XF1i1$C<4=LR%t}bWc%y zCTRx}sExHe5$8i%lI4`#L~jw#X}EgS&*km?H`cbs5S<8KZ*+~U40z-~5fLLF?(H86 z89t$sN_RkI(kh!^WYgZYhp(v(8IFD~nC*JT4*Ff6lYJ`LpB zjATA{1;N%mz-p82IjLD;Lz1GMBy~$`Xufdrtfj@T7-8FfTtT;_0_&~Jrd=->`0^&c z4`j%UfK?OaBaWBp2hW+wN3QKWF_Y#l*_{{Z;i$P-E2AnEpZOh6ZQL>p`K`I6&4tdy zf_g?JQVs_;?NTqs@bc1d$R~JAs`sb`nr!Azn03VoJLW{j67@Cg>I$F2N;k6gsOYnG zzbx6ejA=fAkXR^RbsFIcMNPY{gEi|@=6<3ZvJ+OC;}{G(EsDOAM$o$R+EU-p)$YC=hAVw_Ocj^OVi zjYiLwxKV)}y|d!?Fz=8D%c($OXQ{;fCKE)OnH2?Dgy=L(o0i-}YiPpxwcaY6zODkH zG42%U=Mhy(G(o+1J6`A|qms#bq*$hGDh-$8Xpf-6K{#H*<%-&`%uuB0M+3aCGS;XG zV5I({ci7Or;GYNhyTV$`?NU_AzGMZdYyVZo6GE&iU5SsL?-8f4Zn5l#LW_PzvSO$7 ziYcMSqpGkL&1+IANlDd~4o;&VLaOLg_>$DgK#x@0+lb8R3`^0psipf7y4-O-^i5oM zxUCC6V)3_M2&J@e?o?n%I~g`rq-x9fb^M5&6_%iBGWenVd$bT!Hq1+NkBZ|l<^Alg ztCN)_E|aAPBPm>%?)XW+^FEyDlqLPAP?Ij1jzLb@uR4^gxFCHL(mU66g<7ggx0Zk|Eo!<=&)E&;B?$^0*O>->>AxR0hu%*C>S%;&j^2|cSZDY(&qh^ zo&tT6_ny1k%aP5sO!T$cFi8sZ5LJVME<|57t+V=L1s`b2KCX8LYSw)~bs4@4m}n2T zr6BZG>4{=xvXKN&w;`Ghx{wUbPnrsz9vV#ByF+-8XEj6O) zBJ|izHN}Pt)6&yf!mi@R#;hu6*|)BZjv+8M5>V^A5vI(3k&*N^@8x@UCrYNTNNFOk zG1+u`59df-qtluIJ^BNj4GKN(eqR%l8*?-^o7YD>vp9K%G(r{TM~Ord_yFhzN$2TE z__y#9pcVGEVuWE7Rp@^tCbv7BN7Ti)BOy9uAx$s*+&zgL4{?DF~|l4C-uN==1?#{2wPd#GZkhyKaWyTW&#iQ?6)fOh_0mnB$NHb0PmGp=9np2 z#sm$xVa;+)D&qX$#F>5j zjwo0z^xM2XQkwznLtDJiX0EED{8-jZQHYxzJmHVYU4pRsLnTP6K#lm!^AyIZ%O`-g7`LxGS0 zT4vGzaf(LbF9ruP{ylo$^|R`4DwBl=@VoKo%>tEwfKdQkR^RW@UqR)1n15|3HyeQK za`6Ua^8emu?kIR*v=3IRh3c@VDWeK}Dp0bIUBf-=kHVrETbcF9-6s;eoIUV%UF=w!n#NBvAu@sHk%E zz*f8yj!*@2! zOn-MgqQlFd<_Y{t>vVj)iJA1a;q-siU7#UcfnHK9E{ieXAs|5*6oN+E1y+mCn@k-~-RvYvIs77vxo&mjQZdm4JQ(Rj2hz%yoBf{=eF496SesD5%fWM#*I{Kt znP%mIL;1mfzmF-#VF4^RTiZoK7;apsLGSB>>p}8ZsBbb3nNGVP0f2Y1^N$n(rLeB* z-TiLv^b%3F!sY@1ib9d!juK^ae}pjd1tRkI<8{D_HmhkWi=}+2*i}IP0ugRoP*epQET+7OJ=3@X;5~QUa zngN7K%UC8?$FE3wubU$)2D`xCh_0& zIeqUj?ugh}i|+u=2&`8685|`Hs3CpdYmLp%a+nl^g$&#ZoP%6zKGR=BAa^^t{i~V} z%0|=K_~eHXa-7c54 zy#1-KrBhP%z4igHOGVV`xFI?UxF)aZAXVH%- zZ~{nAw^smGrujad4&QYO-|cIO1U6-F|$lgySu@NVKY1gX}bgG?P1py*SQ5gO76q7XddrZ06jA`ZDD9B z6XeSCeNGp004Q*NDxg~5vQeeWk5^cTp0>9+%jUlT)MBI^faQ>z?A%|mvVnbS77m0U zFi)VnJ2kMygXvO+|*P>GW~K8pwUZ-M0M;1a}~e-#j1hwoMFW zj$Sbo2MEVP1-MXyZYs3-I{v3b&UOh}uK_G+I20Om6gTgo)b`%}FD zgO?puTilLCLlDlFwy#QS|D++{Tu{eFGd3{M4?`M`r82DnELD2`aVOJZ2Q@i9$I`5K z;=9!}obrNW<1~C(n|K695eyrvMYxOkSVpqY=O5NT@rC?aIV6+TJT^aX z0zDw6Ysf5Bub&d(MSx77L&tL{^8;|w_C7HSi3WBQ6>MctxjbKt zFxBAzT-TWwUYSY-x6Nt4Fg0&;VNB@t33D?7lNw`&I&b`B(+{g7;E>fRZcbP!0J z1k1gqsPKFy{Yb$$I2I(GKT)B)mg?=&k4T+)5Y+P`?kyGjfZK`N!#UKA!J+;_BKEco zH=wQ5F)a%z`(bHz8b@{1XKT>Qi_hSH9l6qrD8~@>1yjX@yAa5!wBuB}ueTrG4k&xX!_fl>p1&4cW#`dV z4Vlu4&l5jg?C2n&(WOrbU5>KJ*QaYa(?-jg0%3;h`YFLt^}NsG*Vs@`wPq@#9(SWI z{abzy=1BzGD~vxGON``2UHFSFTGuQjsk6?F)?gfI(0x9Lc)iwar0RVQgdBvTG}*7| zr^;U|$w&d(QqGNHzZkw9Pnx%`}M4{ z12Kl0Eo^%v74x>+a;8M3hzTOE1o>B#x^YmhAr)!;TZpV)H7jEnL!Vlv@Kd3eJ4iO` zBUJ`-3-Y8d4q+}aZ_+f=<*}UNCd7_7V9C^qxh#3%!mE+-8)5Reijhi_NC znY>2S7jeJc5AsFGl;}LhL%37qzj*S{3$*bd>zXNfgR;`uELgpfE+nCqs9k~y0C-Ia z?dEv?s}E{ludPL}c8;p_2yjE;aB|6X8RO0B)t}3LTQ-U*_{96Eh???x^1_Sw%zc!? zASsal2|^(`*@Jm`hwnK-kdSh_;>3jRh4Fy~a7n{!To0q)zJrt;Tcy?=9lTZ&1d9s5 z^`t>A4qds8Y#x|IJB%|LOupS_ViqU+pbhd4tS4rtb`~rPOf~V#9#J>U4nGkh*{40q z|EXXcXEC`8rFmTLF0Bj{-%GBmnlQrhaV@ZZq+;C6hy}tv13cuD%+7cRvb2ue%ge&q zTZKkz2k4q<_?!CGdde#z9Grn%)faXQFgXsbOmNI-arN{x0smqJKNP!it!n#~&_dyE zB>2Nwp>&3R20l3&_B&>u_b|@&ye#7IrSI5`5*IgYf9c$~e8Qup>`yD_YOnOMsUW5*FVSe3iSF<+ zKy6HtaHr|&^suFf+H#yDIsQ-wRS z4JKOHW^d8xVMjYFp5sx8*QRnga2k=ZbRIaSQc|&RXm0)3UK8Q&@2piUaFF|r(OotU zS*bnv8ZQBJX}BS-j969e?u9kc<%jFfC3v1|M!CoM=ZkAGSzIstNhMbJ2>sc4ZAXZY zvwQ>Vs7XH>6bH$Rr&c#du2}>Zk$A_|K6Qgo%Ko<(AQ#%NLSC`M_4l5wSk#+mzkiGM zr(7ms4h#=>s-=Uc`fAzYetLqj-P@#X4rQbu$#kn#a|X9belf=3V!CJ7urix3g}T;Z zp^H!TA)VqOw6Dfu@%%`kIM_yL0ui`>w?HRYI)TiV(I?qP?d@(*W=AdM;bE^Z&6wQHZycZX9 zP~2)EwrGli-FYln%J^ei8olcH)sSM=UHFUnu*K0BAGqrle!3z^cDQ|YFP;yx(F&Yn z=<|ph$O`{qQEmJwafoy-X*h}2B-jBzs}aUr5aveA3%6-f`erg;3Nvn}#qfjYEM}-w zLPiU#?k=!7?apZq4L8VH_EE$4=Q8qX&2tRws9)`&sBt1DqBRm{xhH>KB)ND_Kv%A9e4r zFR^xthg{0s|EMvz6tMIdEAMkD{D^hi5n>9m_M*^AIDG577KzRwbqp)>ufm+9;_t1x zI0sKx z2~nQ$@2nil#?rHav~|op?vUi*5dvyr^(?7UjoGQS@SmJ&(H+O)$zc;ILGl1OAacjb zWZh-{sHup0IoawA3&FDo$^cuH{z>u}(rZ>!I%=41F*Pw?_dd?y6baXas&EwQ?jcQI z)X6vtlbX{G{?eJx3QWirf@BS)fOAi}jU;e&{;^ytwwB4%mE3M9VAmqtfl+~Ew3&Xn zWY{H~9<@Ti_=(x5KNO9FxT)!rFU4kuSc8_XX{?OBXA=t`a>v(RD(wz3iUo0U&0ru)>|?-FLCDr33?~P$U$SIE9T`XIv!_#lyfitC zki9JgH4GiL#7RMDrL*t@ge(2bX^sy!ipVMQSQP>x%GumYyd&*?(atl}SfG&1+3$vmow_xotqq$jZ`l%h7W)wqtyZ&oiwaF-)%2GBrsIBCkO2B0&=KAYk((mfJhe~JP6zj{Xhcm4c-SNq{v@bR1xAqny zjB|ZWzzm=fh(&2YUdKJx=R)SIXvowo=etS|s=eL_%+KWwt6t?m6G2zYwZ(W(kjL`Q zZ=K#+PLsvcg(~@H#$5;i3^{Mm*buKkaXPGy2KmV|)EEW-@PsK?VhkS#CcY|C$jl1m zZ@Z{!Ir&v{3>v0M+8xVm03OU?Gs~OE>`N;2z^Vo7?Sk|(+KlYkf`LKphkwiF^7Pv1G*=E(-p7DJc&lXn+1yw zK&!j2dKLq1K+?h(SS7a8MaaZM6jY>{5UQCEz^ES3Iq{auo*l9o0N;YIPtLpR?awzl zM0EQIku9d%fTBcy_Pp3?+D_4t*Ad?Zc!B)=iu;<~WL^lZ|J_CyAfhN0f#;YJvHsR; zl$4Y;5$^>}7`1CDA}AqYQP}&ue*xM&Zvfd(K4{09refj~9UCi^TCLyKY|!Cn`O9j$i1hvBmAU^( z(=L(Lhj2Onw`>ohu$io%UM8i8`%o7ruM`DP^)`(L`@!t&ped81jSgl?f%E&~JT4#= z%AN>23M7mWHz_f4C4f1&I;oeiZ~6e=&*Rm85W?wv%_g9m1Izk*DjQat%|@^bjxm+^ zMGTJKRLQ#^FEvQTtHB4u68lW3uevSS6)eBgt_@!KNR^*?E}y{;FD~tAV!Jx@YSi34 z3cmdeK!jC5kI!@fz+#;La#W6~?K{xs1`wK`)dsJCO+~ABA~ODGU9ikstP+6!$^m@Q zoC;6{=FI)nr}FRp;z-3No{vh0Sbu$)Pfyq|Jl!-kYzOf-CR(r-X z>%k0j_Z=b|e}_~)cxN=d=X)3-J0=Am^M5P6Rsc`-jHsx_mhHME{F8foU`W&-7(4GU?uxa63g*K*dEFLBdJ0n5@tH>?D*p}*P z45`3eQUTuw^wmc`a__Dx(!&TbOc+UQHb@ceso+lLc-JG9W}tkb#Nz{$H@TlYJ{Nwr zvJ22|hITv41O0vjp>kXT(n7%NVZAFz7m6fuv`Dp3wgzi|4QLG78OwykL{^y3eBWY~ z3{X1Y7N!JHCRcu2gXre61USEDDef!Y*K~W`WN$eJG~Qk<+Ej1zLLz7P*C*Ej4Ia22 zL~0f~TIoFs1+4&lU}`;sFkXRq(KCOb`4g9nNYRL~nViTV_EW&(wb(ef2;t#HVlYii zB4Q}+BEK`J7KE1{4=2;dcUWp$w8?2sMUKLD19wGdK*&p;o^OaQt50^ZGe-}eia>Mb zDqGmnJ^yAonK!$tO|sYGuqK$)R%&W5+!eePpH@>tTXzn$CB;bschB;WSz~tT;%{yy z{k}s#u?dml^vx=h?D#$&H)P^_nZ6k2uZKGYu~SjOK=Qq^5LaSS@eunz)jUfF8n&i$ z@C`t@| zk(ON!WzjCa7ht@at1*M=DIT$yt#(s6zw>Yhxn(KreG=dp=+>_OU(^&FA26lW4X0KG z!i4}@5Gludkx~O_FsA+3lXpTD6R-zMB<0B+OQ|;(R#}FmuDIOa<9lB!3KL%UA1Bvi zU?~oB)aJZ#%SwCmrdGC*91~o&Xc%bVtz?1be*!v&-VB~m8GL%*pI%4C4emh&PxAsWR7@FJ!rV8>XMh`f(j0=}sMw@rl!Zz-D;5|i9vhN?D%e$qpN+I>8E8+b>+#LpAU zUX~m>7Uo-7&Y&zg?}^l6_^gD4p3Wd^Tby@6oK0)J}ntfWBugRG2&-{D)*M{g0gI?@WeP3M-h!%z0WOu(`~)J|)I{;y{=nEFsKesEWq=sk;HMu)U$<2TTjNP`9LzoQ-=+ig?AW-kO2XyJ{*VAclBL@;K6 zjvfy?C`SFybxYtGM)(G*orl11CR`RH1keE|Aqu_5cVnrWXsCdj_JtK(MYN+to|WMJ zWu|cLn4epd#0uGjN*m|_$i6keceSi?P*ETs2`8u^WsZ5Sm6cd?{N24+o=i?}+FySR<;KY`EN6<$)D zbEtj(!+?XM0?4*E$Y_O%bA?OdoyO5K)ooejpZW#`bV3RfD4g_N2(cZ20Qx_rw<5Z7 z!IQkuGH}WEfIf5gN{)uD@{-G!{HLH^A0-8f;vE9|(|Dkn+JUhQ>#sXBw7?Q{pp3w` zcK!Fg>nf1v+L}r<|5b12NebujTbKNd|6}EUYHttVCiZqG@55g=qrjanK2X(`eASft zPg(uv=emM$-g0J?^?z@pew#>Q4a}7v`hoE8%g*osF7ODa|1y5&fA0426@P2=#dAVdN|imv=1E8S@NSK}%0jty#{ zaPup=_}?n^KOZ6m!XqktYV^ND*3)kpFs@GY?@F(YU$gd^ys8mglBnma6W2z1;}qiEH6b)D|T zot(N)DhF@F3oMDNdwV~_nsjNjJDym& zSHAqcpCBKIK(g(I*4Jm^mRK|h)Nh$GVW|8+zxZ6@Yiw>Bv-S3^K5sOvy<97SJ+5<6 zo-Qn2A4HwleV}*lzw6z?#4|RL95px}Zm`i5SpD^UFPD3NQ@ySy(UnjRwS8%p?y;ny zvL~naH^$5|gMyG4o_le=5?B2d5wNhO5w&Bj)8dtjx+||&*C86u?~Ov-lY^945ag{y zLD_3Q6kn=5G>?=XWBcAyU)Lw)7tSZ9{lTtHK29@6ZNdBb_{}9Q3PJ&bOj_rn?!rx0 ziyw~giS8}+KC#%YQobG5cTXBJLqk{yyXGvCY`Cn;v9@}0I3E|BEf`fZG}{HHMrtY# zS-0pD8vWfb&hzmuvBu(xNmAgw-HFzIP*Mqs`P47l4y!k+>(*yQcezv03Zgzi1}5o8 zrqq~RGEz`}8u3p2f0cYBK$kK9hWKbiFI2E27%KE-;g(zKc<%GOme4z)4|I&q!n~ z-Df?uT=}wHKwp)8d<50a-|pcl)0&GunQ34`Y1glIv+G1(n+8{;(`1 zHPzpCxI4F=_?!@43+#ctu|Vc?*?p}=cAb;j+I~mD)yb>Gj<=|fyZwZ2Xxlp0g9y-D8F24%khDhLgjKo6-L9cCB*Rg&Pif z<;%+=0pxP6cj>g?$!j;mPC^c=Vpk6loO6Uq@~!q0?;$pnmYuTeQWHFD&4n^>TBtx%z{sM)j6;%u@;PHcijPN9%$R^uQFx|m_$Vj z0Q6QvH0GX+mcZIb(fptq9T^9M{%?U3pee7phIRoO7W%L6$q-Z6dflV8Yd(mdSbsej zGk2^cyuD67QRNu`Ya_;!mTuq3Oe6leGliccggYS2lm!!fO?)YjzS6nv~fm7bow#!Vup+D}hUj!928W03W~oAA})*aWVbLK~tSra(*lp6p@F zm7^N$R|{7{Wy{Gzs@F31tg51}q~ERA|T?OrRFNVbR5>%))} zuPcQtASO+pj84t9+Q)ZqDBOgfvuLzlfh|j|K^>M5aE4cz7A4n#Cz+6s*T^Hq7JemP zY*TpEgFB6zn8~nZPv*0iQc_nebogvGat`ANWp&A3m+N8M*xSCfSEtomx7!H@pKl~E z@2<^WYex}NK&i!Lv+88VGZ^rL@;qIs4xzhZna^k1zUV~9TCLOcQx!S%K46QLR_VUuo(OPtK*>c%fFz5<=W#Ka#kf6?Hy1%wrGRikk`EUiKYL?UT6oE$@WtFbxZ~j7Y;^QGR zBxY*)IW8{cS3J0KrT@M?va+SxAhyGruz;Yq*DWgFuJ9ttT73pu@G8&5N3%>gvyG=_ zsoEV6E+Igg<&VV&{|Y%nI9n3(!u=*)&bO{H^y7$etB(r?F`IHgN)p*-1}+)pgW#6DfM1Gvjx7+O*NpaIr>rUdgJ+;$Y-hA_V1`&=FcO4 zofr}y1)zrP3i@=QQt-0uoJwqUYPsVM_h%@qxVheQ|gpVIbGyQ^v?64Mz9u$U}7 z_IOi|x8Af^Xs6DlocBx%mLDAPrMexu<(^2EBndt3B{q`E%j6#9=rR|OlPY>Woa_{K zp|Gvrxt2cuTZ>PQgUV)R-I?^#3Yq}&?O+!q>qki zby#&@Vl(EJ#0Yy*9Upyz{o_YubtSF_!0q@jB#P#cC;nV(0a%{(00hiSL?gvD;&bbaOsR%l-Yvg9*0XOmp-&a`F>z(BY)h{yb8rvHgW( z9Vku07NT~JVU7&c-4MP zn@Yp?lF96>NJz8JaE<%`=t}ANICn7LUyGF`z?GdpD6modXX5u;mET7<`>Ol;ud6(O zEWZagqw_x9?JZL4L|9LA_wN_-U=fBIICDPUqYo(%5@ z=Bx%rIy!QyXev4?C9TSf&CM-GaAd^D`!;u6I)@C*KOub4$KP^vB)%K6BW|BAFa_(- zKs4;^?p1m}q2Nr4PnO2&s0FsFep8Dx;b36ZT8g@@JU{$1-QVI*RA;ACl?%$&fZSxl zvn5pkJsD$Z_ImsK(hV^aO(Pxga>L~1Xyf>1vinsSaE40RB>#BZ-?4gOv)qT-`#7Y3 zZ7nQ#e1Bp2OQ)3me>0g-VM-W3kq9X9`V;wu3M2of41QEf|LP?4IgBz$eo2u3S1YnV zj4~is8U3A5{?~Z?9g6)sn)z2NIV|dh37;tQZ|3zHb~6eQ6~TYEKL5?fI)D897xNMe zfZdF;c(~|at>1)UfaJN_hd<{J>wh7(fAcY{-+T;Cy713wdx!NBcC*-Q`mBGq{toV9 z=?y9WYlPpyln4B;m3Nf>)%x*w=ox`A<=?~je+TzBOZmTp`#Y`V|E^rv=K6nU7B-O2FLPWN+sF?NN#UZ606Nwfre)!GiaNSuE)PKf8S!kn1%NrR{yk z54}!4d%VNwc*M~zSF7HKboHDxZTSz7dJ5jk$xoe!kl{_Fu(7bR?%_c5%OOd+-lz{S zh09#6yMe*xaDwkKsQDh2N0W)zaE>#iDKy^AQ2E`+N+O!n@vEYosIIx$=Dsr7KPLaJ z08Gf#Cjt{JnO`IVyffnI93N2w$)5HPPB2IWH(NPoQ+q<9^Ota2YF)F6FvtWw?yb3C znhUnsiWw^*r^VuWORmv-aNO-}nYoJr;p5dpVVX_HNIWd8uU2Qa!FOV{P^`ZKXR}ZV zM6NEaXaN~Jp04NM>v$PHwvl0w@{Sg^xjRlg8U&2=Ls;P;3VDJAtmn|<6}~llPokOp zHN%OqOaa@$5&78?m7cv`6`k9yiI_L<*U44A{W`P~uMPdES=ukb-@>vwE~ou?>nm%n z|4<_f-%;9?wRR-Y z!oloMYbOu(b~JC}$+NAOu$*oT)uNq|1n={dpWS03G7z_WQ2=%h0MN>&BvLZ z9=dDmFqwj|`Snvg}edOvnm{_G5B z>)U(bx(1bWANpae-Evu?U4$!(D8R9u<$F!&IdfkLU_Mzq6ZvGEk=zYaM*YqVVDX}K zl7&Eab=lJR2ZV+1a&+X0`CN$8qJ=V}1Qd*F%oY!j$PNMS7hh*wW(vy>8MjVmn`x>| zM`1b@YtH6XHq#-kpNh>5jUczK7X@z{Jg!<``9#>BAJ6-1?w>`UO^wFNjGb)_kevuM ztvYknTf3f27XXyrI4YJLuR<|vsiPFyJr)Q?;5<#y7K4a1ovdbyp^Menva;(p$|My! z?TN6;h()+aW>1gL$Px?npX(man~H$E7-2 zXa2{oI!;qB%$7V`uOObl>w!Cg#e9310?g#*7b{#NLE7p)rdzdJSZ+dTyleAvttpEk zpBE(+5z>aV`+bylJT$V)jV<%$cqJM-BD%U*&`tZ){){3^({19Dum=2NNlGkt~KVU~MZp}$=yeb#~=la&Aad+7ZMiLWhC zp>bTr-rjzG8V4rKQ*UPA2@Mq$OlO9UPB;r*gJnwqHgD#nlPZe8 zmWP{v$o8Fp6@luF4|JDzMw@?`GC%q}IUTD(x8V?T-&eaOJzC4U>FIIY3j}ytk5T=k z=BerrR5_Syh5V{Ego(3$!Sd2!f<-OF4l>PpD~AbzMkV3CSbw;5VS_DrV{K!3jz7p{(2IIzG+;W`%@O_r)u%@F<9y|s-TIn(Zxji6{-F?5 zIjhE4n!`e^sK|UdO9>LLBfJ*M9Gew<@>+C5hNDsTSH+g%yFN{5@HEY|8R41K7QG0V?9#{f#u^_JkAx{ zrE}1yt(O)%*iM2z$K6vR626jobFAB1WOZ%910w zpX!b6Kzy{A)X{FKGp$adK|-(Q4DJ4@G_dNe8gg~OCHS~_G5+1ca*Gj%QQ0q=Anh~4 z91coGnNuo+frgs0W{7SRLa(pSbNvDBY^z@@w4g&YY^U!X=ND$#(V7VJ%wI2(b8Z*1F%Ymi zfTTj4Wf)ck?okfMYKOwtRLeDQ@P}8msHz_SPU3{2(cjW{H7I_6PFxbG*-;Y@ZqI91 z)V{hJ6fjgWCn9JVigltCco!3Qx_sKGPHjAq>8n_$Ju=S44#+bKGnf#Z;ZiY{&v#$< z3voHQ3sD9?KGS*obqrcaEh=y-IA89G-fuLR?L_9Ytz(%U%(~csb0@SKsLAPjf8;v7 zrrBU6BU{p{mp1c_NJq-T_o$u~R!5IXi<^qP7gF+NqnlI!>AWfvrjr)9u@c(mPJx05 zN8T}&>BaFln%MZ1`>xcppEbJn6NPb+$*0QoPYFF8Qk=YK9M|C=@h1Tf#T~#Ru#GNF z(U*6;^_Hvdrk)4AwUwQ#{ArAj=6g+;f=ibt^j!0RKWan7V7%~uP8!6TZTR!RB=M5mRlwm5Zul3@l8a~~u z0oB`n&>%IpL4bUQ4VDWq^y!$g?Vu{^OZJSEksC~@>>zKyUR%+KHt5%Vf_hqLHyRY3aF z->{e5Y2Gx&Mlv%w`R854*4eSRd&GEdUO4O;ZDk%MT0IRcEW?fkv(j6qk^636E;_XDmZVo@=E9j2uS_|h=^n-Wm2V?3| zV_>QtN*s;vY6aAHut>knNTRj>4HcYkVvs)kEleg2tMylebiKvjn!Z9J==CkOYVK=I zxDbc`i*x`vTXWaF>Hc}?>~V9T{K==k z9^LOQgB6?FhuwN38i3~M>=cohkt|cFf1);9qh1S4WO>RH?((_-v%uulROWUyzEA$9 znIsLy2QI)wiO&jK4<<{prn3HY12AyJBdoBRcLa2;p*Lgall}bJX z+2Y`kw-d6*9s#nAt;P2>-kqoyBKq$Ulm6~En1qo9VC_BGg_R^*Jgj7vN`+R1Wb8+N zY#0N|y5JH_#LW^s(#|vugEt6GfEQqTW_4bNX=}W$&7II8cjA*VJUG$R;IE+Tt#Y-S zb#SvcTb-osat5=eMfxXhgADTGB;45xB#n)49+%l*)vyb z>l@hAUW8+ETvm&t0Y!ZgxYtMQrx5caiW^O%R^%^sk6K9YXQ=;!f&G=pVKgYcXh=)5 zw7+hz_UNr()|tu-^}?C`d|5N5;NsdWi}oF#s@%bRYgqDTrU2c-ub1cz7T&vsvYJn~ zumw=r-fp=-DtJCHeV4Oti~W+Vab=Z66`T6;goS~;5tirAWj()fhuGN0u_lf>TtW?DU;jxyagsrb`8=$DdU^$#L9x+qoF(ex&jL~YE0xI)j6ItGIr z_z0Fe__vu_Bwrd%-0KnmbpfLX1o`IoOQwzqQT$aK7^^m@XphnYp?Ok?wIB1HY)wbbUOD|KT|Au=Z8b9&%(n?iAQrfLHlAg|1$unE zkK>N-@Eov3NPvO1XAILBk^Yqo`$>%IpH>OiFnko#r3B}Tb{F~OU;5BW=5NqM$n8$( znhD(c)I&4OE7(9D+3OH-#QSG7zAs@`YN~ZYNzT)Ex9CJK9U$HzR3w)L=ELZR+g0;p zgXbQN-`94<2BdgZj!pbL8=BxCd2x%r(Kzxb$Q_dZS4Ob#`{!~h@iP(^M1)v}tVn z^mMTnxIbPf${P3Z9Q{U$xyoU^+zLxJmuj@}b{8zDzhUCPzFpViQDWw(vjzqzn;3T1 za>CMi?}oNnwNH-Ud)*RLa4XqzW0G)|Y>{vYJ-T6DR6qIQTP##S`iUke=3%5hu+rD% zI>VLPXf#=W6e#+^c=Wb2FdC+Vm#;)~ukpAl$@>Il@qauU$lCo`{NDFqtP9w1Qui^j z;ZQm@H)xfFkI{0T@h5^rxwc06@Ig-&(bGoS+EdkS>j~b{nM@jItKCL`ZQCPpG`IKu zPu1_p*9$Dukj^gA!lOqh($i|iK)MlkIUD_H$>xfR)jRlNDHt zEs$2d^`YW%A(Ov545J~&Qo`c}kqNOV_0e{!x-Z$XP5~#9^Uj!7l?bDm+mIuBCu^dyWWb-F#vraOiG( zvD+76g|4#)$PPB@Zuo@+khUI}&Y?WcckDDr2bIxR`~%+$0BrtjPhF(YgV_oQ#B|HX zdhNWZ5AcDdAna_YGM&luG5GYpXM3K9;J*^U0Gf5^z=zvwwfQpjjNLh3)_bDiZ}gVh znt{>Gm@w9f+M)ZMolc|9E*R}ix+cUhok??kaS>Lw+M$)u!)7>!wI_lF4MsOn&XbBu znkleJ9Nn*^U%yuTD%)ITwHHKl;b9(?o+{v}qp0Xm?aM;!slhvdoh=jGLlN!Nx*njY zs_P9IPADy>QnZ>>sx%sp4=XR6uC=s0Y1O5a({fgE{`O%a-Lyu8`m9WS?KeZE#fN;9 zahU8iLMhh-#2%n6Di_<455S5Qe4i`Tb=V$MF#QVW@C2*&GMXh+X@4br!apJ1 zbL)mC`UGHIx$h=Hq4yc-C2!75BBnc+V_rN)zKr!=0*878sK&_ ze7tD$MOQ%!#F<-_^%)bV7SnWy1dn;9ev}MCAJZ|?_!Jyfg{UL>yK)elN&uCb`uMXLwWUCD&I#hQ619TL&r*c z^E6~K--e%;b#*=n_@6Vge!x#K7zU$_m!3W6kV1C%yu^A`BYZYdF-AS%`q87VIXf7c(M zfp+v&N%$z`ql^{fX9V{#iPAEePZE9M_=IWUaVkn3_=ZFxf|sv)!46)jp%uHnJukg9;+<3EzpzZ7>s%kfY?FlEwEbvx0kLC~y<0 zw=ST;*3sASqW-e%3^wDw!F(jam*Os*PKn+~TcFQ8$yqbX(S;*LkU{>eY($~GOwEjh zu7_amBbC20RwWbs2C^EJfwzR9$-_JQE$X;pyW7cE?>agV2gPjeC|Pml6r1e)IjvJ$ ztr>j{S zR30tXHF)fNz)85$aBXx8qJqi-ej_=jHV0MR+62 zo$%~lli^DY;<0X*-7pndOZG<}?W}jjJIe)-B{&ioZP^855?!-*o$Sq+#u06S_BE*! zBBWBwUFBX`7tlRlG(t<>>+A1_eH%b;7p-@XvUBkvR8gALA@|?>Oe|&ueMwz?S|carGB<@` z0e5r@&;Dwd0`?6&=WB8`-?vM<@>uqt#loa?oQ~A|WaUN@%Lym$44B(bcfSGH!8(dI zPFs~6Tl&h+J*4vT!-@)KRF;R^N%uW=5|UP3eTCwrHkayWYApeToMjh1m_l(V6YH>& zX(M?OQ9lGW>s%A3pxYU7vo-u}zu9F%bbVNh~;B z?$s@&!y#*}=_tOyU{%J)mv3^70UbX>dLrWFs@ot|7(t=YA|-#uEetrkKi?^hA`=?d z&Lo3+W-)Bp=UkKIlp+c}Kio?)=4~#RXimtf`9Q+q`*22+XFdC#>a`3%5Y*H8reizF zSZwkqqjE9ao(urm@MEtlTST-0n&DvI(;>6UA0Be>?5eWTn59bXnJW1#c?!6rJ$<-% zbiaTq9REdkZk7*~(-C3*!4^y{&H4lk(rVir8Jv5z@bx0r%qHg}L~7v-WWf;DZugo7%4H1A{uU&5u3De;r+ZDPmrwzw+3>Hci@6wbbJf#yhc1Wzvrn&l> zB3yX+$Ri4#y#|oOLS$oojZJY$gXz}K;+q#h7n~qC**dBJUHU1>76Trmf6p z>$k$V#kX?Fg7FN`)yapbikr*k-AtgYNzh+&{5%oy(l_+bqTes`;&6FyseXinw~ksn zO&l|oeXmo49ad(J<`k+ZkG?Ofco@mVTW>b?vgFe|$XgZZxVx=GMDrU(Y9^JeWTc%7 zVgHA?bki*NcpmwgLXuSWBjJE9Hu;;YQ6f29Zgu(An};4nCQ$Wqt~f<5802Uk{CWQK zfSdq#z?R_ccC+byM%zuNEkMgh1bd-kCRI~)=vg)2!AI)@D6Yj^%j?^#O52M;3i(*> z19k?r_iHc*cwA852SRJx=2%a-MPAQwe!K$x$XGDfDmRaJIbHLKit$W%r`ZUX_xgoE)}RWz1*Ji zned33SN;)|AfU-9x0hyf{L!I#w^_t^fY0U)EP%imi_?j_re*WN1aYu=Y+2$41Y9sa zw6%Ja3j>c4*{oHgs)E7TNn97Kw`{Pa#95XP)}jJJ=C5yeXTOJp8T&bouB8ZTc`Z(g zlsSyB-`*kCLqtZ>scIdOo+ULec~9l)J_DMS{*|C2guprwRZupyajyaUqJwc#=80w& zm=JqRTorO5EW-+`(U!RfhUesIf2Fw6>?rS#;GU5qf#AuA*Oj%X%#?wsPv_}!ba}YU zlG`RGkBT>XQup!;m^J2GJ*;kkp|zTQkQ!fOjeVcrDLJ1Fmw0if-`1u9Or%J<2-wZB z=OphmIlc}IlhUWb8yV^h!g&8fdR@^u6FQA5!;iG}@#t{5_PcN4^Kscxp612wm)}cA z=_+Mh7#5`tc2RpF7A%HPRN#}B>I zxX%damzg{LmU^qVOyG8JrWQy&9vr8xIoMX$Pb!rrs$XzZHSrF(4qT0_16gbWd3rL? zMWOFzIA<@|Iw$CKsZ3bNWQi5Z)M7h#lTT9Cmm?1L8~5f8NY~zn&-^!d29r@dv>Aye z&>y#{Z;^ZC^5?($Z&8Z3=+Db&S(K=m6mSzGE0uo|qb`i6^SF*A0%&9jk5VlP^(8I- zlG>g69<8{l;Vcj$+Idt?i+yLI!Q|-{475d55ElJX zkwGNTCt&Z7fRhdP;xQWGmI^*v1ve|xNtUha#0s1GyT~5uqb%|pXmoQeL98zJTRtT} z1e{;taBMr;Q(Fzcuc8%(NBQ!*vDhzI2C_z9&c{o7uK;WK=eK2Sy)P94(otf6{qsLR z_{+UCqoGaWH%jEY3Y}SF9*-&ejW>< zvvOeksi&&d&<%c&{G%)Q1OyG_;e{i>``sSVQrC16=<=#4{)NghVkDKy)f%zwE~ZN{ z@M{iz>QhOMDU#}uP}ad2NUrye%@*{65pBzO7W5ku(CIKZK`ctk7l_zp; z7uTIGTsICiyv-gatt-n%RYx+x?LlYP$)iJ}8OukYW{d@+>1J&^hX0KCUjv+gpp8EK zia2S3lM-J!ionb=yE4RgaZCb$sKB|P>SL=_S$@n7Vg=D zSgB02QHD})XH_p{i|XcTk>1*k!cT~yheDxEw+BmB@e$8G7b|t&V}$L~aDFP!WIIgI z-BKODWGF5kVW{kr&>uZd4VLH-z>OnM`L$C8u6X-B&>?lfb>JjyqPp?Dy6Z$S+yVfK zo^kWkZu3DTJM~T7bJ2w#`f37)Fn8%f9%wuRY| z?(B9N|1KRM?d%)9{v}hl6~0rD zvD@MH-fbo~CK{8P9G%4}(f5gm^P*6He4_&z%edyvETL9#NKH$JYWVQx@mZ80SKg=P zIu>&LG~Mw^H!o46;^>*5zAJV1`k{dZ)d67-tIab1?CZ&u-z%FHfO$*=9c9mQ^$~j7 z#x%7kh$J*At1OLZyRuW&+#b}n9+T6i`)Im7J7JP&k~H76lycCB*g-p;jQbu=%Fz8_VgP8o<42By9U*nSdR+Z%w12dO7>x*s+X8*vE2I z#g))LCRsFMMq^(}FHNU@P;5nymX)2q{cf_z$1+9$>h_iFV;fCdEIu>+q+^#@ zwEGr_m86QW5?&ggW>x`StYfl=}eWw&Lb(FNoNW_+>!Um0TLgMqu z`0`#M^O@$~W*24zTI91!cNn@yzibQmg!bg3$C8O@d2Cpygq`O*J3C{Iqa20mDqIE_ z&srIME-7kvT@U-YN{cLF72f@Q>evM(jY3BvC+K6|>C|GC^(c81UI_EhF}rwEbT?Xj zklq`>4=5-O+rcgg07i(z=lY-nVdY za`{5ORK+D&J>Ph-v9<*q)~je3dc>FACi*|uIg_r){Ix-5nO zu761NA%9xX=a**$UzDQOiO9A-P&KJLj_RqyMTQ`5c8pF19>v&J*v1R&J+Qu5fM z5FBIHP%wR#9GQ0^OFdssDIPrS0+8sz3Nd+y!RQG=P$V^qUr(EoHK%A2AewNSCiJ(B zW!D3P?B4_Na$>Ys#e6Wd3jaV4HvSbR!`KePnQNp6X2urTMG>Q{ADWWS4&joqxiCeCxOsh@*>@xr1xe!q=pDZS%(@IUzf`f_ z#8F`2Q8yvk->@lhFi2YL7gh3w*2L*yw!YU@mxLN6yZVS*FD{36UE?7;HZr9!Qa1W#bIobd#Q-z#HOWK2AfF?JpV$4Mn{qYaG5VG5g9|BUuDOLdN^eYI9-2ODx4K z10)5TRowPX_exDb6*J}cuRI<8!j}Je`0N7&*6KI#@bL5l5KV&enh@}(hZLzXlBR}` z7j+Jw6xT9f)%&7WI}$X67NiGKs%WB6f&)-n^FJOl9C0i4A zA6Etzq@sTodbaRA0@^T;%K-Bq3;~bgR0_L~&CbsH|E`5~W2T$E8*rXG+`{3B9rVWA znVqLOI~Tg-EE;Vn^`dpNrd3}LL+T&fDC{qXLg3`U*E~ku(GIA{8Jd;kjIZ`z^-q}D z{`y$2rl|5Xb{6kDel9UHKl6qZ15Zcpt8e-7>@)))Gfr7rD3z;lOEXJ~WhikLMEI-3 zCa%$k?@81sH6y5ca$|*0LhjV*%R)1LeI?Kr9_jJXJI`|}ok!(=Z($dRY(`ESGArGP zv491><{chdjnd^O05KFoVdyMfj^Xja|Jt39Z3-#C$+mbx!v-^waNBy)p_L2FCUi?#GN%Q_&q z*ohA{58w8s+ePC=^_$m*qU}^UtBuiw-^$O2Ep%6K$r3cIY^<=(thjx+VmLVg9eh6W zUQz8qLoJ@4UNkLdr#*0!JqmP1tGQoI*xRQRU?ldB6y1-%*$8+HZN3<`)V7jQ8Nap) z-i`~Dx{8$Du%!69MqEWjuN_F_lhOI5bQjI@;hxr9>0ISpH_9__9eAoE^mSzfl#2KSD7pD&()t=M`+l zd7_-VN?uEn_z|tk{BXBnPehu5mBuX6S!6R^%;;+|lS0$ohWX^!QWV!`xF-HCErJ#@ zSb$&^K)}`Bv~TvqiicClz$m+j`JF0{oU}A*t|`uFI^?FTK!0_USS}x@&orqV#v<;Q zNi*mgB2ahg(YrVDaaCVNs{ep}^z-!z*-2C=G1Ck*{f05^4hHm`?^#etI5R&x*L(=` zF~2Sp$Bxvf6!r-l8;zeO*5ZM#R@;z?)j2B>NPs8`Tg*gf;VfrFOAE`BH(D(;4*^VVT|r?VeaBNu6@Y1;QG5t``#!;v@T)q!5|LK!DDDqyj*4-M}@b0!ipz`20nrA_)5VeV~) zpZkOFNStap*t$uNm?Fz%(3!rYzlzXICD41$PAWw&{AsQC3t8mt8**ORcQVrxOW@|E zM^R#?plGi@?A>IApUbdn;@D|IC7lFQ$Qqn_J)#Z_LW(C8i<;vJ(zopnduX6WUgPyg zB~mvVbLe+Kl~Cwk9ll$Mia(0_HM&`H7l?nsp)6NQEFm#)oCh(?gs|S-+!BK-dEATR zs`5mjqgNVRCZgWzmt_wq*Hx+&bgp$jg38@;w6-sLlCT|zg93jfm{ZJRTn)!7%X^-5 zVk@<0p^$}VU(Y7we*a;i9H_@sGX*LBXkH%oYQTJ@;s{+La!{?!!B0xgyu7MnWhs11 zZ+T&#+J=EKU52hDUbWiGvF^0GN-fa#Qs99%XH_!w;3LQ7IvJf#VUNUR4=g#JJ?f3*K28gfAt^**YR4ll-WSzAsR+Pxz_huCjdYvl1c-OrBybguy+D>c#3Qf79t!r7vh0jFQc&Ph2kIeJq^M$nC{yhoZ zpJz|aUA9fgQ&b2$JJkI%i^`-|^goHekTbA-RH;1Zn8hxC4SErvRthv2?8J<7I(>nss zMHqZH7(O_FY47GKpF8{(mxI)B#(o6={GyeD zq~pnp`Sa+j=PW=ka8f~zE{QD9kND_sT)EpkJ;s=FBL3XnH&yko+%nN}f!5O0mTse{ znQ|8!ZBrwh61Lna8d~a&cHs-N^MzXR&o>WMc78GgoXJ)2(K*?)Km#mrqC!<+%d84pnn}p4hI;83Dzri=TJ63+5C- zQ?wwjrPwaMX(U(cc}XIBGd0*OVs(4tjBhCfq6|d*e3!tCQ{ZG|^su5d8}qhxEq2_1 zY!snXh1gjcpu+`p+%lUd+PKqN;Qc?jO4W=hqt;FcjDt zZT}P6375kKI@GgkiTr=pB?VwpO|h$@$qJHaqj7vpVospDyqK<`JU2O8wlNt_e=vV2 zJ3E;ZSUMYdF*min9T1Lz;UJsA$8F;3q~uz)Qq2;n=;=?$e{Y@lZd2neA?y^*sA;Leb>&9IeHW zp7xuYx9daZEwLwRob%0h6ubH^9YJ0@x_7LV*}2T1#wQp+*x%pJRoe`URQQd$b{1|E z*q~MPm2LBV{Z7zo99Pc>*JI*6150Wlft)9x>-UG7aYq=iv0WhzCAb+|do2@*w%R6O z*DI{)^y#qmZnvpvR1ryfYiGuL_q&}41p?!DtL&nCLuC&TgJVpD_LY*1qEFv*`H-7q zQe&G3uID&Ju*_h{B3f8=&gzdZCqN1G*Sn`8y?ta9GcX`g9t_XA2M32yCnYAL+}?VW zZ6{`VqfJ{}jBZ!$y>~`XL5bn3yz}m3dwxh5if>Q^dzH=s4&qP^VMAc)) zI@FVHcP_SRRc=ev4j%Ufv&J!nJr}%BWaC764;egZD+pLI7UL;^!V1x0ND8z+Nc zs}(fB9vQn)!jyhg?bp*;SAM-K(ikzgZNEqj=e^gXa8+a64rY;2^G0G~qBv15qFUNJ z{WgQ(lM?IdUB}_cs94ygzfqrO*i}k z6B5gI^hHcTi;CQ{qhX}YEi3O4C%FaPlwZ~obAHPx6p}8~HMqPG8(})6z8Y zY(mRQY(Xtlx_{o|vN?Ldu&c}&_$O5JO6 z<#y}sP7xQd3tqqIy=KNlLf^34-u|z*6j9I13&O|+G5&|ax2v!#ug#AZuY(_-nq6^t z->xxQTimU8D6B%u`!Ve$>Ec&NLeb9p+RkZu+N$xl=|WnU4@1o(4x#DRnQ2Ety;HAW zS<84xg(iubN3xrJ0l?5d|XC>6$i zx~oS?c(5RQ1sj6Mp|QHE1hNlimL}hfJ*5p9l$K({Sx^l{dp8rQ5f>{bi@)1Z{)BUP z#TNCx?6pOnGN-?OouTt#H?U`BmCw#Gd*m55fA3iWemv%LZ^0&8cIJ<(5a>gkQ2NgV zPI_CahF=H!n+wq!6%B*2t;?wyEsB(7A1efyOO)t6uX*_7d#pd{hf6mJB$y9AfrgMsXSlRe6=4mYh>gOO zNC~Z#iP!L0azUS&vuV89arEsDs`OY$PyOGA0jLVWw-hv)h=9P6SV4&Der z|COToHSpJbeOB}7l&zohZ&d%?0#6_Qm9?SLe;m$au>gF$Ue|47At5gw)*`LqCz}zX zgI@&oc+S~CED6-vU6|+Gam1n;RbSK-)lfnjTSi!7K#sV?5p@`u_Colf5ylAK>**V3 zoDVjAP!sGK=vh?^#Yo@_WrFRT9iyOn=|YdKbCapyLCkl|?e9&K7j^YTRPjxVjx;c6 z@Woj^B0a&+7c;(2w9hN@s?pMazLD2r|Am9n$?qaZ`Us>2v@vx?Ixw4ad6~b#MO5EgSrq6 zG4qK>oLXCVf|3d{HQ$e*b{G6F-8$+Ep`Zq=Uq!g8=v5F+6sm)zHy z*~0UKt!GjSKl_R`i%TpCAp0l7B-7y~R-~ee^Enguc zd{Fjhh|UJR3w|6foeW@XZ4G=eOsQOfOPEn6^O2tfm)9&a*zN7+SN}jO`%MfT@4Ild zVMT?a7Cl4?Gg>?RkU4&ICnX*XA9sSCd6ysxuDAw^H}-b=A|18e^c#8ST_{H+knv*v zsoSt;G;aW-&xiYVZZ|is{iJwnu>I-O(+I=y-_x7+efpo%<1KQXF;)GDy=FGUaFjg} zaj>`rvAZ#)>#J;T&9u!=0(Ghjmh>^dE{z_v%c@avh~5UbDyoGU{4n>a`K$}Uf8By? z2jKp}81Jn*OONOd!L1)8rcm&`tSNK(n7+Rg@cIAQ75~MPD!%WO3E8Hw*#7Q)OS{z~ ztjBNMJ#QHK_e>8H`>9XMJfh;y=(^86!)<+TTD+|ML#b1WLF=APeY*TfQueA%v2TjK z7ifFs1+3{2d&4cx@JNf7TWfjazfT7jaT@P2tbd~ut&nx+e+1k^IO>g|4_s4EiwffOpTlUOt#>4IX zJ=5PC=--g-zjLqNPTbT?aUS1kv-v+$Gc~LfV*ft4u0Fxot@F=y?qds8Zyf#y@5U`z zxl{7|M*+DfpB}LA+e~3DPkA)aNMofqo4K)31+)Vty0&2b^S#OJ>+eVvzbSgSZh5M8 zP~Ac|$*GFKsbRO5eCrAVuJk!h*{!){#T>R@8o*w+-_6grlV#WX6uQ~S>V7;UP%>Ng z!6r+i+9Ri{KWsQ!d9e9tilxyJY5!&WeiX-4d4AoWC)YM9yY;VDO^7*f>0{^w#G!uh z1jJ2K(X9D-yd}J~=1k!+{{G*8UhlIg6bIFUhnVzQM9$4}VlTZvGeCa%dA@i);DxJ| zG0iJ&F7A*PRZqQiyMDo)ddH6A!Ix{o?mXFDnc z-h$}(^}qPfs;H>+a237o;sY+36L{)!S38`5sORip&RPHWM;gVMJI9{k}^5{Ebt*xy~3sbC~ejb*jyxxP?CPGHVx!wg109 zcja1z-VDw46K6@hEdNkhf9i68IbT^jxAejIAFEEBb?FjTtUJ=wcFxKCkL!{gPu_WN z7uQ^Sa$Im)XkGe;KazhKlp0psT)ZJBowVvxs@4pNQ)gSNr%x?EA_mLtc@d2>ZuB%X zFidT~f7QqGU%}#2g*QDKU%NcGeoeY>ef!BJ`>elL&0u>D>meT~)d0;k6do(B2(nal zWZ3#?E3faN_`*e;@c!YBd91snro^8=er)I62Tb$)rkU?x;GYleX*S+dS`hK&PV}?0 zl|jf;0OvV?^AE<$C$T#rdWsi7^8(+m86U3%t)_v_7JLD9Gi#rPd~$$wSAY^#pm~9N zRnIK)VIBkaT}(UD(0Kzrp@SG)L-z7`)Jfy)}2gbFW z1{&9;RM{6Hf(4`!I9YS9HyU~El0!Do6Iv02x@fs2x}klRZVI1K9&}flH+BjR0r -""" - -__version__ = "4.1"# + "$Revision: 1.92 $"[11:15] + "-cvs" -__license__ = """Copyright (c) 2002-2006, Mark Pilgrim, All rights reserved. - -Redistribution and use in source and binary forms, with or without modification, -are permitted provided that the following conditions are met: - -* Redistributions of source code must retain the above copyright notice, - this list of conditions and the following disclaimer. -* Redistributions in binary form must reproduce the above copyright notice, - this list of conditions and the following disclaimer in the documentation - and/or other materials provided with the distribution. - -THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS 'AS IS' -AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE -IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE -ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE -LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR -CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF -SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS -INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN -CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) -ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE -POSSIBILITY OF SUCH DAMAGE.""" -__author__ = "Mark Pilgrim " -__contributors__ = ["Jason Diamond ", - "John Beimler ", - "Fazal Majid ", - "Aaron Swartz ", - "Kevin Marks "] -_debug = 0 - -# HTTP "User-Agent" header to send to servers when downloading feeds. -# If you are embedding feedparser in a larger application, you should -# change this to your application name and URL. -USER_AGENT = "UniversalFeedParser/%s +http://feedparser.org/" % __version__ - -# HTTP "Accept" header to send to servers when downloading feeds. If you don't -# want to send an Accept header, set this to None. -ACCEPT_HEADER = "application/atom+xml,application/rdf+xml,application/rss+xml,application/x-netcdf,application/xml;q=0.9,text/xml;q=0.2,*/*;q=0.1" - -# List of preferred XML parsers, by SAX driver name. These will be tried first, -# but if they're not installed, Python will keep searching through its own list -# of pre-installed parsers until it finds one that supports everything we need. -PREFERRED_XML_PARSERS = ["drv_libxml2"] - -# If you want feedparser to automatically run HTML markup through HTML Tidy, set -# this to 1. Requires mxTidy -# or utidylib . -TIDY_MARKUP = 0 - -# List of Python interfaces for HTML Tidy, in order of preference. Only useful -# if TIDY_MARKUP = 1 -PREFERRED_TIDY_INTERFACES = ["uTidy", "mxTidy"] - -# ---------- required modules (should come with any Python distribution) ---------- -import sgmllib, re, sys, copy, urlparse, time, rfc822, types, cgi, urllib, urllib2 -try: - from cStringIO import StringIO as _StringIO -except: - from StringIO import StringIO as _StringIO - -# ---------- optional modules (feedparser will work without these, but with reduced functionality) ---------- - -# gzip is included with most Python distributions, but may not be available if you compiled your own -try: - import gzip -except: - gzip = None -try: - import zlib -except: - zlib = None - -# If a real XML parser is available, feedparser will attempt to use it. feedparser has -# been tested with the built-in SAX parser, PyXML, and libxml2. On platforms where the -# Python distribution does not come with an XML parser (such as Mac OS X 10.2 and some -# versions of FreeBSD), feedparser will quietly fall back on regex-based parsing. -try: - import xml.sax - xml.sax.make_parser(PREFERRED_XML_PARSERS) # test for valid parsers - from xml.sax.saxutils import escape as _xmlescape - _XML_AVAILABLE = 1 -except: - _XML_AVAILABLE = 0 - def _xmlescape(data): - data = data.replace('&', '&') - data = data.replace('>', '>') - data = data.replace('<', '<') - return data - -# base64 support for Atom feeds that contain embedded binary data -try: - import base64, binascii -except: - base64 = binascii = None - -# cjkcodecs and iconv_codec provide support for more character encodings. -# Both are available from http://cjkpython.i18n.org/ -try: - import cjkcodecs.aliases -except: - pass -try: - import iconv_codec -except: - pass - -# chardet library auto-detects character encodings -# Download from http://chardet.feedparser.org/ -try: - import chardet - if _debug: - import chardet.constants - chardet.constants._debug = 1 -except: - chardet = None - -# ---------- don't touch these ---------- -class ThingsNobodyCaresAboutButMe(Exception): pass -class CharacterEncodingOverride(ThingsNobodyCaresAboutButMe): pass -class CharacterEncodingUnknown(ThingsNobodyCaresAboutButMe): pass -class NonXMLContentType(ThingsNobodyCaresAboutButMe): pass -class UndeclaredNamespace(Exception): pass - -sgmllib.tagfind = re.compile('[a-zA-Z][-_.:a-zA-Z0-9]*') -sgmllib.special = re.compile('' % (tag, ''.join([' %s="%s"' % t for t in attrs])), escape=0) - - # match namespaces - if tag.find(':') <> -1: - prefix, suffix = tag.split(':', 1) - else: - prefix, suffix = '', tag - prefix = self.namespacemap.get(prefix, prefix) - if prefix: - prefix = prefix + '_' - - # special hack for better tracking of empty textinput/image elements in illformed feeds - if (not prefix) and tag not in ('title', 'link', 'description', 'name'): - self.intextinput = 0 - if (not prefix) and tag not in ('title', 'link', 'description', 'url', 'href', 'width', 'height'): - self.inimage = 0 - - # call special handler (if defined) or default handler - methodname = '_start_' + prefix + suffix - try: - method = getattr(self, methodname) - return method(attrsD) - except AttributeError: - return self.push(prefix + suffix, 1) - - def unknown_endtag(self, tag): - if _debug: sys.stderr.write('end %s\n' % tag) - # match namespaces - if tag.find(':') <> -1: - prefix, suffix = tag.split(':', 1) - else: - prefix, suffix = '', tag - prefix = self.namespacemap.get(prefix, prefix) - if prefix: - prefix = prefix + '_' - - # call special handler (if defined) or default handler - methodname = '_end_' + prefix + suffix - try: - method = getattr(self, methodname) - method() - except AttributeError: - self.pop(prefix + suffix) - - # track inline content - if self.incontent and self.contentparams.has_key('type') and not self.contentparams.get('type', 'xml').endswith('xml'): - # element declared itself as escaped markup, but it isn't really - self.contentparams['type'] = 'application/xhtml+xml' - if self.incontent and self.contentparams.get('type') == 'application/xhtml+xml': - tag = tag.split(':')[-1] - self.handle_data('' % tag, escape=0) - - # track xml:base and xml:lang going out of scope - if self.basestack: - self.basestack.pop() - if self.basestack and self.basestack[-1]: - self.baseuri = self.basestack[-1] - if self.langstack: - self.langstack.pop() - if self.langstack: # and (self.langstack[-1] is not None): - self.lang = self.langstack[-1] - - def handle_charref(self, ref): - # called for each character reference, e.g. for ' ', ref will be '160' - if not self.elementstack: return - ref = ref.lower() - if ref in ('34', '38', '39', '60', '62', 'x22', 'x26', 'x27', 'x3c', 'x3e'): - text = '&#%s;' % ref - else: - if ref[0] == 'x': - c = int(ref[1:], 16) - else: - c = int(ref) - text = unichr(c).encode('utf-8') - self.elementstack[-1][2].append(text) - - def handle_entityref(self, ref): - # called for each entity reference, e.g. for '©', ref will be 'copy' - if not self.elementstack: return - if _debug: sys.stderr.write('entering handle_entityref with %s\n' % ref) - if ref in ('lt', 'gt', 'quot', 'amp', 'apos'): - text = '&%s;' % ref - else: - # entity resolution graciously donated by Aaron Swartz - def name2cp(k): - import htmlentitydefs - if hasattr(htmlentitydefs, 'name2codepoint'): # requires Python 2.3 - return htmlentitydefs.name2codepoint[k] - k = htmlentitydefs.entitydefs[k] - if k.startswith('&#') and k.endswith(';'): - return int(k[2:-1]) # not in latin-1 - return ord(k) - try: name2cp(ref) - except KeyError: text = '&%s;' % ref - else: text = unichr(name2cp(ref)).encode('utf-8') - self.elementstack[-1][2].append(text) - - def handle_data(self, text, escape=1): - # called for each block of plain text, i.e. outside of any tag and - # not containing any character or entity references - if not self.elementstack: return - if escape and self.contentparams.get('type') == 'application/xhtml+xml': - text = _xmlescape(text) - self.elementstack[-1][2].append(text) - - def handle_comment(self, text): - # called for each comment, e.g. - pass - - def handle_pi(self, text): - # called for each processing instruction, e.g. - pass - - def handle_decl(self, text): - pass - - def parse_declaration(self, i): - # override internal declaration handler to handle CDATA blocks - if _debug: sys.stderr.write('entering parse_declaration\n') - if self.rawdata[i:i+9] == '', i) - if k == -1: k = len(self.rawdata) - self.handle_data(_xmlescape(self.rawdata[i+9:k]), 0) - return k+3 - else: - k = self.rawdata.find('>', i) - return k+1 - - def mapContentType(self, contentType): - contentType = contentType.lower() - if contentType == 'text': - contentType = 'text/plain' - elif contentType == 'html': - contentType = 'text/html' - elif contentType == 'xhtml': - contentType = 'application/xhtml+xml' - return contentType - - def trackNamespace(self, prefix, uri): - loweruri = uri.lower() - if (prefix, loweruri) == (None, 'http://my.netscape.com/rdf/simple/0.9/') and not self.version: - self.version = 'rss090' - if loweruri == 'http://purl.org/rss/1.0/' and not self.version: - self.version = 'rss10' - if loweruri == 'http://www.w3.org/2005/atom' and not self.version: - self.version = 'atom10' - if loweruri.find('backend.userland.com/rss') <> -1: - # match any backend.userland.com namespace - uri = 'http://backend.userland.com/rss' - loweruri = uri - if self._matchnamespaces.has_key(loweruri): - self.namespacemap[prefix] = self._matchnamespaces[loweruri] - self.namespacesInUse[self._matchnamespaces[loweruri]] = uri - else: - self.namespacesInUse[prefix or ''] = uri - - def resolveURI(self, uri): - return _urljoin(self.baseuri or '', uri) - - def decodeEntities(self, element, data): - return data - - def push(self, element, expectingText): - self.elementstack.append([element, expectingText, []]) - - def pop(self, element, stripWhitespace=1): - if not self.elementstack: return - if self.elementstack[-1][0] != element: return - - element, expectingText, pieces = self.elementstack.pop() - output = ''.join(pieces) - if stripWhitespace: - output = output.strip() - if not expectingText: return output - - # decode base64 content - if base64 and self.contentparams.get('base64', 0): - try: - output = base64.decodestring(output) - except binascii.Error: - pass - except binascii.Incomplete: - pass - - # resolve relative URIs - if (element in self.can_be_relative_uri) and output: - output = self.resolveURI(output) - - # decode entities within embedded markup - if not self.contentparams.get('base64', 0): - output = self.decodeEntities(element, output) - - # remove temporary cruft from contentparams - try: - del self.contentparams['mode'] - except KeyError: - pass - try: - del self.contentparams['base64'] - except KeyError: - pass - - # resolve relative URIs within embedded markup - if self.mapContentType(self.contentparams.get('type', 'text/html')) in self.html_types: - if element in self.can_contain_relative_uris: - output = _resolveRelativeURIs(output, self.baseuri, self.encoding) - - # sanitize embedded markup - if self.mapContentType(self.contentparams.get('type', 'text/html')) in self.html_types: - if element in self.can_contain_dangerous_markup: - output = _sanitizeHTML(output, self.encoding) - - if self.encoding and type(output) != type(u''): - try: - output = unicode(output, self.encoding) - except: - pass - - # categories/tags/keywords/whatever are handled in _end_category - if element == 'category': - return output - - # store output in appropriate place(s) - if self.inentry and not self.insource: - if element == 'content': - self.entries[-1].setdefault(element, []) - contentparams = copy.deepcopy(self.contentparams) - contentparams['value'] = output - self.entries[-1][element].append(contentparams) - elif element == 'link': - self.entries[-1][element] = output - if output: - self.entries[-1]['links'][-1]['href'] = output - else: - if element == 'description': - element = 'summary' - self.entries[-1][element] = output - if self.incontent: - contentparams = copy.deepcopy(self.contentparams) - contentparams['value'] = output - self.entries[-1][element + '_detail'] = contentparams - elif (self.infeed or self.insource) and (not self.intextinput) and (not self.inimage): - context = self._getContext() - if element == 'description': - element = 'subtitle' - context[element] = output - if element == 'link': - context['links'][-1]['href'] = output - elif self.incontent: - contentparams = copy.deepcopy(self.contentparams) - contentparams['value'] = output - context[element + '_detail'] = contentparams - return output - - def pushContent(self, tag, attrsD, defaultContentType, expectingText): - self.incontent += 1 - self.contentparams = FeedParserDict({ - 'type': self.mapContentType(attrsD.get('type', defaultContentType)), - 'language': self.lang, - 'base': self.baseuri}) - self.contentparams['base64'] = self._isBase64(attrsD, self.contentparams) - self.push(tag, expectingText) - - def popContent(self, tag): - value = self.pop(tag) - self.incontent -= 1 - self.contentparams.clear() - return value - - def _mapToStandardPrefix(self, name): - colonpos = name.find(':') - if colonpos <> -1: - prefix = name[:colonpos] - suffix = name[colonpos+1:] - prefix = self.namespacemap.get(prefix, prefix) - name = prefix + ':' + suffix - return name - - def _getAttribute(self, attrsD, name): - return attrsD.get(self._mapToStandardPrefix(name)) - - def _isBase64(self, attrsD, contentparams): - if attrsD.get('mode', '') == 'base64': - return 1 - if self.contentparams['type'].startswith('text/'): - return 0 - if self.contentparams['type'].endswith('+xml'): - return 0 - if self.contentparams['type'].endswith('/xml'): - return 0 - return 1 - - def _itsAnHrefDamnIt(self, attrsD): - href = attrsD.get('url', attrsD.get('uri', attrsD.get('href', None))) - if href: - try: - del attrsD['url'] - except KeyError: - pass - try: - del attrsD['uri'] - except KeyError: - pass - attrsD['href'] = href - return attrsD - - def _save(self, key, value): - context = self._getContext() - context.setdefault(key, value) - - def _start_rss(self, attrsD): - versionmap = {'0.91': 'rss091u', - '0.92': 'rss092', - '0.93': 'rss093', - '0.94': 'rss094'} - if not self.version: - attr_version = attrsD.get('version', '') - version = versionmap.get(attr_version) - if version: - self.version = version - elif attr_version.startswith('2.'): - self.version = 'rss20' - else: - self.version = 'rss' - - def _start_dlhottitles(self, attrsD): - self.version = 'hotrss' - - def _start_channel(self, attrsD): - self.infeed = 1 - self._cdf_common(attrsD) - _start_feedinfo = _start_channel - - def _cdf_common(self, attrsD): - if attrsD.has_key('lastmod'): - self._start_modified({}) - self.elementstack[-1][-1] = attrsD['lastmod'] - self._end_modified() - if attrsD.has_key('href'): - self._start_link({}) - self.elementstack[-1][-1] = attrsD['href'] - self._end_link() - - def _start_feed(self, attrsD): - self.infeed = 1 - versionmap = {'0.1': 'atom01', - '0.2': 'atom02', - '0.3': 'atom03'} - if not self.version: - attr_version = attrsD.get('version') - version = versionmap.get(attr_version) - if version: - self.version = version - else: - self.version = 'atom' - - def _end_channel(self): - self.infeed = 0 - _end_feed = _end_channel - - def _start_image(self, attrsD): - self.inimage = 1 - self.push('image', 0) - context = self._getContext() - context.setdefault('image', FeedParserDict()) - - def _end_image(self): - self.pop('image') - self.inimage = 0 - - def _start_textinput(self, attrsD): - self.intextinput = 1 - self.push('textinput', 0) - context = self._getContext() - context.setdefault('textinput', FeedParserDict()) - _start_textInput = _start_textinput - - def _end_textinput(self): - self.pop('textinput') - self.intextinput = 0 - _end_textInput = _end_textinput - - def _start_author(self, attrsD): - self.inauthor = 1 - self.push('author', 1) - _start_managingeditor = _start_author - _start_dc_author = _start_author - _start_dc_creator = _start_author - _start_itunes_author = _start_author - - def _end_author(self): - self.pop('author') - self.inauthor = 0 - self._sync_author_detail() - _end_managingeditor = _end_author - _end_dc_author = _end_author - _end_dc_creator = _end_author - _end_itunes_author = _end_author - - def _start_itunes_owner(self, attrsD): - self.inpublisher = 1 - self.push('publisher', 0) - - def _end_itunes_owner(self): - self.pop('publisher') - self.inpublisher = 0 - self._sync_author_detail('publisher') - - def _start_contributor(self, attrsD): - self.incontributor = 1 - context = self._getContext() - context.setdefault('contributors', []) - context['contributors'].append(FeedParserDict()) - self.push('contributor', 0) - - def _end_contributor(self): - self.pop('contributor') - self.incontributor = 0 - - def _start_dc_contributor(self, attrsD): - self.incontributor = 1 - context = self._getContext() - context.setdefault('contributors', []) - context['contributors'].append(FeedParserDict()) - self.push('name', 0) - - def _end_dc_contributor(self): - self._end_name() - self.incontributor = 0 - - def _start_name(self, attrsD): - self.push('name', 0) - _start_itunes_name = _start_name - - def _end_name(self): - value = self.pop('name') - if self.inpublisher: - self._save_author('name', value, 'publisher') - elif self.inauthor: - self._save_author('name', value) - elif self.incontributor: - self._save_contributor('name', value) - elif self.intextinput: - context = self._getContext() - context['textinput']['name'] = value - _end_itunes_name = _end_name - - def _start_width(self, attrsD): - self.push('width', 0) - - def _end_width(self): - value = self.pop('width') - try: - value = int(value) - except: - value = 0 - if self.inimage: - context = self._getContext() - context['image']['width'] = value - - def _start_height(self, attrsD): - self.push('height', 0) - - def _end_height(self): - value = self.pop('height') - try: - value = int(value) - except: - value = 0 - if self.inimage: - context = self._getContext() - context['image']['height'] = value - - def _start_url(self, attrsD): - self.push('href', 1) - _start_homepage = _start_url - _start_uri = _start_url - - def _end_url(self): - value = self.pop('href') - if self.inauthor: - self._save_author('href', value) - elif self.incontributor: - self._save_contributor('href', value) - elif self.inimage: - context = self._getContext() - context['image']['href'] = value - elif self.intextinput: - context = self._getContext() - context['textinput']['link'] = value - _end_homepage = _end_url - _end_uri = _end_url - - def _start_email(self, attrsD): - self.push('email', 0) - _start_itunes_email = _start_email - - def _end_email(self): - value = self.pop('email') - if self.inpublisher: - self._save_author('email', value, 'publisher') - elif self.inauthor: - self._save_author('email', value) - elif self.incontributor: - self._save_contributor('email', value) - _end_itunes_email = _end_email - - def _getContext(self): - if self.insource: - context = self.sourcedata - elif self.inentry: - context = self.entries[-1] - else: - context = self.feeddata - return context - - def _save_author(self, key, value, prefix='author'): - context = self._getContext() - context.setdefault(prefix + '_detail', FeedParserDict()) - context[prefix + '_detail'][key] = value - self._sync_author_detail() - - def _save_contributor(self, key, value): - context = self._getContext() - context.setdefault('contributors', [FeedParserDict()]) - context['contributors'][-1][key] = value - - def _sync_author_detail(self, key='author'): - context = self._getContext() - detail = context.get('%s_detail' % key) - if detail: - name = detail.get('name') - email = detail.get('email') - if name and email: - context[key] = '%s (%s)' % (name, email) - elif name: - context[key] = name - elif email: - context[key] = email - else: - author = context.get(key) - if not author: return - emailmatch = re.search(r'''(([a-zA-Z0-9\_\-\.\+]+)@((\[[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.)|(([a-zA-Z0-9\-]+\.)+))([a-zA-Z]{2,4}|[0-9]{1,3})(\]?))''', author) - if not emailmatch: return - email = emailmatch.group(0) - # probably a better way to do the following, but it passes all the tests - author = author.replace(email, '') - author = author.replace('()', '') - author = author.strip() - if author and (author[0] == '('): - author = author[1:] - if author and (author[-1] == ')'): - author = author[:-1] - author = author.strip() - context.setdefault('%s_detail' % key, FeedParserDict()) - context['%s_detail' % key]['name'] = author - context['%s_detail' % key]['email'] = email - - def _start_subtitle(self, attrsD): - self.pushContent('subtitle', attrsD, 'text/plain', 1) - _start_tagline = _start_subtitle - _start_itunes_subtitle = _start_subtitle - - def _end_subtitle(self): - self.popContent('subtitle') - _end_tagline = _end_subtitle - _end_itunes_subtitle = _end_subtitle - - def _start_rights(self, attrsD): - self.pushContent('rights', attrsD, 'text/plain', 1) - _start_dc_rights = _start_rights - _start_copyright = _start_rights - - def _end_rights(self): - self.popContent('rights') - _end_dc_rights = _end_rights - _end_copyright = _end_rights - - def _start_item(self, attrsD): - self.entries.append(FeedParserDict()) - self.push('item', 0) - self.inentry = 1 - self.guidislink = 0 - id = self._getAttribute(attrsD, 'rdf:about') - if id: - context = self._getContext() - context['id'] = id - self._cdf_common(attrsD) - _start_entry = _start_item - _start_product = _start_item - - def _end_item(self): - self.pop('item') - self.inentry = 0 - _end_entry = _end_item - - def _start_dc_language(self, attrsD): - self.push('language', 1) - _start_language = _start_dc_language - - def _end_dc_language(self): - self.lang = self.pop('language') - _end_language = _end_dc_language - - def _start_dc_publisher(self, attrsD): - self.push('publisher', 1) - _start_webmaster = _start_dc_publisher - - def _end_dc_publisher(self): - self.pop('publisher') - self._sync_author_detail('publisher') - _end_webmaster = _end_dc_publisher - - def _start_published(self, attrsD): - self.push('published', 1) - _start_dcterms_issued = _start_published - _start_issued = _start_published - - def _end_published(self): - value = self.pop('published') - self._save('published_parsed', _parse_date(value)) - _end_dcterms_issued = _end_published - _end_issued = _end_published - - def _start_updated(self, attrsD): - self.push('updated', 1) - _start_modified = _start_updated - _start_dcterms_modified = _start_updated - _start_pubdate = _start_updated - _start_dc_date = _start_updated - - def _end_updated(self): - value = self.pop('updated') - parsed_value = _parse_date(value) - self._save('updated_parsed', parsed_value) - _end_modified = _end_updated - _end_dcterms_modified = _end_updated - _end_pubdate = _end_updated - _end_dc_date = _end_updated - - def _start_created(self, attrsD): - self.push('created', 1) - _start_dcterms_created = _start_created - - def _end_created(self): - value = self.pop('created') - self._save('created_parsed', _parse_date(value)) - _end_dcterms_created = _end_created - - def _start_expirationdate(self, attrsD): - self.push('expired', 1) - - def _end_expirationdate(self): - self._save('expired_parsed', _parse_date(self.pop('expired'))) - - def _start_cc_license(self, attrsD): - self.push('license', 1) - value = self._getAttribute(attrsD, 'rdf:resource') - if value: - self.elementstack[-1][2].append(value) - self.pop('license') - - def _start_creativecommons_license(self, attrsD): - self.push('license', 1) - - def _end_creativecommons_license(self): - self.pop('license') - - def _addTag(self, term, scheme, label): - context = self._getContext() - tags = context.setdefault('tags', []) - if (not term) and (not scheme) and (not label): return - value = FeedParserDict({'term': term, 'scheme': scheme, 'label': label}) - if value not in tags: - tags.append(FeedParserDict({'term': term, 'scheme': scheme, 'label': label})) - - def _start_category(self, attrsD): - if _debug: sys.stderr.write('entering _start_category with %s\n' % repr(attrsD)) - term = attrsD.get('term') - scheme = attrsD.get('scheme', attrsD.get('domain')) - label = attrsD.get('label') - self._addTag(term, scheme, label) - self.push('category', 1) - _start_dc_subject = _start_category - _start_keywords = _start_category - - def _end_itunes_keywords(self): - for term in self.pop('itunes_keywords').split(): - self._addTag(term, 'http://www.itunes.com/', None) - - def _start_itunes_category(self, attrsD): - self._addTag(attrsD.get('text'), 'http://www.itunes.com/', None) - self.push('category', 1) - - def _end_category(self): - value = self.pop('category') - if not value: return - context = self._getContext() - tags = context['tags'] - if value and len(tags) and not tags[-1]['term']: - tags[-1]['term'] = value - else: - self._addTag(value, None, None) - _end_dc_subject = _end_category - _end_keywords = _end_category - _end_itunes_category = _end_category - - def _start_cloud(self, attrsD): - self._getContext()['cloud'] = FeedParserDict(attrsD) - - def _start_link(self, attrsD): - attrsD.setdefault('rel', 'alternate') - attrsD.setdefault('type', 'text/html') - attrsD = self._itsAnHrefDamnIt(attrsD) - if attrsD.has_key('href'): - attrsD['href'] = self.resolveURI(attrsD['href']) - expectingText = self.infeed or self.inentry or self.insource - context = self._getContext() - context.setdefault('links', []) - context['links'].append(FeedParserDict(attrsD)) - if attrsD['rel'] == 'enclosure': - self._start_enclosure(attrsD) - if attrsD.has_key('href'): - expectingText = 0 - if (attrsD.get('rel') == 'alternate') and (self.mapContentType(attrsD.get('type')) in self.html_types): - context['link'] = attrsD['href'] - else: - self.push('link', expectingText) - _start_producturl = _start_link - - def _end_link(self): - value = self.pop('link') - context = self._getContext() - if self.intextinput: - context['textinput']['link'] = value - if self.inimage: - context['image']['link'] = value - _end_producturl = _end_link - - def _start_guid(self, attrsD): - self.guidislink = (attrsD.get('ispermalink', 'true') == 'true') - self.push('id', 1) - - def _end_guid(self): - value = self.pop('id') - self._save('guidislink', self.guidislink and not self._getContext().has_key('link')) - if self.guidislink: - # guid acts as link, but only if 'ispermalink' is not present or is 'true', - # and only if the item doesn't already have a link element - self._save('link', value) - - def _start_title(self, attrsD): - self.pushContent('title', attrsD, 'text/plain', self.infeed or self.inentry or self.insource) - _start_dc_title = _start_title - _start_media_title = _start_title - - def _end_title(self): - value = self.popContent('title') - context = self._getContext() - if self.intextinput: - context['textinput']['title'] = value - elif self.inimage: - context['image']['title'] = value - _end_dc_title = _end_title - _end_media_title = _end_title - - def _start_description(self, attrsD): - context = self._getContext() - if context.has_key('summary'): - self._summaryKey = 'content' - self._start_content(attrsD) - else: - self.pushContent('description', attrsD, 'text/html', self.infeed or self.inentry or self.insource) - - def _start_abstract(self, attrsD): - self.pushContent('description', attrsD, 'text/plain', self.infeed or self.inentry or self.insource) - - def _end_description(self): - if self._summaryKey == 'content': - self._end_content() - else: - value = self.popContent('description') - context = self._getContext() - if self.intextinput: - context['textinput']['description'] = value - elif self.inimage: - context['image']['description'] = value - self._summaryKey = None - _end_abstract = _end_description - - def _start_info(self, attrsD): - self.pushContent('info', attrsD, 'text/plain', 1) - _start_feedburner_browserfriendly = _start_info - - def _end_info(self): - self.popContent('info') - _end_feedburner_browserfriendly = _end_info - - def _start_generator(self, attrsD): - if attrsD: - attrsD = self._itsAnHrefDamnIt(attrsD) - if attrsD.has_key('href'): - attrsD['href'] = self.resolveURI(attrsD['href']) - self._getContext()['generator_detail'] = FeedParserDict(attrsD) - self.push('generator', 1) - - def _end_generator(self): - value = self.pop('generator') - context = self._getContext() - if context.has_key('generator_detail'): - context['generator_detail']['name'] = value - - def _start_admin_generatoragent(self, attrsD): - self.push('generator', 1) - value = self._getAttribute(attrsD, 'rdf:resource') - if value: - self.elementstack[-1][2].append(value) - self.pop('generator') - self._getContext()['generator_detail'] = FeedParserDict({'href': value}) - - def _start_admin_errorreportsto(self, attrsD): - self.push('errorreportsto', 1) - value = self._getAttribute(attrsD, 'rdf:resource') - if value: - self.elementstack[-1][2].append(value) - self.pop('errorreportsto') - - def _start_summary(self, attrsD): - context = self._getContext() - if context.has_key('summary'): - self._summaryKey = 'content' - self._start_content(attrsD) - else: - self._summaryKey = 'summary' - self.pushContent(self._summaryKey, attrsD, 'text/plain', 1) - _start_itunes_summary = _start_summary - - def _end_summary(self): - if self._summaryKey == 'content': - self._end_content() - else: - self.popContent(self._summaryKey or 'summary') - self._summaryKey = None - _end_itunes_summary = _end_summary - - def _start_enclosure(self, attrsD): - attrsD = self._itsAnHrefDamnIt(attrsD) - self._getContext().setdefault('enclosures', []).append(FeedParserDict(attrsD)) - href = attrsD.get('href') - if href: - context = self._getContext() - if not context.get('id'): - context['id'] = href - - def _start_source(self, attrsD): - self.insource = 1 - - def _end_source(self): - self.insource = 0 - self._getContext()['source'] = copy.deepcopy(self.sourcedata) - self.sourcedata.clear() - - def _start_content(self, attrsD): - self.pushContent('content', attrsD, 'text/plain', 1) - src = attrsD.get('src') - if src: - self.contentparams['src'] = src - self.push('content', 1) - - def _start_prodlink(self, attrsD): - self.pushContent('content', attrsD, 'text/html', 1) - - def _start_body(self, attrsD): - self.pushContent('content', attrsD, 'application/xhtml+xml', 1) - _start_xhtml_body = _start_body - - def _start_content_encoded(self, attrsD): - self.pushContent('content', attrsD, 'text/html', 1) - _start_fullitem = _start_content_encoded - - def _end_content(self): - copyToDescription = self.mapContentType(self.contentparams.get('type')) in (['text/plain'] + self.html_types) - value = self.popContent('content') - if copyToDescription: - self._save('description', value) - _end_body = _end_content - _end_xhtml_body = _end_content - _end_content_encoded = _end_content - _end_fullitem = _end_content - _end_prodlink = _end_content - - def _start_itunes_image(self, attrsD): - self.push('itunes_image', 0) - self._getContext()['image'] = FeedParserDict({'href': attrsD.get('href')}) - _start_itunes_link = _start_itunes_image - - def _end_itunes_block(self): - value = self.pop('itunes_block', 0) - self._getContext()['itunes_block'] = (value == 'yes') and 1 or 0 - - def _end_itunes_explicit(self): - value = self.pop('itunes_explicit', 0) - self._getContext()['itunes_explicit'] = (value == 'yes') and 1 or 0 - -if _XML_AVAILABLE: - class _StrictFeedParser(_FeedParserMixin, xml.sax.handler.ContentHandler): - def __init__(self, baseuri, baselang, encoding): - if _debug: sys.stderr.write('trying StrictFeedParser\n') - xml.sax.handler.ContentHandler.__init__(self) - _FeedParserMixin.__init__(self, baseuri, baselang, encoding) - self.bozo = 0 - self.exc = None - - def startPrefixMapping(self, prefix, uri): - self.trackNamespace(prefix, uri) - - def startElementNS(self, name, qname, attrs): - namespace, localname = name - lowernamespace = str(namespace or '').lower() - if lowernamespace.find('backend.userland.com/rss') <> -1: - # match any backend.userland.com namespace - namespace = 'http://backend.userland.com/rss' - lowernamespace = namespace - if qname and qname.find(':') > 0: - givenprefix = qname.split(':')[0] - else: - givenprefix = None - prefix = self._matchnamespaces.get(lowernamespace, givenprefix) - if givenprefix and (prefix == None or (prefix == '' and lowernamespace == '')) and not self.namespacesInUse.has_key(givenprefix): - raise UndeclaredNamespace, "'%s' is not associated with a namespace" % givenprefix - if prefix: - localname = prefix + ':' + localname - localname = str(localname).lower() - if _debug: sys.stderr.write('startElementNS: qname = %s, namespace = %s, givenprefix = %s, prefix = %s, attrs = %s, localname = %s\n' % (qname, namespace, givenprefix, prefix, attrs.items(), localname)) - - # qname implementation is horribly broken in Python 2.1 (it - # doesn't report any), and slightly broken in Python 2.2 (it - # doesn't report the xml: namespace). So we match up namespaces - # with a known list first, and then possibly override them with - # the qnames the SAX parser gives us (if indeed it gives us any - # at all). Thanks to MatejC for helping me test this and - # tirelessly telling me that it didn't work yet. - attrsD = {} - for (namespace, attrlocalname), attrvalue in attrs._attrs.items(): - lowernamespace = (namespace or '').lower() - prefix = self._matchnamespaces.get(lowernamespace, '') - if prefix: - attrlocalname = prefix + ':' + attrlocalname - attrsD[str(attrlocalname).lower()] = attrvalue - for qname in attrs.getQNames(): - attrsD[str(qname).lower()] = attrs.getValueByQName(qname) - self.unknown_starttag(localname, attrsD.items()) - - def characters(self, text): - self.handle_data(text) - - def endElementNS(self, name, qname): - namespace, localname = name - lowernamespace = str(namespace or '').lower() - if qname and qname.find(':') > 0: - givenprefix = qname.split(':')[0] - else: - givenprefix = '' - prefix = self._matchnamespaces.get(lowernamespace, givenprefix) - if prefix: - localname = prefix + ':' + localname - localname = str(localname).lower() - self.unknown_endtag(localname) - - def error(self, exc): - self.bozo = 1 - self.exc = exc - - def fatalError(self, exc): - self.error(exc) - raise exc - -class _BaseHTMLProcessor(sgmllib.SGMLParser): - elements_no_end_tag = ['area', 'base', 'basefont', 'br', 'col', 'frame', 'hr', - 'img', 'input', 'isindex', 'link', 'meta', 'param'] - - def __init__(self, encoding): - self.encoding = encoding - if _debug: sys.stderr.write('entering BaseHTMLProcessor, encoding=%s\n' % self.encoding) - sgmllib.SGMLParser.__init__(self) - - def reset(self): - self.pieces = [] - sgmllib.SGMLParser.reset(self) - - def _shorttag_replace(self, match): - tag = match.group(1) - if tag in self.elements_no_end_tag: - return '<' + tag + ' />' - else: - return '<' + tag + '>' - - def feed(self, data): - data = re.compile(r'', self._shorttag_replace, data) # bug [ 1399464 ] Bad regexp for _shorttag_replace - data = re.sub(r'<([^<\s]+?)\s*/>', self._shorttag_replace, data) - data = data.replace(''', "'") - data = data.replace('"', '"') - if self.encoding and type(data) == type(u''): - data = data.encode(self.encoding) - sgmllib.SGMLParser.feed(self, data) - - def normalize_attrs(self, attrs): - # utility method to be called by descendants - attrs = [(k.lower(), v) for k, v in attrs] - attrs = [(k, k in ('rel', 'type') and v.lower() or v) for k, v in attrs] - return attrs - - def unknown_starttag(self, tag, attrs): - # called for each start tag - # attrs is a list of (attr, value) tuples - # e.g. for 
, tag='pre', attrs=[('class', 'screen')]
-        if _debug: sys.stderr.write('_BaseHTMLProcessor, unknown_starttag, tag=%s\n' % tag)
-        uattrs = []
-        # thanks to Kevin Marks for this breathtaking hack to deal with (valid) high-bit attribute values in UTF-8 feeds
-        for key, value in attrs:
-            if type(value) != type(u''):
-                value = unicode(value, self.encoding)
-            uattrs.append((unicode(key, self.encoding), value))
-        strattrs = u''.join([u' %s="%s"' % (key, value) for key, value in uattrs]).encode(self.encoding)
-        if tag in self.elements_no_end_tag:
-            self.pieces.append('<%(tag)s%(strattrs)s />' % locals())
-        else:
-            self.pieces.append('<%(tag)s%(strattrs)s>' % locals())
-
-    def unknown_endtag(self, tag):
-        # called for each end tag, e.g. for
, tag will be 'pre' - # Reconstruct the original end tag. - if tag not in self.elements_no_end_tag: - self.pieces.append("" % locals()) - - def handle_charref(self, ref): - # called for each character reference, e.g. for ' ', ref will be '160' - # Reconstruct the original character reference. - self.pieces.append('&#%(ref)s;' % locals()) - - def handle_entityref(self, ref): - # called for each entity reference, e.g. for '©', ref will be 'copy' - # Reconstruct the original entity reference. - self.pieces.append('&%(ref)s;' % locals()) - - def handle_data(self, text): - # called for each block of plain text, i.e. outside of any tag and - # not containing any character or entity references - # Store the original text verbatim. - if _debug: sys.stderr.write('_BaseHTMLProcessor, handle_text, text=%s\n' % text) - self.pieces.append(text) - - def handle_comment(self, text): - # called for each HTML comment, e.g. - # Reconstruct the original comment. - self.pieces.append('' % locals()) - - def handle_pi(self, text): - # called for each processing instruction, e.g. - # Reconstruct original processing instruction. - self.pieces.append('' % locals()) - - def handle_decl(self, text): - # called for the DOCTYPE, if present, e.g. - # - # Reconstruct original DOCTYPE - self.pieces.append('' % locals()) - - _new_declname_match = re.compile(r'[a-zA-Z][-_.a-zA-Z0-9:]*\s*').match - def _scan_name(self, i, declstartpos): - rawdata = self.rawdata - n = len(rawdata) - if i == n: - return None, -1 - m = self._new_declname_match(rawdata, i) - if m: - s = m.group() - name = s.strip() - if (i + len(s)) == n: - return None, -1 # end of buffer - return name.lower(), m.end() - else: - self.handle_data(rawdata) -# self.updatepos(declstartpos, i) - return None, -1 - - def output(self): - '''Return processed HTML as a single string''' - return ''.join([str(p) for p in self.pieces]) - -class _LooseFeedParser(_FeedParserMixin, _BaseHTMLProcessor): - def __init__(self, baseuri, baselang, encoding): - sgmllib.SGMLParser.__init__(self) - _FeedParserMixin.__init__(self, baseuri, baselang, encoding) - - def decodeEntities(self, element, data): - data = data.replace('<', '<') - data = data.replace('<', '<') - data = data.replace('>', '>') - data = data.replace('>', '>') - data = data.replace('&', '&') - data = data.replace('&', '&') - data = data.replace('"', '"') - data = data.replace('"', '"') - data = data.replace(''', ''') - data = data.replace(''', ''') - if self.contentparams.has_key('type') and not self.contentparams.get('type', 'xml').endswith('xml'): - data = data.replace('<', '<') - data = data.replace('>', '>') - data = data.replace('&', '&') - data = data.replace('"', '"') - data = data.replace(''', "'") - return data - -class _RelativeURIResolver(_BaseHTMLProcessor): - relative_uris = [('a', 'href'), - ('applet', 'codebase'), - ('area', 'href'), - ('blockquote', 'cite'), - ('body', 'background'), - ('del', 'cite'), - ('form', 'action'), - ('frame', 'longdesc'), - ('frame', 'src'), - ('iframe', 'longdesc'), - ('iframe', 'src'), - ('head', 'profile'), - ('img', 'longdesc'), - ('img', 'src'), - ('img', 'usemap'), - ('input', 'src'), - ('input', 'usemap'), - ('ins', 'cite'), - ('link', 'href'), - ('object', 'classid'), - ('object', 'codebase'), - ('object', 'data'), - ('object', 'usemap'), - ('q', 'cite'), - ('script', 'src')] - - def __init__(self, baseuri, encoding): - _BaseHTMLProcessor.__init__(self, encoding) - self.baseuri = baseuri - - def resolveURI(self, uri): - return _urljoin(self.baseuri, uri) - - def unknown_starttag(self, tag, attrs): - attrs = self.normalize_attrs(attrs) - attrs = [(key, ((tag, key) in self.relative_uris) and self.resolveURI(value) or value) for key, value in attrs] - _BaseHTMLProcessor.unknown_starttag(self, tag, attrs) - -def _resolveRelativeURIs(htmlSource, baseURI, encoding): - if _debug: sys.stderr.write('entering _resolveRelativeURIs\n') - p = _RelativeURIResolver(baseURI, encoding) - p.feed(htmlSource) - return p.output() - -class _HTMLSanitizer(_BaseHTMLProcessor): - acceptable_elements = ['a', 'abbr', 'acronym', 'address', 'area', 'b', 'big', - 'blockquote', 'br', 'button', 'caption', 'center', 'cite', 'code', 'col', - 'colgroup', 'dd', 'del', 'dfn', 'dir', 'div', 'dl', 'dt', 'em', 'fieldset', - 'font', 'form', 'h1', 'h2', 'h3', 'h4', 'h5', 'h6', 'hr', 'i', 'img', 'input', - 'ins', 'kbd', 'label', 'legend', 'li', 'map', 'menu', 'ol', 'optgroup', - 'option', 'p', 'pre', 'q', 's', 'samp', 'select', 'small', 'span', 'strike', - 'strong', 'sub', 'sup', 'table', 'tbody', 'td', 'textarea', 'tfoot', 'th', - 'thead', 'tr', 'tt', 'u', 'ul', 'var'] - - acceptable_attributes = ['abbr', 'accept', 'accept-charset', 'accesskey', - 'action', 'align', 'alt', 'axis', 'border', 'cellpadding', 'cellspacing', - 'char', 'charoff', 'charset', 'checked', 'cite', 'class', 'clear', 'cols', - 'colspan', 'color', 'compact', 'coords', 'datetime', 'dir', 'disabled', - 'enctype', 'for', 'frame', 'headers', 'height', 'href', 'hreflang', 'hspace', - 'id', 'ismap', 'label', 'lang', 'longdesc', 'maxlength', 'media', 'method', - 'multiple', 'name', 'nohref', 'noshade', 'nowrap', 'prompt', 'readonly', - 'rel', 'rev', 'rows', 'rowspan', 'rules', 'scope', 'selected', 'shape', 'size', - 'span', 'src', 'start', 'summary', 'tabindex', 'target', 'title', 'type', - 'usemap', 'valign', 'value', 'vspace', 'width'] - - unacceptable_elements_with_end_tag = ['script', 'applet'] - - def reset(self): - _BaseHTMLProcessor.reset(self) - self.unacceptablestack = 0 - - def unknown_starttag(self, tag, attrs): - if not tag in self.acceptable_elements: - if tag in self.unacceptable_elements_with_end_tag: - self.unacceptablestack += 1 - return - attrs = self.normalize_attrs(attrs) - attrs = [(key, value) for key, value in attrs if key in self.acceptable_attributes] - _BaseHTMLProcessor.unknown_starttag(self, tag, attrs) - - def unknown_endtag(self, tag): - if not tag in self.acceptable_elements: - if tag in self.unacceptable_elements_with_end_tag: - self.unacceptablestack -= 1 - return - _BaseHTMLProcessor.unknown_endtag(self, tag) - - def handle_pi(self, text): - pass - - def handle_decl(self, text): - pass - - def handle_data(self, text): - if not self.unacceptablestack: - _BaseHTMLProcessor.handle_data(self, text) - -def _sanitizeHTML(htmlSource, encoding): - p = _HTMLSanitizer(encoding) - p.feed(htmlSource) - data = p.output() - if TIDY_MARKUP: - # loop through list of preferred Tidy interfaces looking for one that's installed, - # then set up a common _tidy function to wrap the interface-specific API. - _tidy = None - for tidy_interface in PREFERRED_TIDY_INTERFACES: - try: - if tidy_interface == "uTidy": - from tidy import parseString as _utidy - def _tidy(data, **kwargs): - return str(_utidy(data, **kwargs)) - break - elif tidy_interface == "mxTidy": - from mx.Tidy import Tidy as _mxtidy - def _tidy(data, **kwargs): - nerrors, nwarnings, data, errordata = _mxtidy.tidy(data, **kwargs) - return data - break - except: - pass - if _tidy: - utf8 = type(data) == type(u'') - if utf8: - data = data.encode('utf-8') - data = _tidy(data, output_xhtml=1, numeric_entities=1, wrap=0, char_encoding="utf8") - if utf8: - data = unicode(data, 'utf-8') - if data.count(''): - data = data.split('>', 1)[1] - if data.count('= '2.3.3' - assert base64 != None - user, passw = base64.decodestring(req.headers['Authorization'].split(' ')[1]).split(':') - realm = re.findall('realm="([^"]*)"', headers['WWW-Authenticate'])[0] - self.add_password(realm, host, user, passw) - retry = self.http_error_auth_reqed('www-authenticate', host, req, headers) - self.reset_retry_count() - return retry - except: - return self.http_error_default(req, fp, code, msg, headers) - -def _open_resource(url_file_stream_or_string, etag, modified, agent, referrer, handlers): - """URL, filename, or string --> stream - - This function lets you define parsers that take any input source - (URL, pathname to local or network file, or actual data as a string) - and deal with it in a uniform manner. Returned object is guaranteed - to have all the basic stdio read methods (read, readline, readlines). - Just .close() the object when you're done with it. - - If the etag argument is supplied, it will be used as the value of an - If-None-Match request header. - - If the modified argument is supplied, it must be a tuple of 9 integers - as returned by gmtime() in the standard Python time module. This MUST - be in GMT (Greenwich Mean Time). The formatted date/time will be used - as the value of an If-Modified-Since request header. - - If the agent argument is supplied, it will be used as the value of a - User-Agent request header. - - If the referrer argument is supplied, it will be used as the value of a - Referer[sic] request header. - - If handlers is supplied, it is a list of handlers used to build a - urllib2 opener. - """ - - if hasattr(url_file_stream_or_string, 'read'): - return url_file_stream_or_string - - if url_file_stream_or_string == '-': - return sys.stdin - - if urlparse.urlparse(url_file_stream_or_string)[0] in ('http', 'https', 'ftp'): - if not agent: - agent = USER_AGENT - # test for inline user:password for basic auth - auth = None - if base64: - urltype, rest = urllib.splittype(url_file_stream_or_string) - realhost, rest = urllib.splithost(rest) - if realhost: - user_passwd, realhost = urllib.splituser(realhost) - if user_passwd: - url_file_stream_or_string = '%s://%s%s' % (urltype, realhost, rest) - auth = base64.encodestring(user_passwd).strip() - # try to open with urllib2 (to use optional headers) - request = urllib2.Request(url_file_stream_or_string) - request.add_header('User-Agent', agent) - if etag: - request.add_header('If-None-Match', etag) - if modified: - # format into an RFC 1123-compliant timestamp. We can't use - # time.strftime() since the %a and %b directives can be affected - # by the current locale, but RFC 2616 states that dates must be - # in English. - short_weekdays = ['Mon', 'Tue', 'Wed', 'Thu', 'Fri', 'Sat', 'Sun'] - months = ['Jan', 'Feb', 'Mar', 'Apr', 'May', 'Jun', 'Jul', 'Aug', 'Sep', 'Oct', 'Nov', 'Dec'] - request.add_header('If-Modified-Since', '%s, %02d %s %04d %02d:%02d:%02d GMT' % (short_weekdays[modified[6]], modified[2], months[modified[1] - 1], modified[0], modified[3], modified[4], modified[5])) - if referrer: - request.add_header('Referer', referrer) - if gzip and zlib: - request.add_header('Accept-encoding', 'gzip, deflate') - elif gzip: - request.add_header('Accept-encoding', 'gzip') - elif zlib: - request.add_header('Accept-encoding', 'deflate') - else: - request.add_header('Accept-encoding', '') - if auth: - request.add_header('Authorization', 'Basic %s' % auth) - if ACCEPT_HEADER: - request.add_header('Accept', ACCEPT_HEADER) - request.add_header('A-IM', 'feed') # RFC 3229 support - opener = apply(urllib2.build_opener, tuple([_FeedURLHandler()] + handlers)) - opener.addheaders = [] # RMK - must clear so we only send our custom User-Agent - try: - return opener.open(request) - finally: - opener.close() # JohnD - - # try to open with native open function (if url_file_stream_or_string is a filename) - try: - return open(url_file_stream_or_string) - except: - pass - - # treat url_file_stream_or_string as string - return _StringIO(str(url_file_stream_or_string)) - -_date_handlers = [] -def registerDateHandler(func): - '''Register a date handler function (takes string, returns 9-tuple date in GMT)''' - _date_handlers.insert(0, func) - -# ISO-8601 date parsing routines written by Fazal Majid. -# The ISO 8601 standard is very convoluted and irregular - a full ISO 8601 -# parser is beyond the scope of feedparser and would be a worthwhile addition -# to the Python library. -# A single regular expression cannot parse ISO 8601 date formats into groups -# as the standard is highly irregular (for instance is 030104 2003-01-04 or -# 0301-04-01), so we use templates instead. -# Please note the order in templates is significant because we need a -# greedy match. -_iso8601_tmpl = ['YYYY-?MM-?DD', 'YYYY-MM', 'YYYY-?OOO', - 'YY-?MM-?DD', 'YY-?OOO', 'YYYY', - '-YY-?MM', '-OOO', '-YY', - '--MM-?DD', '--MM', - '---DD', - 'CC', ''] -_iso8601_re = [ - tmpl.replace( - 'YYYY', r'(?P\d{4})').replace( - 'YY', r'(?P\d\d)').replace( - 'MM', r'(?P[01]\d)').replace( - 'DD', r'(?P[0123]\d)').replace( - 'OOO', r'(?P[0123]\d\d)').replace( - 'CC', r'(?P\d\d$)') - + r'(T?(?P\d{2}):(?P\d{2})' - + r'(:(?P\d{2}))?' - + r'(?P[+-](?P\d{2})(:(?P\d{2}))?|Z)?)?' - for tmpl in _iso8601_tmpl] -del tmpl -_iso8601_matches = [re.compile(regex).match for regex in _iso8601_re] -del regex -def _parse_date_iso8601(dateString): - '''Parse a variety of ISO-8601-compatible formats like 20040105''' - m = None - for _iso8601_match in _iso8601_matches: - m = _iso8601_match(dateString) - if m: break - if not m: return - if m.span() == (0, 0): return - params = m.groupdict() - ordinal = params.get('ordinal', 0) - if ordinal: - ordinal = int(ordinal) - else: - ordinal = 0 - year = params.get('year', '--') - if not year or year == '--': - year = time.gmtime()[0] - elif len(year) == 2: - # ISO 8601 assumes current century, i.e. 93 -> 2093, NOT 1993 - year = 100 * int(time.gmtime()[0] / 100) + int(year) - else: - year = int(year) - month = params.get('month', '-') - if not month or month == '-': - # ordinals are NOT normalized by mktime, we simulate them - # by setting month=1, day=ordinal - if ordinal: - month = 1 - else: - month = time.gmtime()[1] - month = int(month) - day = params.get('day', 0) - if not day: - # see above - if ordinal: - day = ordinal - elif params.get('century', 0) or \ - params.get('year', 0) or params.get('month', 0): - day = 1 - else: - day = time.gmtime()[2] - else: - day = int(day) - # special case of the century - is the first year of the 21st century - # 2000 or 2001 ? The debate goes on... - if 'century' in params.keys(): - year = (int(params['century']) - 1) * 100 + 1 - # in ISO 8601 most fields are optional - for field in ['hour', 'minute', 'second', 'tzhour', 'tzmin']: - if not params.get(field, None): - params[field] = 0 - hour = int(params.get('hour', 0)) - minute = int(params.get('minute', 0)) - second = int(params.get('second', 0)) - # weekday is normalized by mktime(), we can ignore it - weekday = 0 - # daylight savings is complex, but not needed for feedparser's purposes - # as time zones, if specified, include mention of whether it is active - # (e.g. PST vs. PDT, CET). Using -1 is implementation-dependent and - # and most implementations have DST bugs - daylight_savings_flag = 0 - tm = [year, month, day, hour, minute, second, weekday, - ordinal, daylight_savings_flag] - # ISO 8601 time zone adjustments - tz = params.get('tz') - if tz and tz != 'Z': - if tz[0] == '-': - tm[3] += int(params.get('tzhour', 0)) - tm[4] += int(params.get('tzmin', 0)) - elif tz[0] == '+': - tm[3] -= int(params.get('tzhour', 0)) - tm[4] -= int(params.get('tzmin', 0)) - else: - return None - # Python's time.mktime() is a wrapper around the ANSI C mktime(3c) - # which is guaranteed to normalize d/m/y/h/m/s. - # Many implementations have bugs, but we'll pretend they don't. - return time.localtime(time.mktime(tm)) -registerDateHandler(_parse_date_iso8601) - -# 8-bit date handling routines written by ytrewq1. -_korean_year = u'\ub144' # b3e2 in euc-kr -_korean_month = u'\uc6d4' # bff9 in euc-kr -_korean_day = u'\uc77c' # c0cf in euc-kr -_korean_am = u'\uc624\uc804' # bfc0 c0fc in euc-kr -_korean_pm = u'\uc624\ud6c4' # bfc0 c8c4 in euc-kr - -_korean_onblog_date_re = \ - re.compile('(\d{4})%s\s+(\d{2})%s\s+(\d{2})%s\s+(\d{2}):(\d{2}):(\d{2})' % \ - (_korean_year, _korean_month, _korean_day)) -_korean_nate_date_re = \ - re.compile(u'(\d{4})-(\d{2})-(\d{2})\s+(%s|%s)\s+(\d{,2}):(\d{,2}):(\d{,2})' % \ - (_korean_am, _korean_pm)) -def _parse_date_onblog(dateString): - '''Parse a string according to the OnBlog 8-bit date format''' - m = _korean_onblog_date_re.match(dateString) - if not m: return - w3dtfdate = '%(year)s-%(month)s-%(day)sT%(hour)s:%(minute)s:%(second)s%(zonediff)s' % \ - {'year': m.group(1), 'month': m.group(2), 'day': m.group(3),\ - 'hour': m.group(4), 'minute': m.group(5), 'second': m.group(6),\ - 'zonediff': '+09:00'} - if _debug: sys.stderr.write('OnBlog date parsed as: %s\n' % w3dtfdate) - return _parse_date_w3dtf(w3dtfdate) -registerDateHandler(_parse_date_onblog) - -def _parse_date_nate(dateString): - '''Parse a string according to the Nate 8-bit date format''' - m = _korean_nate_date_re.match(dateString) - if not m: return - hour = int(m.group(5)) - ampm = m.group(4) - if (ampm == _korean_pm): - hour += 12 - hour = str(hour) - if len(hour) == 1: - hour = '0' + hour - w3dtfdate = '%(year)s-%(month)s-%(day)sT%(hour)s:%(minute)s:%(second)s%(zonediff)s' % \ - {'year': m.group(1), 'month': m.group(2), 'day': m.group(3),\ - 'hour': hour, 'minute': m.group(6), 'second': m.group(7),\ - 'zonediff': '+09:00'} - if _debug: sys.stderr.write('Nate date parsed as: %s\n' % w3dtfdate) - return _parse_date_w3dtf(w3dtfdate) -registerDateHandler(_parse_date_nate) - -_mssql_date_re = \ - re.compile('(\d{4})-(\d{2})-(\d{2})\s+(\d{2}):(\d{2}):(\d{2})(\.\d+)?') -def _parse_date_mssql(dateString): - '''Parse a string according to the MS SQL date format''' - m = _mssql_date_re.match(dateString) - if not m: return - w3dtfdate = '%(year)s-%(month)s-%(day)sT%(hour)s:%(minute)s:%(second)s%(zonediff)s' % \ - {'year': m.group(1), 'month': m.group(2), 'day': m.group(3),\ - 'hour': m.group(4), 'minute': m.group(5), 'second': m.group(6),\ - 'zonediff': '+09:00'} - if _debug: sys.stderr.write('MS SQL date parsed as: %s\n' % w3dtfdate) - return _parse_date_w3dtf(w3dtfdate) -registerDateHandler(_parse_date_mssql) - -# Unicode strings for Greek date strings -_greek_months = \ - { \ - u'\u0399\u03b1\u03bd': u'Jan', # c9e1ed in iso-8859-7 - u'\u03a6\u03b5\u03b2': u'Feb', # d6e5e2 in iso-8859-7 - u'\u039c\u03ac\u03ce': u'Mar', # ccdcfe in iso-8859-7 - u'\u039c\u03b1\u03ce': u'Mar', # cce1fe in iso-8859-7 - u'\u0391\u03c0\u03c1': u'Apr', # c1f0f1 in iso-8859-7 - u'\u039c\u03ac\u03b9': u'May', # ccdce9 in iso-8859-7 - u'\u039c\u03b1\u03ca': u'May', # cce1fa in iso-8859-7 - u'\u039c\u03b1\u03b9': u'May', # cce1e9 in iso-8859-7 - u'\u0399\u03bf\u03cd\u03bd': u'Jun', # c9effded in iso-8859-7 - u'\u0399\u03bf\u03bd': u'Jun', # c9efed in iso-8859-7 - u'\u0399\u03bf\u03cd\u03bb': u'Jul', # c9effdeb in iso-8859-7 - u'\u0399\u03bf\u03bb': u'Jul', # c9f9eb in iso-8859-7 - u'\u0391\u03cd\u03b3': u'Aug', # c1fde3 in iso-8859-7 - u'\u0391\u03c5\u03b3': u'Aug', # c1f5e3 in iso-8859-7 - u'\u03a3\u03b5\u03c0': u'Sep', # d3e5f0 in iso-8859-7 - u'\u039f\u03ba\u03c4': u'Oct', # cfeaf4 in iso-8859-7 - u'\u039d\u03bf\u03ad': u'Nov', # cdefdd in iso-8859-7 - u'\u039d\u03bf\u03b5': u'Nov', # cdefe5 in iso-8859-7 - u'\u0394\u03b5\u03ba': u'Dec', # c4e5ea in iso-8859-7 - } - -_greek_wdays = \ - { \ - u'\u039a\u03c5\u03c1': u'Sun', # caf5f1 in iso-8859-7 - u'\u0394\u03b5\u03c5': u'Mon', # c4e5f5 in iso-8859-7 - u'\u03a4\u03c1\u03b9': u'Tue', # d4f1e9 in iso-8859-7 - u'\u03a4\u03b5\u03c4': u'Wed', # d4e5f4 in iso-8859-7 - u'\u03a0\u03b5\u03bc': u'Thu', # d0e5ec in iso-8859-7 - u'\u03a0\u03b1\u03c1': u'Fri', # d0e1f1 in iso-8859-7 - u'\u03a3\u03b1\u03b2': u'Sat', # d3e1e2 in iso-8859-7 - } - -_greek_date_format_re = \ - re.compile(u'([^,]+),\s+(\d{2})\s+([^\s]+)\s+(\d{4})\s+(\d{2}):(\d{2}):(\d{2})\s+([^\s]+)') - -def _parse_date_greek(dateString): - '''Parse a string according to a Greek 8-bit date format.''' - m = _greek_date_format_re.match(dateString) - if not m: return - try: - wday = _greek_wdays[m.group(1)] - month = _greek_months[m.group(3)] - except: - return - rfc822date = '%(wday)s, %(day)s %(month)s %(year)s %(hour)s:%(minute)s:%(second)s %(zonediff)s' % \ - {'wday': wday, 'day': m.group(2), 'month': month, 'year': m.group(4),\ - 'hour': m.group(5), 'minute': m.group(6), 'second': m.group(7),\ - 'zonediff': m.group(8)} - if _debug: sys.stderr.write('Greek date parsed as: %s\n' % rfc822date) - return _parse_date_rfc822(rfc822date) -registerDateHandler(_parse_date_greek) - -# Unicode strings for Hungarian date strings -_hungarian_months = \ - { \ - u'janu\u00e1r': u'01', # e1 in iso-8859-2 - u'febru\u00e1ri': u'02', # e1 in iso-8859-2 - u'm\u00e1rcius': u'03', # e1 in iso-8859-2 - u'\u00e1prilis': u'04', # e1 in iso-8859-2 - u'm\u00e1ujus': u'05', # e1 in iso-8859-2 - u'j\u00fanius': u'06', # fa in iso-8859-2 - u'j\u00falius': u'07', # fa in iso-8859-2 - u'augusztus': u'08', - u'szeptember': u'09', - u'okt\u00f3ber': u'10', # f3 in iso-8859-2 - u'november': u'11', - u'december': u'12', - } - -_hungarian_date_format_re = \ - re.compile(u'(\d{4})-([^-]+)-(\d{,2})T(\d{,2}):(\d{2})((\+|-)(\d{,2}:\d{2}))') - -def _parse_date_hungarian(dateString): - '''Parse a string according to a Hungarian 8-bit date format.''' - m = _hungarian_date_format_re.match(dateString) - if not m: return - try: - month = _hungarian_months[m.group(2)] - day = m.group(3) - if len(day) == 1: - day = '0' + day - hour = m.group(4) - if len(hour) == 1: - hour = '0' + hour - except: - return - w3dtfdate = '%(year)s-%(month)s-%(day)sT%(hour)s:%(minute)s%(zonediff)s' % \ - {'year': m.group(1), 'month': month, 'day': day,\ - 'hour': hour, 'minute': m.group(5),\ - 'zonediff': m.group(6)} - if _debug: sys.stderr.write('Hungarian date parsed as: %s\n' % w3dtfdate) - return _parse_date_w3dtf(w3dtfdate) -registerDateHandler(_parse_date_hungarian) - -# W3DTF-style date parsing adapted from PyXML xml.utils.iso8601, written by -# Drake and licensed under the Python license. Removed all range checking -# for month, day, hour, minute, and second, since mktime will normalize -# these later -def _parse_date_w3dtf(dateString): - def __extract_date(m): - year = int(m.group('year')) - if year < 100: - year = 100 * int(time.gmtime()[0] / 100) + int(year) - if year < 1000: - return 0, 0, 0 - julian = m.group('julian') - if julian: - julian = int(julian) - month = julian / 30 + 1 - day = julian % 30 + 1 - jday = None - while jday != julian: - t = time.mktime((year, month, day, 0, 0, 0, 0, 0, 0)) - jday = time.gmtime(t)[-2] - diff = abs(jday - julian) - if jday > julian: - if diff < day: - day = day - diff - else: - month = month - 1 - day = 31 - elif jday < julian: - if day + diff < 28: - day = day + diff - else: - month = month + 1 - return year, month, day - month = m.group('month') - day = 1 - if month is None: - month = 1 - else: - month = int(month) - day = m.group('day') - if day: - day = int(day) - else: - day = 1 - return year, month, day - - def __extract_time(m): - if not m: - return 0, 0, 0 - hours = m.group('hours') - if not hours: - return 0, 0, 0 - hours = int(hours) - minutes = int(m.group('minutes')) - seconds = m.group('seconds') - if seconds: - seconds = int(seconds) - else: - seconds = 0 - return hours, minutes, seconds - - def __extract_tzd(m): - '''Return the Time Zone Designator as an offset in seconds from UTC.''' - if not m: - return 0 - tzd = m.group('tzd') - if not tzd: - return 0 - if tzd == 'Z': - return 0 - hours = int(m.group('tzdhours')) - minutes = m.group('tzdminutes') - if minutes: - minutes = int(minutes) - else: - minutes = 0 - offset = (hours*60 + minutes) * 60 - if tzd[0] == '+': - return -offset - return offset - - __date_re = ('(?P\d\d\d\d)' - '(?:(?P-|)' - '(?:(?P\d\d\d)' - '|(?P\d\d)(?:(?P=dsep)(?P\d\d))?))?') - __tzd_re = '(?P[-+](?P\d\d)(?::?(?P\d\d))|Z)' - __tzd_rx = re.compile(__tzd_re) - __time_re = ('(?P\d\d)(?P:|)(?P\d\d)' - '(?:(?P=tsep)(?P\d\d(?:[.,]\d+)?))?' - + __tzd_re) - __datetime_re = '%s(?:T%s)?' % (__date_re, __time_re) - __datetime_rx = re.compile(__datetime_re) - m = __datetime_rx.match(dateString) - if (m is None) or (m.group() != dateString): return - gmt = __extract_date(m) + __extract_time(m) + (0, 0, 0) - if gmt[0] == 0: return - return time.gmtime(time.mktime(gmt) + __extract_tzd(m) - time.timezone) -registerDateHandler(_parse_date_w3dtf) - -def _parse_date_rfc822(dateString): - '''Parse an RFC822, RFC1123, RFC2822, or asctime-style date''' - data = dateString.split() - if data[0][-1] in (',', '.') or data[0].lower() in rfc822._daynames: - del data[0] - if len(data) == 4: - s = data[3] - i = s.find('+') - if i > 0: - data[3:] = [s[:i], s[i+1:]] - else: - data.append('') - dateString = " ".join(data) - if len(data) < 5: - dateString += ' 00:00:00 GMT' - tm = rfc822.parsedate_tz(dateString) - if tm: - return time.gmtime(rfc822.mktime_tz(tm)) -# rfc822.py defines several time zones, but we define some extra ones. -# 'ET' is equivalent to 'EST', etc. -_additional_timezones = {'AT': -400, 'ET': -500, 'CT': -600, 'MT': -700, 'PT': -800} -rfc822._timezones.update(_additional_timezones) -registerDateHandler(_parse_date_rfc822) - -def _parse_date(dateString): - '''Parses a variety of date formats into a 9-tuple in GMT''' - for handler in _date_handlers: - try: - date9tuple = handler(dateString) - if not date9tuple: continue - if len(date9tuple) != 9: - if _debug: sys.stderr.write('date handler function must return 9-tuple\n') - raise ValueError - map(int, date9tuple) - return date9tuple - except Exception, e: - if _debug: sys.stderr.write('%s raised %s\n' % (handler.__name__, repr(e))) - pass - return None - -def _getCharacterEncoding(http_headers, xml_data): - '''Get the character encoding of the XML document - - http_headers is a dictionary - xml_data is a raw string (not Unicode) - - This is so much trickier than it sounds, it's not even funny. - According to RFC 3023 ('XML Media Types'), if the HTTP Content-Type - is application/xml, application/*+xml, - application/xml-external-parsed-entity, or application/xml-dtd, - the encoding given in the charset parameter of the HTTP Content-Type - takes precedence over the encoding given in the XML prefix within the - document, and defaults to 'utf-8' if neither are specified. But, if - the HTTP Content-Type is text/xml, text/*+xml, or - text/xml-external-parsed-entity, the encoding given in the XML prefix - within the document is ALWAYS IGNORED and only the encoding given in - the charset parameter of the HTTP Content-Type header should be - respected, and it defaults to 'us-ascii' if not specified. - - Furthermore, discussion on the atom-syntax mailing list with the - author of RFC 3023 leads me to the conclusion that any document - served with a Content-Type of text/* and no charset parameter - must be treated as us-ascii. (We now do this.) And also that it - must always be flagged as non-well-formed. (We now do this too.) - - If Content-Type is unspecified (input was local file or non-HTTP source) - or unrecognized (server just got it totally wrong), then go by the - encoding given in the XML prefix of the document and default to - 'iso-8859-1' as per the HTTP specification (RFC 2616). - - Then, assuming we didn't find a character encoding in the HTTP headers - (and the HTTP Content-type allowed us to look in the body), we need - to sniff the first few bytes of the XML data and try to determine - whether the encoding is ASCII-compatible. Section F of the XML - specification shows the way here: - http://www.w3.org/TR/REC-xml/#sec-guessing-no-ext-info - - If the sniffed encoding is not ASCII-compatible, we need to make it - ASCII compatible so that we can sniff further into the XML declaration - to find the encoding attribute, which will tell us the true encoding. - - Of course, none of this guarantees that we will be able to parse the - feed in the declared character encoding (assuming it was declared - correctly, which many are not). CJKCodecs and iconv_codec help a lot; - you should definitely install them if you can. - http://cjkpython.i18n.org/ - ''' - - def _parseHTTPContentType(content_type): - '''takes HTTP Content-Type header and returns (content type, charset) - - If no charset is specified, returns (content type, '') - If no content type is specified, returns ('', '') - Both return parameters are guaranteed to be lowercase strings - ''' - content_type = content_type or '' - content_type, params = cgi.parse_header(content_type) - return content_type, params.get('charset', '').replace("'", '') - - sniffed_xml_encoding = '' - xml_encoding = '' - true_encoding = '' - http_content_type, http_encoding = _parseHTTPContentType(http_headers.get('content-type')) - # Must sniff for non-ASCII-compatible character encodings before - # searching for XML declaration. This heuristic is defined in - # section F of the XML specification: - # http://www.w3.org/TR/REC-xml/#sec-guessing-no-ext-info - try: - if xml_data[:4] == '\x4c\x6f\xa7\x94': - # EBCDIC - xml_data = _ebcdic_to_ascii(xml_data) - elif xml_data[:4] == '\x00\x3c\x00\x3f': - # UTF-16BE - sniffed_xml_encoding = 'utf-16be' - xml_data = unicode(xml_data, 'utf-16be').encode('utf-8') - elif (len(xml_data) >= 4) and (xml_data[:2] == '\xfe\xff') and (xml_data[2:4] != '\x00\x00'): - # UTF-16BE with BOM - sniffed_xml_encoding = 'utf-16be' - xml_data = unicode(xml_data[2:], 'utf-16be').encode('utf-8') - elif xml_data[:4] == '\x3c\x00\x3f\x00': - # UTF-16LE - sniffed_xml_encoding = 'utf-16le' - xml_data = unicode(xml_data, 'utf-16le').encode('utf-8') - elif (len(xml_data) >= 4) and (xml_data[:2] == '\xff\xfe') and (xml_data[2:4] != '\x00\x00'): - # UTF-16LE with BOM - sniffed_xml_encoding = 'utf-16le' - xml_data = unicode(xml_data[2:], 'utf-16le').encode('utf-8') - elif xml_data[:4] == '\x00\x00\x00\x3c': - # UTF-32BE - sniffed_xml_encoding = 'utf-32be' - xml_data = unicode(xml_data, 'utf-32be').encode('utf-8') - elif xml_data[:4] == '\x3c\x00\x00\x00': - # UTF-32LE - sniffed_xml_encoding = 'utf-32le' - xml_data = unicode(xml_data, 'utf-32le').encode('utf-8') - elif xml_data[:4] == '\x00\x00\xfe\xff': - # UTF-32BE with BOM - sniffed_xml_encoding = 'utf-32be' - xml_data = unicode(xml_data[4:], 'utf-32be').encode('utf-8') - elif xml_data[:4] == '\xff\xfe\x00\x00': - # UTF-32LE with BOM - sniffed_xml_encoding = 'utf-32le' - xml_data = unicode(xml_data[4:], 'utf-32le').encode('utf-8') - elif xml_data[:3] == '\xef\xbb\xbf': - # UTF-8 with BOM - sniffed_xml_encoding = 'utf-8' - xml_data = unicode(xml_data[3:], 'utf-8').encode('utf-8') - else: - # ASCII-compatible - pass - xml_encoding_match = re.compile('^<\?.*encoding=[\'"](.*?)[\'"].*\?>').match(xml_data) - except: - xml_encoding_match = None - if xml_encoding_match: - xml_encoding = xml_encoding_match.groups()[0].lower() - if sniffed_xml_encoding and (xml_encoding in ('iso-10646-ucs-2', 'ucs-2', 'csunicode', 'iso-10646-ucs-4', 'ucs-4', 'csucs4', 'utf-16', 'utf-32', 'utf_16', 'utf_32', 'utf16', 'u16')): - xml_encoding = sniffed_xml_encoding - acceptable_content_type = 0 - application_content_types = ('application/xml', 'application/xml-dtd', 'application/xml-external-parsed-entity') - text_content_types = ('text/xml', 'text/xml-external-parsed-entity') - if (http_content_type in application_content_types) or \ - (http_content_type.startswith('application/') and http_content_type.endswith('+xml')): - acceptable_content_type = 1 - true_encoding = http_encoding or xml_encoding or 'utf-8' - elif (http_content_type in text_content_types) or \ - (http_content_type.startswith('text/')) and http_content_type.endswith('+xml'): - acceptable_content_type = 1 - true_encoding = http_encoding or 'us-ascii' - elif http_content_type.startswith('text/'): - true_encoding = http_encoding or 'us-ascii' - elif http_headers and (not http_headers.has_key('content-type')): - true_encoding = xml_encoding or 'iso-8859-1' - else: - true_encoding = xml_encoding or 'utf-8' - return true_encoding, http_encoding, xml_encoding, sniffed_xml_encoding, acceptable_content_type - -def _toUTF8(data, encoding): - '''Changes an XML data stream on the fly to specify a new encoding - - data is a raw sequence of bytes (not Unicode) that is presumed to be in %encoding already - encoding is a string recognized by encodings.aliases - ''' - if _debug: sys.stderr.write('entering _toUTF8, trying encoding %s\n' % encoding) - # strip Byte Order Mark (if present) - if (len(data) >= 4) and (data[:2] == '\xfe\xff') and (data[2:4] != '\x00\x00'): - if _debug: - sys.stderr.write('stripping BOM\n') - if encoding != 'utf-16be': - sys.stderr.write('trying utf-16be instead\n') - encoding = 'utf-16be' - data = data[2:] - elif (len(data) >= 4) and (data[:2] == '\xff\xfe') and (data[2:4] != '\x00\x00'): - if _debug: - sys.stderr.write('stripping BOM\n') - if encoding != 'utf-16le': - sys.stderr.write('trying utf-16le instead\n') - encoding = 'utf-16le' - data = data[2:] - elif data[:3] == '\xef\xbb\xbf': - if _debug: - sys.stderr.write('stripping BOM\n') - if encoding != 'utf-8': - sys.stderr.write('trying utf-8 instead\n') - encoding = 'utf-8' - data = data[3:] - elif data[:4] == '\x00\x00\xfe\xff': - if _debug: - sys.stderr.write('stripping BOM\n') - if encoding != 'utf-32be': - sys.stderr.write('trying utf-32be instead\n') - encoding = 'utf-32be' - data = data[4:] - elif data[:4] == '\xff\xfe\x00\x00': - if _debug: - sys.stderr.write('stripping BOM\n') - if encoding != 'utf-32le': - sys.stderr.write('trying utf-32le instead\n') - encoding = 'utf-32le' - data = data[4:] - newdata = unicode(data, encoding) - if _debug: sys.stderr.write('successfully converted %s data to unicode\n' % encoding) - declmatch = re.compile('^<\?xml[^>]*?>') - newdecl = '''''' - if declmatch.search(newdata): - newdata = declmatch.sub(newdecl, newdata) - else: - newdata = newdecl + u'\n' + newdata - return newdata.encode('utf-8') - -def _stripDoctype(data): - '''Strips DOCTYPE from XML document, returns (rss_version, stripped_data) - - rss_version may be 'rss091n' or None - stripped_data is the same XML document, minus the DOCTYPE - ''' - entity_pattern = re.compile(r']*?)>', re.MULTILINE) - data = entity_pattern.sub('', data) - doctype_pattern = re.compile(r']*?)>', re.MULTILINE) - doctype_results = doctype_pattern.findall(data) - doctype = doctype_results and doctype_results[0] or '' - if doctype.lower().count('netscape'): - version = 'rss091n' - else: - version = None - data = doctype_pattern.sub('', data) - return version, data - -def parse(url_file_stream_or_string, etag=None, modified=None, agent=None, referrer=None, handlers=[]): - '''Parse a feed from a URL, file, stream, or string''' - result = FeedParserDict() - result['feed'] = FeedParserDict() - result['entries'] = [] - if _XML_AVAILABLE: - result['bozo'] = 0 - if type(handlers) == types.InstanceType: - handlers = [handlers] - try: - f = _open_resource(url_file_stream_or_string, etag, modified, agent, referrer, handlers) - data = f.read() - except Exception, e: - result['bozo'] = 1 - result['bozo_exception'] = e - data = '' - f = None - - # if feed is gzip-compressed, decompress it - if f and data and hasattr(f, 'headers'): - if gzip and f.headers.get('content-encoding', '') == 'gzip': - try: - data = gzip.GzipFile(fileobj=_StringIO(data)).read() - except Exception, e: - # Some feeds claim to be gzipped but they're not, so - # we get garbage. Ideally, we should re-request the - # feed without the 'Accept-encoding: gzip' header, - # but we don't. - result['bozo'] = 1 - result['bozo_exception'] = e - data = '' - elif zlib and f.headers.get('content-encoding', '') == 'deflate': - try: - data = zlib.decompress(data, -zlib.MAX_WBITS) - except Exception, e: - result['bozo'] = 1 - result['bozo_exception'] = e - data = '' - - # save HTTP headers - if hasattr(f, 'info'): - info = f.info() - result['etag'] = info.getheader('ETag') - last_modified = info.getheader('Last-Modified') - if last_modified: - result['modified'] = _parse_date(last_modified) - if hasattr(f, 'url'): - result['href'] = f.url - result['status'] = 200 - if hasattr(f, 'status'): - result['status'] = f.status - if hasattr(f, 'headers'): - result['headers'] = f.headers.dict - if hasattr(f, 'close'): - f.close() - - # there are four encodings to keep track of: - # - http_encoding is the encoding declared in the Content-Type HTTP header - # - xml_encoding is the encoding declared in the ; changed -# project name -#2.5 - 7/25/2003 - MAP - changed to Python license (all contributors agree); -# removed unnecessary urllib code -- urllib2 should always be available anyway; -# return actual url, status, and full HTTP headers (as result['url'], -# result['status'], and result['headers']) if parsing a remote feed over HTTP -- -# this should pass all the HTTP tests at ; -# added the latest namespace-of-the-week for RSS 2.0 -#2.5.1 - 7/26/2003 - RMK - clear opener.addheaders so we only send our custom -# User-Agent (otherwise urllib2 sends two, which confuses some servers) -#2.5.2 - 7/28/2003 - MAP - entity-decode inline xml properly; added support for -# inline and as used in some RSS 2.0 feeds -#2.5.3 - 8/6/2003 - TvdV - patch to track whether we're inside an image or -# textInput, and also to return the character encoding (if specified) -#2.6 - 1/1/2004 - MAP - dc:author support (MarekK); fixed bug tracking -# nested divs within content (JohnD); fixed missing sys import (JohanS); -# fixed regular expression to capture XML character encoding (Andrei); -# added support for Atom 0.3-style links; fixed bug with textInput tracking; -# added support for cloud (MartijnP); added support for multiple -# category/dc:subject (MartijnP); normalize content model: 'description' gets -# description (which can come from description, summary, or full content if no -# description), 'content' gets dict of base/language/type/value (which can come -# from content:encoded, xhtml:body, content, or fullitem); -# fixed bug matching arbitrary Userland namespaces; added xml:base and xml:lang -# tracking; fixed bug tracking unknown tags; fixed bug tracking content when -# element is not in default namespace (like Pocketsoap feed); -# resolve relative URLs in link, guid, docs, url, comments, wfw:comment, -# wfw:commentRSS; resolve relative URLs within embedded HTML markup in -# description, xhtml:body, content, content:encoded, title, subtitle, -# summary, info, tagline, and copyright; added support for pingback and -# trackback namespaces -#2.7 - 1/5/2004 - MAP - really added support for trackback and pingback -# namespaces, as opposed to 2.6 when I said I did but didn't really; -# sanitize HTML markup within some elements; added mxTidy support (if -# installed) to tidy HTML markup within some elements; fixed indentation -# bug in _parse_date (FazalM); use socket.setdefaulttimeout if available -# (FazalM); universal date parsing and normalization (FazalM): 'created', modified', -# 'issued' are parsed into 9-tuple date format and stored in 'created_parsed', -# 'modified_parsed', and 'issued_parsed'; 'date' is duplicated in 'modified' -# and vice-versa; 'date_parsed' is duplicated in 'modified_parsed' and vice-versa -#2.7.1 - 1/9/2004 - MAP - fixed bug handling " and '. fixed memory -# leak not closing url opener (JohnD); added dc:publisher support (MarekK); -# added admin:errorReportsTo support (MarekK); Python 2.1 dict support (MarekK) -#2.7.4 - 1/14/2004 - MAP - added workaround for improperly formed
tags in -# encoded HTML (skadz); fixed unicode handling in normalize_attrs (ChrisL); -# fixed relative URI processing for guid (skadz); added ICBM support; added -# base64 support -#2.7.5 - 1/15/2004 - MAP - added workaround for malformed DOCTYPE (seen on many -# blogspot.com sites); added _debug variable -#2.7.6 - 1/16/2004 - MAP - fixed bug with StringIO importing -#3.0b3 - 1/23/2004 - MAP - parse entire feed with real XML parser (if available); -# added several new supported namespaces; fixed bug tracking naked markup in -# description; added support for enclosure; added support for source; re-added -# support for cloud which got dropped somehow; added support for expirationDate -#3.0b4 - 1/26/2004 - MAP - fixed xml:lang inheritance; fixed multiple bugs tracking -# xml:base URI, one for documents that don't define one explicitly and one for -# documents that define an outer and an inner xml:base that goes out of scope -# before the end of the document -#3.0b5 - 1/26/2004 - MAP - fixed bug parsing multiple links at feed level -#3.0b6 - 1/27/2004 - MAP - added feed type and version detection, result['version'] -# will be one of SUPPORTED_VERSIONS.keys() or empty string if unrecognized; -# added support for creativeCommons:license and cc:license; added support for -# full Atom content model in title, tagline, info, copyright, summary; fixed bug -# with gzip encoding (not always telling server we support it when we do) -#3.0b7 - 1/28/2004 - MAP - support Atom-style author element in author_detail -# (dictionary of 'name', 'url', 'email'); map author to author_detail if author -# contains name + email address -#3.0b8 - 1/28/2004 - MAP - added support for contributor -#3.0b9 - 1/29/2004 - MAP - fixed check for presence of dict function; added -# support for summary -#3.0b10 - 1/31/2004 - MAP - incorporated ISO-8601 date parsing routines from -# xml.util.iso8601 -#3.0b11 - 2/2/2004 - MAP - added 'rights' to list of elements that can contain -# dangerous markup; fiddled with decodeEntities (not right); liberalized -# date parsing even further -#3.0b12 - 2/6/2004 - MAP - fiddled with decodeEntities (still not right); -# added support to Atom 0.2 subtitle; added support for Atom content model -# in copyright; better sanitizing of dangerous HTML elements with end tags -# (script, frameset) -#3.0b13 - 2/8/2004 - MAP - better handling of empty HTML tags (br, hr, img, -# etc.) in embedded markup, in either HTML or XHTML form (
,
,
) -#3.0b14 - 2/8/2004 - MAP - fixed CDATA handling in non-wellformed feeds under -# Python 2.1 -#3.0b15 - 2/11/2004 - MAP - fixed bug resolving relative links in wfw:commentRSS; -# fixed bug capturing author and contributor URL; fixed bug resolving relative -# links in author and contributor URL; fixed bug resolvin relative links in -# generator URL; added support for recognizing RSS 1.0; passed Simon Fell's -# namespace tests, and included them permanently in the test suite with his -# permission; fixed namespace handling under Python 2.1 -#3.0b16 - 2/12/2004 - MAP - fixed support for RSS 0.90 (broken in b15) -#3.0b17 - 2/13/2004 - MAP - determine character encoding as per RFC 3023 -#3.0b18 - 2/17/2004 - MAP - always map description to summary_detail (Andrei); -# use libxml2 (if available) -#3.0b19 - 3/15/2004 - MAP - fixed bug exploding author information when author -# name was in parentheses; removed ultra-problematic mxTidy support; patch to -# workaround crash in PyXML/expat when encountering invalid entities -# (MarkMoraes); support for textinput/textInput -#3.0b20 - 4/7/2004 - MAP - added CDF support -#3.0b21 - 4/14/2004 - MAP - added Hot RSS support -#3.0b22 - 4/19/2004 - MAP - changed 'channel' to 'feed', 'item' to 'entries' in -# results dict; changed results dict to allow getting values with results.key -# as well as results[key]; work around embedded illformed HTML with half -# a DOCTYPE; work around malformed Content-Type header; if character encoding -# is wrong, try several common ones before falling back to regexes (if this -# works, bozo_exception is set to CharacterEncodingOverride); fixed character -# encoding issues in BaseHTMLProcessor by tracking encoding and converting -# from Unicode to raw strings before feeding data to sgmllib.SGMLParser; -# convert each value in results to Unicode (if possible), even if using -# regex-based parsing -#3.0b23 - 4/21/2004 - MAP - fixed UnicodeDecodeError for feeds that contain -# high-bit characters in attributes in embedded HTML in description (thanks -# Thijs van de Vossen); moved guid, date, and date_parsed to mapped keys in -# FeedParserDict; tweaked FeedParserDict.has_key to return True if asking -# about a mapped key -#3.0fc1 - 4/23/2004 - MAP - made results.entries[0].links[0] and -# results.entries[0].enclosures[0] into FeedParserDict; fixed typo that could -# cause the same encoding to be tried twice (even if it failed the first time); -# fixed DOCTYPE stripping when DOCTYPE contained entity declarations; -# better textinput and image tracking in illformed RSS 1.0 feeds -#3.0fc2 - 5/10/2004 - MAP - added and passed Sam's amp tests; added and passed -# my blink tag tests -#3.0fc3 - 6/18/2004 - MAP - fixed bug in _changeEncodingDeclaration that -# failed to parse utf-16 encoded feeds; made source into a FeedParserDict; -# duplicate admin:generatorAgent/@rdf:resource in generator_detail.url; -# added support for image; refactored parse() fallback logic to try other -# encodings if SAX parsing fails (previously it would only try other encodings -# if re-encoding failed); remove unichr madness in normalize_attrs now that -# we're properly tracking encoding in and out of BaseHTMLProcessor; set -# feed.language from root-level xml:lang; set entry.id from rdf:about; -# send Accept header -#3.0 - 6/21/2004 - MAP - don't try iso-8859-1 (can't distinguish between -# iso-8859-1 and windows-1252 anyway, and most incorrectly marked feeds are -# windows-1252); fixed regression that could cause the same encoding to be -# tried twice (even if it failed the first time) -#3.0.1 - 6/22/2004 - MAP - default to us-ascii for all text/* content types; -# recover from malformed content-type header parameter with no equals sign -# ('text/xml; charset:iso-8859-1') -#3.1 - 6/28/2004 - MAP - added and passed tests for converting HTML entities -# to Unicode equivalents in illformed feeds (aaronsw); added and -# passed tests for converting character entities to Unicode equivalents -# in illformed feeds (aaronsw); test for valid parsers when setting -# XML_AVAILABLE; make version and encoding available when server returns -# a 304; add handlers parameter to pass arbitrary urllib2 handlers (like -# digest auth or proxy support); add code to parse username/password -# out of url and send as basic authentication; expose downloading-related -# exceptions in bozo_exception (aaronsw); added __contains__ method to -# FeedParserDict (aaronsw); added publisher_detail (aaronsw) -#3.2 - 7/3/2004 - MAP - use cjkcodecs and iconv_codec if available; always -# convert feed to UTF-8 before passing to XML parser; completely revamped -# logic for determining character encoding and attempting XML parsing -# (much faster); increased default timeout to 20 seconds; test for presence -# of Location header on redirects; added tests for many alternate character -# encodings; support various EBCDIC encodings; support UTF-16BE and -# UTF16-LE with or without a BOM; support UTF-8 with a BOM; support -# UTF-32BE and UTF-32LE with or without a BOM; fixed crashing bug if no -# XML parsers are available; added support for 'Content-encoding: deflate'; -# send blank 'Accept-encoding: ' header if neither gzip nor zlib modules -# are available -#3.3 - 7/15/2004 - MAP - optimize EBCDIC to ASCII conversion; fix obscure -# problem tracking xml:base and xml:lang if element declares it, child -# doesn't, first grandchild redeclares it, and second grandchild doesn't; -# refactored date parsing; defined public registerDateHandler so callers -# can add support for additional date formats at runtime; added support -# for OnBlog, Nate, MSSQL, Greek, and Hungarian dates (ytrewq1); added -# zopeCompatibilityHack() which turns FeedParserDict into a regular -# dictionary, required for Zope compatibility, and also makes command- -# line debugging easier because pprint module formats real dictionaries -# better than dictionary-like objects; added NonXMLContentType exception, -# which is stored in bozo_exception when a feed is served with a non-XML -# media type such as 'text/plain'; respect Content-Language as default -# language if not xml:lang is present; cloud dict is now FeedParserDict; -# generator dict is now FeedParserDict; better tracking of xml:lang, -# including support for xml:lang='' to unset the current language; -# recognize RSS 1.0 feeds even when RSS 1.0 namespace is not the default -# namespace; don't overwrite final status on redirects (scenarios: -# redirecting to a URL that returns 304, redirecting to a URL that -# redirects to another URL with a different type of redirect); add -# support for HTTP 303 redirects -#4.0 - MAP - support for relative URIs in xml:base attribute; fixed -# encoding issue with mxTidy (phopkins); preliminary support for RFC 3229; -# support for Atom 1.0; support for iTunes extensions; new 'tags' for -# categories/keywords/etc. as array of dict -# {'term': term, 'scheme': scheme, 'label': label} to match Atom 1.0 -# terminology; parse RFC 822-style dates with no time; lots of other -# bug fixes -#4.1 - MAP - removed socket timeout; added support for chardet library diff --git a/subscriber/index.yaml b/subscriber/index.yaml deleted file mode 100644 index 045e8e4..0000000 --- a/subscriber/index.yaml +++ /dev/null @@ -1,17 +0,0 @@ -indexes: - -# AUTOGENERATED - -# This index.yaml is automatically updated whenever the dev_appserver -# detects that a new type of query is run. If you want to manage the -# index.yaml file manually, remove the above marker line (the line -# saying "# AUTOGENERATED"). If you want to manage some indexes -# manually, move them above the marker line. The index.yaml file is -# automatically uploaded to the admin console when you next deploy -# your application using appcfg.py. - -# Unused in query history -- copied from input. -- kind: SomeUpdate - properties: - - name: updated - direction: desc diff --git a/subscriber/main.py b/subscriber/main.py deleted file mode 100755 index 1e16157..0000000 --- a/subscriber/main.py +++ /dev/null @@ -1,150 +0,0 @@ -#!/usr/bin/env python -# -# Copyright 2008 Google Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -"""Simple subscriber that aggregates all feeds together.""" - -import hashlib -import logging -import random -import wsgiref.handlers -from google.appengine.ext import db -from google.appengine.ext import webapp -from google.appengine.ext.webapp import template - -import feedparser -import simplejson - - -class SomeUpdate(db.Model): - """Some topic update. - - Key name will be a hash of the feed source and item ID. - """ - title = db.TextProperty() - content = db.TextProperty() - updated = db.DateTimeProperty(auto_now_add=True) - link = db.TextProperty() - - -class InputHandler(webapp.RequestHandler): - """Handles feed input and subscription""" - - def get(self): - # Just subscribe to everything. - self.response.out.write(self.request.get('hub.challenge')) - self.response.set_status(200) - - def post(self): - body = self.request.body.decode('utf-8') - logging.info('Post body is %d characters', len(body)) - - data = feedparser.parse(self.request.body) - if data.bozo: - logging.error('Bozo feed data. %s: %r', - data.bozo_exception.__class__.__name__, - data.bozo_exception) - if (hasattr(data.bozo_exception, 'getLineNumber') and - hasattr(data.bozo_exception, 'getMessage')): - line = data.bozo_exception.getLineNumber() - logging.error('Line %d: %s', line, data.bozo_exception.getMessage()) - segment = self.request.body.split('\n')[line-1] - logging.info('Body segment with error: %r', segment.decode('utf-8')) - return self.response.set_status(500) - - update_list = [] - logging.info('Found %d entries', len(data.entries)) - for entry in data.entries: - if hasattr(entry, 'content'): - # This is Atom. - entry_id = entry.id - content = entry.content[0].value - link = entry.get('link', '') - title = entry.get('title', '') - else: - content = entry.get('description', '') - title = entry.get('title', '') - link = entry.get('link', '') - entry_id = (entry.get('id', '') or link or title or content) - - logging.info('Found entry with title = "%s", id = "%s", ' - 'link = "%s", content = "%s"', - title, entry_id, link, content) - update_list.append(SomeUpdate( - key_name='key_' + hashlib.sha1(link + '\n' + entry_id).hexdigest(), - title=title, - content=content, - link=link)) - db.put(update_list) - self.response.set_status(200) - self.response.out.write("Aight. Saved."); - - -class DebugHandler(webapp.RequestHandler): - """Debug handler for simulating events.""" - def get(self): - self.response.out.write(""" - - -
-
Simulate feed:
- -
-
- - -""") - - -class ViewHandler(webapp.RequestHandler): - """Shows the items to anyone as HTML.""" - - def get(self): - context = dict(entries=SomeUpdate.gql('ORDER BY updated DESC').fetch(50)) - self.response.out.write(template.render('subscriber.html', context)) - - -class ItemsHandler(webapp.RequestHandler): - """Gets the items.""" - - def get(self): - encoder = simplejson.JSONEncoder() - stuff = [] - for update in SomeUpdate.gql('ORDER BY updated DESC').fetch(10): - stuff.append({'time': str(update.updated), - 'title': update.title, - 'content': update.content, - 'source': update.link}) - self.response.out.write(encoder.encode(stuff)) - - -application = webapp.WSGIApplication( - [ - (r'/items', ItemsHandler), - (r'/debug', DebugHandler), - # Wildcard below so we can test multiple subscribers in a single app. - (r'/subscriber.*', InputHandler), - (r'/', ViewHandler), - ], - debug=True) - - -def main(): - wsgiref.handlers.CGIHandler().run(application) - - -if __name__ == '__main__': - main() diff --git a/subscriber/simplejson/__init__.py b/subscriber/simplejson/__init__.py deleted file mode 100644 index 4683a28..0000000 --- a/subscriber/simplejson/__init__.py +++ /dev/null @@ -1,378 +0,0 @@ -r""" -A simple, fast, extensible JSON encoder and decoder - -JSON (JavaScript Object Notation) is a subset of -JavaScript syntax (ECMA-262 3rd edition) used as a lightweight data -interchange format. - -simplejson exposes an API familiar to uses of the standard library -marshal and pickle modules. - -Encoding basic Python object hierarchies:: - - >>> import simplejson - >>> simplejson.dumps(['foo', {'bar': ('baz', None, 1.0, 2)}]) - '["foo", {"bar": ["baz", null, 1.0, 2]}]' - >>> print simplejson.dumps("\"foo\bar") - "\"foo\bar" - >>> print simplejson.dumps(u'\u1234') - "\u1234" - >>> print simplejson.dumps('\\') - "\\" - >>> print simplejson.dumps({"c": 0, "b": 0, "a": 0}, sort_keys=True) - {"a": 0, "b": 0, "c": 0} - >>> from StringIO import StringIO - >>> io = StringIO() - >>> simplejson.dump(['streaming API'], io) - >>> io.getvalue() - '["streaming API"]' - -Compact encoding:: - - >>> import simplejson - >>> compact = simplejson.dumps([1,2,3,{'4': 5, '6': 7}], separators=(',',':')) - >>> # Can't assume dict ordering - >>> compact in ('[1,2,3,{"4":5,"6":7}]', '[1,2,3,{"6":7,"4":5}]') - True - -Pretty printing:: - - >>> import simplejson - >>> print simplejson.dumps({'4': 5, '6': 7}, sort_keys=True, indent=4) - { - "4": 5, - "6": 7 - } - -Decoding JSON:: - - >>> import simplejson - >>> simplejson.loads('["foo", {"bar":["baz", null, 1.0, 2]}]') == ["foo", {"bar":["baz", None, 1.0, 2]}] - True - >>> simplejson.loads('"\\"foo\\bar"') == '"foo\x08ar' - True - >>> from StringIO import StringIO - >>> io = StringIO('["streaming API"]') - >>> simplejson.load(io) == ["streaming API"] - True - -Specializing JSON object decoding:: - - >>> import simplejson - >>> def as_complex(dct): - ... if '__complex__' in dct: - ... return complex(dct['real'], dct['imag']) - ... return dct - ... - >>> simplejson.loads('{"__complex__": true, "real": 1, "imag": 2}', - ... object_hook=as_complex) - (1+2j) - >>> import decimal - >>> simplejson.loads('1.1', parse_float=decimal.Decimal) - Decimal("1.1") - -Extending JSONEncoder:: - - >>> import simplejson - >>> class ComplexEncoder(simplejson.JSONEncoder): - ... def default(self, obj): - ... if isinstance(obj, complex): - ... return [obj.real, obj.imag] - ... return simplejson.JSONEncoder.default(self, obj) - ... - >>> dumps(2 + 1j, cls=ComplexEncoder) - '[2.0, 1.0]' - >>> ComplexEncoder().encode(2 + 1j) - '[2.0, 1.0]' - >>> ''.join(ComplexEncoder().iterencode(2 + 1j)) - '[2.0, 1.0]' - - -Using simplejson from the shell to validate and -pretty-print:: - - $ echo '{"json":"obj"}' | python -msimplejson.tool - { - "json": "obj" - } - $ echo '{ 1.2:3.4}' | python -msimplejson.tool - Expecting property name: line 1 column 2 (char 2) - -Note that the JSON produced by this module's default settings -is a subset of YAML, so it may be used as a serializer for that as well. -""" -__version__ = '2.0.1' -__all__ = [ - 'dump', 'dumps', 'load', 'loads', - 'JSONDecoder', 'JSONEncoder', -] - -if __name__ == '__main__': - import warnings - warnings.warn('python -msimplejson is deprecated, use python -msiplejson.tool', DeprecationWarning) - from simplejson.decoder import JSONDecoder - from simplejson.encoder import JSONEncoder -else: - from decoder import JSONDecoder - from encoder import JSONEncoder - -_default_encoder = JSONEncoder( - skipkeys=False, - ensure_ascii=True, - check_circular=True, - allow_nan=True, - indent=None, - separators=None, - encoding='utf-8', - default=None, -) - -def dump(obj, fp, skipkeys=False, ensure_ascii=True, check_circular=True, - allow_nan=True, cls=None, indent=None, separators=None, - encoding='utf-8', default=None, **kw): - """ - Serialize ``obj`` as a JSON formatted stream to ``fp`` (a - ``.write()``-supporting file-like object). - - If ``skipkeys`` is ``True`` then ``dict`` keys that are not basic types - (``str``, ``unicode``, ``int``, ``long``, ``float``, ``bool``, ``None``) - will be skipped instead of raising a ``TypeError``. - - If ``ensure_ascii`` is ``False``, then the some chunks written to ``fp`` - may be ``unicode`` instances, subject to normal Python ``str`` to - ``unicode`` coercion rules. Unless ``fp.write()`` explicitly - understands ``unicode`` (as in ``codecs.getwriter()``) this is likely - to cause an error. - - If ``check_circular`` is ``False``, then the circular reference check - for container types will be skipped and a circular reference will - result in an ``OverflowError`` (or worse). - - If ``allow_nan`` is ``False``, then it will be a ``ValueError`` to - serialize out of range ``float`` values (``nan``, ``inf``, ``-inf``) - in strict compliance of the JSON specification, instead of using the - JavaScript equivalents (``NaN``, ``Infinity``, ``-Infinity``). - - If ``indent`` is a non-negative integer, then JSON array elements and object - members will be pretty-printed with that indent level. An indent level - of 0 will only insert newlines. ``None`` is the most compact representation. - - If ``separators`` is an ``(item_separator, dict_separator)`` tuple - then it will be used instead of the default ``(', ', ': ')`` separators. - ``(',', ':')`` is the most compact JSON representation. - - ``encoding`` is the character encoding for str instances, default is UTF-8. - - ``default(obj)`` is a function that should return a serializable version - of obj or raise TypeError. The default simply raises TypeError. - - To use a custom ``JSONEncoder`` subclass (e.g. one that overrides the - ``.default()`` method to serialize additional types), specify it with - the ``cls`` kwarg. - """ - # cached encoder - if (skipkeys is False and ensure_ascii is True and - check_circular is True and allow_nan is True and - cls is None and indent is None and separators is None and - encoding == 'utf-8' and default is None and not kw): - iterable = _default_encoder.iterencode(obj) - else: - if cls is None: - cls = JSONEncoder - iterable = cls(skipkeys=skipkeys, ensure_ascii=ensure_ascii, - check_circular=check_circular, allow_nan=allow_nan, indent=indent, - separators=separators, encoding=encoding, - default=default, **kw).iterencode(obj) - # could accelerate with writelines in some versions of Python, at - # a debuggability cost - for chunk in iterable: - fp.write(chunk) - - -def dumps(obj, skipkeys=False, ensure_ascii=True, check_circular=True, - allow_nan=True, cls=None, indent=None, separators=None, - encoding='utf-8', default=None, **kw): - """ - Serialize ``obj`` to a JSON formatted ``str``. - - If ``skipkeys`` is ``True`` then ``dict`` keys that are not basic types - (``str``, ``unicode``, ``int``, ``long``, ``float``, ``bool``, ``None``) - will be skipped instead of raising a ``TypeError``. - - If ``ensure_ascii`` is ``False``, then the return value will be a - ``unicode`` instance subject to normal Python ``str`` to ``unicode`` - coercion rules instead of being escaped to an ASCII ``str``. - - If ``check_circular`` is ``False``, then the circular reference check - for container types will be skipped and a circular reference will - result in an ``OverflowError`` (or worse). - - If ``allow_nan`` is ``False``, then it will be a ``ValueError`` to - serialize out of range ``float`` values (``nan``, ``inf``, ``-inf``) in - strict compliance of the JSON specification, instead of using the - JavaScript equivalents (``NaN``, ``Infinity``, ``-Infinity``). - - If ``indent`` is a non-negative integer, then JSON array elements and - object members will be pretty-printed with that indent level. An indent - level of 0 will only insert newlines. ``None`` is the most compact - representation. - - If ``separators`` is an ``(item_separator, dict_separator)`` tuple - then it will be used instead of the default ``(', ', ': ')`` separators. - ``(',', ':')`` is the most compact JSON representation. - - ``encoding`` is the character encoding for str instances, default is UTF-8. - - ``default(obj)`` is a function that should return a serializable version - of obj or raise TypeError. The default simply raises TypeError. - - To use a custom ``JSONEncoder`` subclass (e.g. one that overrides the - ``.default()`` method to serialize additional types), specify it with - the ``cls`` kwarg. - """ - # cached encoder - if (skipkeys is False and ensure_ascii is True and - check_circular is True and allow_nan is True and - cls is None and indent is None and separators is None and - encoding == 'utf-8' and default is None and not kw): - return _default_encoder.encode(obj) - if cls is None: - cls = JSONEncoder - return cls( - skipkeys=skipkeys, ensure_ascii=ensure_ascii, - check_circular=check_circular, allow_nan=allow_nan, indent=indent, - separators=separators, encoding=encoding, default=default, - **kw).encode(obj) - - -_default_decoder = JSONDecoder(encoding=None, object_hook=None) - - -def load(fp, encoding=None, cls=None, object_hook=None, parse_float=None, - parse_int=None, parse_constant=None, **kw): - """ - Deserialize ``fp`` (a ``.read()``-supporting file-like object containing - a JSON document) to a Python object. - - If the contents of ``fp`` is encoded with an ASCII based encoding other - than utf-8 (e.g. latin-1), then an appropriate ``encoding`` name must - be specified. Encodings that are not ASCII based (such as UCS-2) are - not allowed, and should be wrapped with - ``codecs.getreader(fp)(encoding)``, or simply decoded to a ``unicode`` - object and passed to ``loads()`` - - ``object_hook`` is an optional function that will be called with the - result of any object literal decode (a ``dict``). The return value of - ``object_hook`` will be used instead of the ``dict``. This feature - can be used to implement custom decoders (e.g. JSON-RPC class hinting). - - To use a custom ``JSONDecoder`` subclass, specify it with the ``cls`` - kwarg. - """ - return loads(fp.read(), - encoding=encoding, cls=cls, object_hook=object_hook, - parse_float=parse_float, parse_int=parse_int, - parse_constant=parse_constant, **kw) - - -def loads(s, encoding=None, cls=None, object_hook=None, parse_float=None, - parse_int=None, parse_constant=None, **kw): - """ - Deserialize ``s`` (a ``str`` or ``unicode`` instance containing a JSON - document) to a Python object. - - If ``s`` is a ``str`` instance and is encoded with an ASCII based encoding - other than utf-8 (e.g. latin-1) then an appropriate ``encoding`` name - must be specified. Encodings that are not ASCII based (such as UCS-2) - are not allowed and should be decoded to ``unicode`` first. - - ``object_hook`` is an optional function that will be called with the - result of any object literal decode (a ``dict``). The return value of - ``object_hook`` will be used instead of the ``dict``. This feature - can be used to implement custom decoders (e.g. JSON-RPC class hinting). - - ``parse_float``, if specified, will be called with the string - of every JSON float to be decoded. By default this is equivalent to - float(num_str). This can be used to use another datatype or parser - for JSON floats (e.g. decimal.Decimal). - - ``parse_int``, if specified, will be called with the string - of every JSON int to be decoded. By default this is equivalent to - int(num_str). This can be used to use another datatype or parser - for JSON integers (e.g. float). - - ``parse_constant``, if specified, will be called with one of the - following strings: -Infinity, Infinity, NaN, null, true, false. - This can be used to raise an exception if invalid JSON numbers - are encountered. - - To use a custom ``JSONDecoder`` subclass, specify it with the ``cls`` - kwarg. - """ - if (cls is None and encoding is None and object_hook is None and - parse_int is None and parse_float is None and - parse_constant is None and not kw): - return _default_decoder.decode(s) - if cls is None: - cls = JSONDecoder - if object_hook is not None: - kw['object_hook'] = object_hook - if parse_float is not None: - kw['parse_float'] = parse_float - if parse_int is not None: - kw['parse_int'] = parse_int - if parse_constant is not None: - kw['parse_constant'] = parse_constant - return cls(encoding=encoding, **kw).decode(s) - - -# -# Compatibility cruft from other libraries -# - - -def decode(s): - """ - demjson, python-cjson API compatibility hook. Use loads(s) instead. - """ - import warnings - warnings.warn("simplejson.loads(s) should be used instead of decode(s)", - DeprecationWarning) - return loads(s) - - -def encode(obj): - """ - demjson, python-cjson compatibility hook. Use dumps(s) instead. - """ - import warnings - warnings.warn("simplejson.dumps(s) should be used instead of encode(s)", - DeprecationWarning) - return dumps(obj) - - -def read(s): - """ - jsonlib, JsonUtils, python-json, json-py API compatibility hook. - Use loads(s) instead. - """ - import warnings - warnings.warn("simplejson.loads(s) should be used instead of read(s)", - DeprecationWarning) - return loads(s) - - -def write(obj): - """ - jsonlib, JsonUtils, python-json, json-py API compatibility hook. - Use dumps(s) instead. - """ - import warnings - warnings.warn("simplejson.dumps(s) should be used instead of write(s)", - DeprecationWarning) - return dumps(obj) - - -if __name__ == '__main__': - import simplejson.tool - simplejson.tool.main() diff --git a/subscriber/simplejson/_speedups.c b/subscriber/simplejson/_speedups.c deleted file mode 100644 index 620c916..0000000 --- a/subscriber/simplejson/_speedups.c +++ /dev/null @@ -1,2094 +0,0 @@ -#include "Python.h" -#include "structmember.h" -#if PY_VERSION_HEX < 0x02060000 && !defined(Py_TYPE) -#define Py_TYPE(ob) (((PyObject*)(ob))->ob_type) -#endif -#if PY_VERSION_HEX < 0x02050000 && !defined(PY_SSIZE_T_MIN) -typedef int Py_ssize_t; -#define PY_SSIZE_T_MAX INT_MAX -#define PY_SSIZE_T_MIN INT_MIN -#define PyInt_FromSsize_t PyInt_FromLong -#define PyInt_AsSsize_t PyInt_AsLong -#endif - -#ifdef __GNUC__ -#define UNUSED __attribute__((__unused__)) -#else -#define UNUSED -#endif - -#define DEFAULT_ENCODING "utf-8" - -#define PyScanner_Check(op) PyObject_TypeCheck(op, &PyScannerType) -#define PyScanner_CheckExact(op) (Py_TYPE(op) == &PyScannerType) -#define PyEncoder_Check(op) PyObject_TypeCheck(op, &PyEncoderType) -#define PyEncoder_CheckExact(op) (Py_TYPE(op) == &PyEncoderType) - -static PyTypeObject PyScannerType; -static PyTypeObject PyEncoderType; - -typedef struct _PyScannerObject { - PyObject_HEAD - PyObject *encoding; - PyObject *strict; - PyObject *object_hook; - PyObject *parse_float; - PyObject *parse_int; - PyObject *parse_constant; -} PyScannerObject; - -static PyMemberDef scanner_members[] = { - {"encoding", T_OBJECT, offsetof(PyScannerObject, encoding), READONLY, "encoding"}, - {"strict", T_OBJECT, offsetof(PyScannerObject, strict), READONLY, "strict"}, - {"object_hook", T_OBJECT, offsetof(PyScannerObject, object_hook), READONLY, "object_hook"}, - {"parse_float", T_OBJECT, offsetof(PyScannerObject, parse_float), READONLY, "parse_float"}, - {"parse_int", T_OBJECT, offsetof(PyScannerObject, parse_int), READONLY, "parse_int"}, - {"parse_constant", T_OBJECT, offsetof(PyScannerObject, parse_constant), READONLY, "parse_constant"}, - {NULL} -}; - -typedef struct _PyEncoderObject { - PyObject_HEAD - PyObject *markers; - PyObject *defaultfn; - PyObject *encoder; - PyObject *indent; - PyObject *key_separator; - PyObject *item_separator; - PyObject *sort_keys; - PyObject *skipkeys; - int fast_encode; - int allow_nan; -} PyEncoderObject; - -static PyMemberDef encoder_members[] = { - {"markers", T_OBJECT, offsetof(PyEncoderObject, markers), READONLY, "markers"}, - {"default", T_OBJECT, offsetof(PyEncoderObject, defaultfn), READONLY, "default"}, - {"encoder", T_OBJECT, offsetof(PyEncoderObject, encoder), READONLY, "encoder"}, - {"indent", T_OBJECT, offsetof(PyEncoderObject, indent), READONLY, "indent"}, - {"key_separator", T_OBJECT, offsetof(PyEncoderObject, key_separator), READONLY, "key_separator"}, - {"item_separator", T_OBJECT, offsetof(PyEncoderObject, item_separator), READONLY, "item_separator"}, - {"sort_keys", T_OBJECT, offsetof(PyEncoderObject, sort_keys), READONLY, "sort_keys"}, - {"skipkeys", T_OBJECT, offsetof(PyEncoderObject, skipkeys), READONLY, "skipkeys"}, - {NULL} -}; - -static Py_ssize_t -ascii_escape_char(Py_UNICODE c, char *output, Py_ssize_t chars); -static PyObject * -ascii_escape_unicode(PyObject *pystr); -static PyObject * -ascii_escape_str(PyObject *pystr); -static PyObject * -py_encode_basestring_ascii(PyObject* self UNUSED, PyObject *pystr); -void init_speedups(void); -static PyObject * -scan_once_str(PyScannerObject *s, PyObject *pystr, Py_ssize_t idx); -static PyObject * -scan_once_unicode(PyScannerObject *s, PyObject *pystr, Py_ssize_t idx); -static PyObject * -_build_rval_index_tuple(PyObject *rval, Py_ssize_t idx); -static int -scanner_init(PyObject *self, PyObject *args, PyObject *kwds); -static void -scanner_dealloc(PyObject *self); -static int -encoder_init(PyObject *self, PyObject *args, PyObject *kwds); -static void -encoder_dealloc(PyObject *self); -static int -encoder_listencode_list(PyEncoderObject *s, PyObject *rval, PyObject *seq, Py_ssize_t indent_level); -static int -encoder_listencode_obj(PyEncoderObject *s, PyObject *rval, PyObject *obj, Py_ssize_t indent_level); -static int -encoder_listencode_dict(PyEncoderObject *s, PyObject *rval, PyObject *dct, Py_ssize_t indent_level); -static PyObject * -_encoded_const(PyObject *const); -static void -raise_errmsg(char *msg, PyObject *s, Py_ssize_t end); -static PyObject * -encoder_encode_string(PyEncoderObject *s, PyObject *obj); -static int -_convertPyInt_AsSsize_t(PyObject *o, Py_ssize_t *size_ptr); -static PyObject * -_convertPyInt_FromSsize_t(Py_ssize_t *size_ptr); -static PyObject * -encoder_encode_float(PyEncoderObject *s, PyObject *obj); - -#define S_CHAR(c) (c >= ' ' && c <= '~' && c != '\\' && c != '"') -#define IS_WHITESPACE(c) (((c) == ' ') || ((c) == '\t') || ((c) == '\n') || ((c) == '\r')) - -#define MIN_EXPANSION 6 -#ifdef Py_UNICODE_WIDE -#define MAX_EXPANSION (2 * MIN_EXPANSION) -#else -#define MAX_EXPANSION MIN_EXPANSION -#endif - -static int -_convertPyInt_AsSsize_t(PyObject *o, Py_ssize_t *size_ptr) -{ - *size_ptr = PyInt_AsSsize_t(o); - if (*size_ptr == -1 && PyErr_Occurred()); - return 1; - return 0; -} - -static PyObject * -_convertPyInt_FromSsize_t(Py_ssize_t *size_ptr) -{ - return PyInt_FromSsize_t(*size_ptr); -} - -static Py_ssize_t -ascii_escape_char(Py_UNICODE c, char *output, Py_ssize_t chars) -{ - output[chars++] = '\\'; - switch (c) { - case '\\': output[chars++] = (char)c; break; - case '"': output[chars++] = (char)c; break; - case '\b': output[chars++] = 'b'; break; - case '\f': output[chars++] = 'f'; break; - case '\n': output[chars++] = 'n'; break; - case '\r': output[chars++] = 'r'; break; - case '\t': output[chars++] = 't'; break; - default: -#ifdef Py_UNICODE_WIDE - if (c >= 0x10000) { - /* UTF-16 surrogate pair */ - Py_UNICODE v = c - 0x10000; - c = 0xd800 | ((v >> 10) & 0x3ff); - output[chars++] = 'u'; - output[chars++] = "0123456789abcdef"[(c >> 12) & 0xf]; - output[chars++] = "0123456789abcdef"[(c >> 8) & 0xf]; - output[chars++] = "0123456789abcdef"[(c >> 4) & 0xf]; - output[chars++] = "0123456789abcdef"[(c ) & 0xf]; - c = 0xdc00 | (v & 0x3ff); - output[chars++] = '\\'; - } -#endif - output[chars++] = 'u'; - output[chars++] = "0123456789abcdef"[(c >> 12) & 0xf]; - output[chars++] = "0123456789abcdef"[(c >> 8) & 0xf]; - output[chars++] = "0123456789abcdef"[(c >> 4) & 0xf]; - output[chars++] = "0123456789abcdef"[(c ) & 0xf]; - } - return chars; -} - -static PyObject * -ascii_escape_unicode(PyObject *pystr) -{ - Py_ssize_t i; - Py_ssize_t input_chars; - Py_ssize_t output_size; - Py_ssize_t chars; - PyObject *rval; - char *output; - Py_UNICODE *input_unicode; - - input_chars = PyUnicode_GET_SIZE(pystr); - input_unicode = PyUnicode_AS_UNICODE(pystr); - - /* One char input can be up to 6 chars output, estimate 4 of these */ - output_size = 2 + (MIN_EXPANSION * 4) + input_chars; - rval = PyString_FromStringAndSize(NULL, output_size); - if (rval == NULL) { - return NULL; - } - output = PyString_AS_STRING(rval); - chars = 0; - output[chars++] = '"'; - for (i = 0; i < input_chars; i++) { - Py_UNICODE c = input_unicode[i]; - if (S_CHAR(c)) { - output[chars++] = (char)c; - } - else { - chars = ascii_escape_char(c, output, chars); - } - if (output_size - chars < (1 + MAX_EXPANSION)) { - /* There's more than four, so let's resize by a lot */ - output_size *= 2; - /* This is an upper bound */ - if (output_size > 2 + (input_chars * MAX_EXPANSION)) { - output_size = 2 + (input_chars * MAX_EXPANSION); - } - if (_PyString_Resize(&rval, output_size) == -1) { - return NULL; - } - output = PyString_AS_STRING(rval); - } - } - output[chars++] = '"'; - if (_PyString_Resize(&rval, chars) == -1) { - return NULL; - } - return rval; -} - -static PyObject * -ascii_escape_str(PyObject *pystr) -{ - Py_ssize_t i; - Py_ssize_t input_chars; - Py_ssize_t output_size; - Py_ssize_t chars; - PyObject *rval; - char *output; - char *input_str; - - input_chars = PyString_GET_SIZE(pystr); - input_str = PyString_AS_STRING(pystr); - - /* Fast path for a string that's already ASCII */ - for (i = 0; i < input_chars; i++) { - Py_UNICODE c = (Py_UNICODE)(unsigned char)input_str[i]; - if (!S_CHAR(c)) { - /* If we have to escape something, scan the string for unicode */ - Py_ssize_t j; - for (j = i; j < input_chars; j++) { - c = (Py_UNICODE)(unsigned char)input_str[j]; - if (c > 0x7f) { - /* We hit a non-ASCII character, bail to unicode mode */ - PyObject *uni; - uni = PyUnicode_DecodeUTF8(input_str, input_chars, "strict"); - if (uni == NULL) { - return NULL; - } - rval = ascii_escape_unicode(uni); - Py_DECREF(uni); - return rval; - } - } - break; - } - } - - if (i == input_chars) { - /* Input is already ASCII */ - output_size = 2 + input_chars; - } - else { - /* One char input can be up to 6 chars output, estimate 4 of these */ - output_size = 2 + (MIN_EXPANSION * 4) + input_chars; - } - rval = PyString_FromStringAndSize(NULL, output_size); - if (rval == NULL) { - return NULL; - } - output = PyString_AS_STRING(rval); - output[0] = '"'; - - /* We know that everything up to i is ASCII already */ - chars = i + 1; - memcpy(&output[1], input_str, i); - - for (; i < input_chars; i++) { - Py_UNICODE c = (Py_UNICODE)(unsigned char)input_str[i]; - if (S_CHAR(c)) { - output[chars++] = (char)c; - } - else { - chars = ascii_escape_char(c, output, chars); - } - /* An ASCII char can't possibly expand to a surrogate! */ - if (output_size - chars < (1 + MIN_EXPANSION)) { - /* There's more than four, so let's resize by a lot */ - output_size *= 2; - if (output_size > 2 + (input_chars * MIN_EXPANSION)) { - output_size = 2 + (input_chars * MIN_EXPANSION); - } - if (_PyString_Resize(&rval, output_size) == -1) { - return NULL; - } - output = PyString_AS_STRING(rval); - } - } - output[chars++] = '"'; - if (_PyString_Resize(&rval, chars) == -1) { - return NULL; - } - return rval; -} - -static void -raise_errmsg(char *msg, PyObject *s, Py_ssize_t end) -{ - static PyObject *errmsg_fn = NULL; - PyObject *pymsg; - if (errmsg_fn == NULL) { - PyObject *decoder = PyImport_ImportModule("simplejson.decoder"); - if (decoder == NULL) - return; - errmsg_fn = PyObject_GetAttrString(decoder, "errmsg"); - Py_DECREF(decoder); - if (errmsg_fn == NULL) - return; - } - pymsg = PyObject_CallFunction(errmsg_fn, "(zOO&)", msg, s, _convertPyInt_FromSsize_t, &end); - if (pymsg) { - PyErr_SetObject(PyExc_ValueError, pymsg); - Py_DECREF(pymsg); - } -} - -static PyObject * -join_list_string(PyObject *lst) -{ - static PyObject *joinfn = NULL; - if (joinfn == NULL) { - PyObject *ustr = PyString_FromStringAndSize(NULL, 0); - if (ustr == NULL) - return NULL; - - joinfn = PyObject_GetAttrString(ustr, "join"); - Py_DECREF(ustr); - if (joinfn == NULL) - return NULL; - } - return PyObject_CallFunctionObjArgs(joinfn, lst, NULL); -} - -static PyObject * -_build_rval_index_tuple(PyObject *rval, Py_ssize_t idx) { - /* - steal a reference to rval, returns (rval, idx) - */ - if (rval == NULL) { - return NULL; - } - PyObject *tpl; - PyObject *pyidx = PyInt_FromSsize_t(idx); - if (pyidx == NULL) { - Py_DECREF(rval); - return NULL; - } - tpl = PyTuple_Pack(2, rval, pyidx); - Py_DECREF(pyidx); - Py_DECREF(rval); - return tpl; -} - -static PyObject * -scanstring_str(PyObject *pystr, Py_ssize_t end, char *encoding, int strict, Py_ssize_t *next_end_ptr) -{ - PyObject *rval; - Py_ssize_t len = PyString_GET_SIZE(pystr); - Py_ssize_t begin = end - 1; - Py_ssize_t next = begin; - int has_unicode = 0; - char *buf = PyString_AS_STRING(pystr); - PyObject *chunks = PyList_New(0); - if (chunks == NULL) { - goto bail; - } - if (end < 0 || len <= end) { - PyErr_SetString(PyExc_ValueError, "end is out of bounds"); - goto bail; - } - while (1) { - /* Find the end of the string or the next escape */ - Py_UNICODE c = 0; - PyObject *chunk = NULL; - for (next = end; next < len; next++) { - c = (unsigned char)buf[next]; - if (c == '"' || c == '\\') { - break; - } - else if (strict && c <= 0x1f) { - raise_errmsg("Invalid control character at", pystr, next); - goto bail; - } - else if (c > 0x7f) { - has_unicode = 1; - } - } - if (!(c == '"' || c == '\\')) { - raise_errmsg("Unterminated string starting at", pystr, begin); - goto bail; - } - /* Pick up this chunk if it's not zero length */ - if (next != end) { - PyObject *strchunk = PyString_FromStringAndSize(&buf[end], next - end); - if (strchunk == NULL) { - goto bail; - } - if (has_unicode) { - chunk = PyUnicode_FromEncodedObject(strchunk, encoding, NULL); - Py_DECREF(strchunk); - if (chunk == NULL) { - goto bail; - } - } - else { - chunk = strchunk; - } - if (PyList_Append(chunks, chunk)) { - goto bail; - } - Py_DECREF(chunk); - } - next++; - if (c == '"') { - end = next; - break; - } - if (next == len) { - raise_errmsg("Unterminated string starting at", pystr, begin); - goto bail; - } - c = buf[next]; - if (c != 'u') { - /* Non-unicode backslash escapes */ - end = next + 1; - switch (c) { - case '"': break; - case '\\': break; - case '/': break; - case 'b': c = '\b'; break; - case 'f': c = '\f'; break; - case 'n': c = '\n'; break; - case 'r': c = '\r'; break; - case 't': c = '\t'; break; - default: c = 0; - } - if (c == 0) { - raise_errmsg("Invalid \\escape", pystr, end - 2); - goto bail; - } - } - else { - c = 0; - next++; - end = next + 4; - if (end >= len) { - raise_errmsg("Invalid \\uXXXX escape", pystr, next - 1); - goto bail; - } - /* Decode 4 hex digits */ - for (; next < end; next++) { - c <<= 4; - Py_UNICODE digit = buf[next]; - switch (digit) { - case '0': case '1': case '2': case '3': case '4': - case '5': case '6': case '7': case '8': case '9': - c |= (digit - '0'); break; - case 'a': case 'b': case 'c': case 'd': case 'e': - case 'f': - c |= (digit - 'a' + 10); break; - case 'A': case 'B': case 'C': case 'D': case 'E': - case 'F': - c |= (digit - 'A' + 10); break; - default: - raise_errmsg("Invalid \\uXXXX escape", pystr, end - 5); - goto bail; - } - } -#ifdef Py_UNICODE_WIDE - /* Surrogate pair */ - if ((c & 0xfc00) == 0xd800) { - Py_UNICODE c2 = 0; - if (end + 6 >= len) { - raise_errmsg("Unpaired high surrogate", pystr, end - 5); - goto bail; - } - if (buf[next++] != '\\' || buf[next++] != 'u') { - raise_errmsg("Unpaired high surrogate", pystr, end - 5); - goto bail; - } - end += 6; - /* Decode 4 hex digits */ - for (; next < end; next++) { - c2 <<= 4; - Py_UNICODE digit = buf[next]; - switch (digit) { - case '0': case '1': case '2': case '3': case '4': - case '5': case '6': case '7': case '8': case '9': - c2 |= (digit - '0'); break; - case 'a': case 'b': case 'c': case 'd': case 'e': - case 'f': - c2 |= (digit - 'a' + 10); break; - case 'A': case 'B': case 'C': case 'D': case 'E': - case 'F': - c2 |= (digit - 'A' + 10); break; - default: - raise_errmsg("Invalid \\uXXXX escape", pystr, end - 5); - goto bail; - } - } - if ((c2 & 0xfc00) != 0xdc00) { - raise_errmsg("Unpaired high surrogate", pystr, end - 5); - goto bail; - } - c = 0x10000 + (((c - 0xd800) << 10) | (c2 - 0xdc00)); - } - else if ((c & 0xfc00) == 0xdc00) { - raise_errmsg("Unpaired low surrogate", pystr, end - 5); - goto bail; - } -#endif - } - if (c > 0x7f) { - has_unicode = 1; - } - if (has_unicode) { - chunk = PyUnicode_FromUnicode(&c, 1); - if (chunk == NULL) { - goto bail; - } - } - else { - char c_char = Py_CHARMASK(c); - chunk = PyString_FromStringAndSize(&c_char, 1); - if (chunk == NULL) { - goto bail; - } - } - if (PyList_Append(chunks, chunk)) { - goto bail; - } - Py_DECREF(chunk); - } - - rval = join_list_string(chunks); - if (rval == NULL) { - goto bail; - } - Py_DECREF(chunks); - chunks = NULL; - *next_end_ptr = end; - return rval; -bail: - *next_end_ptr = -1; - Py_XDECREF(chunks); - return NULL; -} - - -static PyObject * -scanstring_unicode(PyObject *pystr, Py_ssize_t end, int strict, Py_ssize_t *next_end_ptr) -{ - PyObject *rval; - Py_ssize_t len = PyUnicode_GET_SIZE(pystr); - Py_ssize_t begin = end - 1; - Py_ssize_t next = begin; - const Py_UNICODE *buf = PyUnicode_AS_UNICODE(pystr); - PyObject *chunks = PyList_New(0); - if (chunks == NULL) { - goto bail; - } - if (end < 0 || len <= end) { - PyErr_SetString(PyExc_ValueError, "end is out of bounds"); - goto bail; - } - while (1) { - /* Find the end of the string or the next escape */ - Py_UNICODE c = 0; - PyObject *chunk = NULL; - for (next = end; next < len; next++) { - c = buf[next]; - if (c == '"' || c == '\\') { - break; - } - else if (strict && c <= 0x1f) { - raise_errmsg("Invalid control character at", pystr, next); - goto bail; - } - } - if (!(c == '"' || c == '\\')) { - raise_errmsg("Unterminated string starting at", pystr, begin); - goto bail; - } - /* Pick up this chunk if it's not zero length */ - if (next != end) { - chunk = PyUnicode_FromUnicode(&buf[end], next - end); - if (chunk == NULL) { - goto bail; - } - if (PyList_Append(chunks, chunk)) { - goto bail; - } - Py_DECREF(chunk); - } - next++; - if (c == '"') { - end = next; - break; - } - if (next == len) { - raise_errmsg("Unterminated string starting at", pystr, begin); - goto bail; - } - c = buf[next]; - if (c != 'u') { - /* Non-unicode backslash escapes */ - end = next + 1; - switch (c) { - case '"': break; - case '\\': break; - case '/': break; - case 'b': c = '\b'; break; - case 'f': c = '\f'; break; - case 'n': c = '\n'; break; - case 'r': c = '\r'; break; - case 't': c = '\t'; break; - default: c = 0; - } - if (c == 0) { - raise_errmsg("Invalid \\escape", pystr, end - 2); - goto bail; - } - } - else { - c = 0; - next++; - end = next + 4; - if (end >= len) { - raise_errmsg("Invalid \\uXXXX escape", pystr, next - 1); - goto bail; - } - /* Decode 4 hex digits */ - for (; next < end; next++) { - c <<= 4; - Py_UNICODE digit = buf[next]; - switch (digit) { - case '0': case '1': case '2': case '3': case '4': - case '5': case '6': case '7': case '8': case '9': - c |= (digit - '0'); break; - case 'a': case 'b': case 'c': case 'd': case 'e': - case 'f': - c |= (digit - 'a' + 10); break; - case 'A': case 'B': case 'C': case 'D': case 'E': - case 'F': - c |= (digit - 'A' + 10); break; - default: - raise_errmsg("Invalid \\uXXXX escape", pystr, end - 5); - goto bail; - } - } -#ifdef Py_UNICODE_WIDE - /* Surrogate pair */ - if ((c & 0xfc00) == 0xd800) { - Py_UNICODE c2 = 0; - if (end + 6 >= len) { - raise_errmsg("Unpaired high surrogate", pystr, end - 5); - goto bail; - } - if (buf[next++] != '\\' || buf[next++] != 'u') { - raise_errmsg("Unpaired high surrogate", pystr, end - 5); - goto bail; - } - end += 6; - /* Decode 4 hex digits */ - for (; next < end; next++) { - c2 <<= 4; - Py_UNICODE digit = buf[next]; - switch (digit) { - case '0': case '1': case '2': case '3': case '4': - case '5': case '6': case '7': case '8': case '9': - c2 |= (digit - '0'); break; - case 'a': case 'b': case 'c': case 'd': case 'e': - case 'f': - c2 |= (digit - 'a' + 10); break; - case 'A': case 'B': case 'C': case 'D': case 'E': - case 'F': - c2 |= (digit - 'A' + 10); break; - default: - raise_errmsg("Invalid \\uXXXX escape", pystr, end - 5); - goto bail; - } - } - if ((c2 & 0xfc00) != 0xdc00) { - raise_errmsg("Unpaired high surrogate", pystr, end - 5); - goto bail; - } - c = 0x10000 + (((c - 0xd800) << 10) | (c2 - 0xdc00)); - } - else if ((c & 0xfc00) == 0xdc00) { - raise_errmsg("Unpaired low surrogate", pystr, end - 5); - goto bail; - } -#endif - } - chunk = PyUnicode_FromUnicode(&c, 1); - if (chunk == NULL) { - goto bail; - } - if (PyList_Append(chunks, chunk)) { - goto bail; - } - Py_DECREF(chunk); - } - - rval = join_list_string(chunks); - if (rval == NULL) { - goto bail; - } - Py_DECREF(chunks); - *next_end_ptr = end; - return rval; -bail: - *next_end_ptr = -1; - Py_XDECREF(chunks); - return NULL; -} - -PyDoc_STRVAR(pydoc_scanstring, - "scanstring(basestring, end, encoding) -> (str, end)\n" - "\n" - "..." -); - -static PyObject * -py_scanstring(PyObject* self UNUSED, PyObject *args) -{ - PyObject *pystr; - PyObject *rval; - Py_ssize_t end; - Py_ssize_t next_end = -1; - char *encoding = NULL; - int strict = 0; - if (!PyArg_ParseTuple(args, "OO&|zi:scanstring", &pystr, _convertPyInt_AsSsize_t, &end, &encoding, &strict)) { - return NULL; - } - if (encoding == NULL) { - encoding = DEFAULT_ENCODING; - } - if (PyString_Check(pystr)) { - rval = scanstring_str(pystr, end, encoding, strict, &next_end); - } - else if (PyUnicode_Check(pystr)) { - rval = scanstring_unicode(pystr, end, strict, &next_end); - } - else { - PyErr_Format(PyExc_TypeError, - "first argument must be a string, not %.80s", - Py_TYPE(pystr)->tp_name); - return NULL; - } - return _build_rval_index_tuple(rval, next_end); -} - -PyDoc_STRVAR(pydoc_encode_basestring_ascii, - "encode_basestring_ascii(basestring) -> str\n" - "\n" - "..." -); - -static PyObject * -py_encode_basestring_ascii(PyObject* self UNUSED, PyObject *pystr) -{ - /* METH_O */ - if (PyString_Check(pystr)) { - return ascii_escape_str(pystr); - } - else if (PyUnicode_Check(pystr)) { - return ascii_escape_unicode(pystr); - } - else { - PyErr_Format(PyExc_TypeError, - "first argument must be a string, not %.80s", - Py_TYPE(pystr)->tp_name); - return NULL; - } -} - -static void -scanner_dealloc(PyObject *self) -{ - assert(PyScanner_Check(self)); - PyScannerObject *s = (PyScannerObject *)self; - Py_XDECREF(s->encoding); - Py_XDECREF(s->strict); - Py_XDECREF(s->object_hook); - Py_XDECREF(s->parse_float); - Py_XDECREF(s->parse_int); - Py_XDECREF(s->parse_constant); - s->encoding = NULL; - s->strict = NULL; - s->object_hook = NULL; - s->parse_float = NULL; - s->parse_int = NULL; - s->parse_constant = NULL; - self->ob_type->tp_free(self); -} - -static PyObject * -_parse_object_str(PyScannerObject *s, PyObject *pystr, Py_ssize_t idx) { - char *str = PyString_AS_STRING(pystr); - Py_ssize_t end_idx = PyString_GET_SIZE(pystr) - 1; - PyObject *tpl = NULL; - PyObject *rval = PyDict_New(); - PyObject *key = NULL; - char *encoding = PyString_AS_STRING(s->encoding); - int strict = PyObject_IsTrue(s->strict); - Py_ssize_t next_idx; - if (rval == NULL) - return NULL; - - /* skip whitespace after { */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - - /* only loop if the object is non-empty */ - if (idx <= end_idx && str[idx] != '}') { - while (idx <= end_idx) { - /* read key */ - if (str[idx] != '"') { - raise_errmsg("Expecting property name", pystr, idx); - goto bail; - } - key = scanstring_str(pystr, idx + 1, encoding, strict, &next_idx); - if (key == NULL) - goto bail; - Py_INCREF(key); - idx = next_idx; - - /* skip whitespace between key and : delimiter, read :, skip whitespace */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - if (idx > end_idx || str[idx] != ':') { - raise_errmsg("Expecting : delimiter", pystr, idx); - goto bail; - } - idx++; - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - - /* read any JSON data type and de-tuplefy the (rval, idx) */ - tpl = scan_once_str(s, pystr, idx); - if (tpl == NULL) - goto bail; - next_idx = PyInt_AsSsize_t(PyTuple_GET_ITEM(tpl, 1)); - if (next_idx == -1 && PyErr_Occurred()) - goto bail; - if (PyDict_SetItem(rval, key, PyTuple_GET_ITEM(tpl, 0)) == -1) - goto bail; - Py_DECREF(tpl); - idx = next_idx; - tpl = NULL; - - /* skip whitespace before } or , */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - - /* bail if the object is closed or we didn't get the , delimiter */ - if (idx > end_idx) break; - if (str[idx] == '}') { - break; - } - else if (str[idx] != ',') { - raise_errmsg("Expecting , delimiter", pystr, idx); - goto bail; - } - idx++; - - /* skip whitespace after , delimiter */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - } - } - /* verify that idx < end_idx, str[idx] should be '}' */ - if (idx > end_idx || str[idx] != '}') { - raise_errmsg("Expecting object", pystr, end_idx); - goto bail; - } - /* if object_hook is not None: rval = object_hook(rval) */ - if (s->object_hook != Py_None) { - tpl = PyObject_CallFunctionObjArgs(s->object_hook, rval, NULL); - if (tpl == NULL) - goto bail; - Py_DECREF(rval); - rval = tpl; - tpl = NULL; - } - return _build_rval_index_tuple(rval, idx + 1); -bail: - Py_XDECREF(key); - Py_XDECREF(tpl); - Py_DECREF(rval); - return NULL; -} - -static PyObject * -_parse_object_unicode(PyScannerObject *s, PyObject *pystr, Py_ssize_t idx) { - Py_UNICODE *str = PyUnicode_AS_UNICODE(pystr); - Py_ssize_t end_idx = PyUnicode_GET_SIZE(pystr) - 1; - PyObject *tpl = NULL; - PyObject *rval = PyDict_New(); - PyObject *key = NULL; - int strict = PyObject_IsTrue(s->strict); - Py_ssize_t next_idx; - if (rval == NULL) - return NULL; - - /* skip whitespace after { */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - - /* only loop if the object is non-empty */ - if (idx <= end_idx && str[idx] != '}') { - while (idx <= end_idx) { - /* read key */ - if (str[idx] != '"') { - raise_errmsg("Expecting property name", pystr, idx); - goto bail; - } - key = scanstring_unicode(pystr, idx + 1, strict, &next_idx); - if (key == NULL) - goto bail; - idx = next_idx; - - /* skip whitespace between key and : delimiter, read :, skip whitespace */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - if (idx > end_idx || str[idx] != ':') { - raise_errmsg("Expecting : delimiter", pystr, idx); - goto bail; - } - idx++; - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - - /* read any JSON term and de-tuplefy the (rval, idx) */ - tpl = scan_once_unicode(s, pystr, idx); - if (tpl == NULL) - goto bail; - next_idx = PyInt_AsSsize_t(PyTuple_GET_ITEM(tpl, 1)); - if (next_idx == -1 && PyErr_Occurred()) - goto bail; - if (PyDict_SetItem(rval, key, PyTuple_GET_ITEM(tpl, 0)) == -1) - goto bail; - Py_DECREF(tpl); - idx = next_idx; - tpl = NULL; - - /* skip whitespace before } or , */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - - /* bail if the object is closed or we didn't get the , delimiter */ - if (idx > end_idx) break; - if (str[idx] == '}') { - break; - } - else if (str[idx] != ',') { - raise_errmsg("Expecting , delimiter", pystr, idx); - goto bail; - } - idx++; - - /* skip whitespace after , delimiter */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - } - } - - /* verify that idx < end_idx, str[idx] should be '}' */ - if (idx > end_idx || str[idx] != '}') { - raise_errmsg("Expecting object", pystr, end_idx); - goto bail; - } - - /* if object_hook is not None: rval = object_hook(rval) */ - if (s->object_hook != Py_None) { - tpl = PyObject_CallFunctionObjArgs(s->object_hook, rval, NULL); - if (tpl == NULL) - goto bail; - Py_DECREF(rval); - rval = tpl; - tpl = NULL; - } - return _build_rval_index_tuple(rval, idx + 1); -bail: - Py_XDECREF(key); - Py_XDECREF(tpl); - Py_DECREF(rval); - return NULL; -} - -static PyObject * -_parse_array_str(PyScannerObject *s, PyObject *pystr, Py_ssize_t idx) { - char *str = PyString_AS_STRING(pystr); - Py_ssize_t end_idx = PyString_GET_SIZE(pystr) - 1; - PyObject *tpl = NULL; - PyObject *rval = PyList_New(0); - Py_ssize_t next_idx; - if (rval == NULL) - return NULL; - - /* skip whitespace after [ */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - - /* only loop if the array is non-empty */ - if (idx <= end_idx && str[idx] != ']') { - while (idx <= end_idx) { - - /* read any JSON term and de-tuplefy the (rval, idx) */ - tpl = scan_once_str(s, pystr, idx); - if (tpl == NULL) - goto bail; - next_idx = PyInt_AsSsize_t(PyTuple_GET_ITEM(tpl, 1)); - if (next_idx == -1 && PyErr_Occurred()) - goto bail; - if (PyList_Append(rval, PyTuple_GET_ITEM(tpl, 0)) == -1) - goto bail; - Py_DECREF(tpl); - idx = next_idx; - tpl = NULL; - - /* skip whitespace between term and , */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - - /* bail if the array is closed or we didn't get the , delimiter */ - if (idx > end_idx) break; - if (str[idx] == ']') { - break; - } - else if (str[idx] != ',') { - raise_errmsg("Expecting , delimiter", pystr, idx); - goto bail; - } - idx++; - - /* skip whitespace after , */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - } - } - - /* verify that idx < end_idx, str[idx] should be ']' */ - if (idx > end_idx || str[idx] != ']') { - raise_errmsg("Expecting object", pystr, end_idx); - goto bail; - } - return _build_rval_index_tuple(rval, idx + 1); -bail: - Py_XDECREF(tpl); - Py_DECREF(rval); - return NULL; -} - -static PyObject * -_parse_array_unicode(PyScannerObject *s, PyObject *pystr, Py_ssize_t idx) { - Py_UNICODE *str = PyUnicode_AS_UNICODE(pystr); - Py_ssize_t end_idx = PyUnicode_GET_SIZE(pystr) - 1; - PyObject *tpl = NULL; - PyObject *rval = PyList_New(0); - Py_ssize_t next_idx; - if (rval == NULL) - return NULL; - - /* skip whitespace after [ */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - - /* only loop if the array is non-empty */ - if (idx <= end_idx && str[idx] != ']') { - while (idx <= end_idx) { - - /* read any JSON term and de-tuplefy the (rval, idx) */ - tpl = scan_once_unicode(s, pystr, idx); - if (tpl == NULL) - goto bail; - next_idx = PyInt_AsSsize_t(PyTuple_GET_ITEM(tpl, 1)); - if (next_idx == -1 && PyErr_Occurred()) - goto bail; - if (PyList_Append(rval, PyTuple_GET_ITEM(tpl, 0)) == -1) - goto bail; - Py_DECREF(tpl); - idx = next_idx; - tpl = NULL; - - /* skip whitespace between term and , */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - - /* bail if the array is closed or we didn't get the , delimiter */ - if (idx > end_idx) break; - if (str[idx] == ']') { - break; - } - else if (str[idx] != ',') { - raise_errmsg("Expecting , delimiter", pystr, idx); - goto bail; - } - idx++; - - /* skip whitespace after , */ - while (idx <= end_idx && IS_WHITESPACE(str[idx])) idx++; - } - } - - /* verify that idx < end_idx, str[idx] should be ']' */ - if (idx > end_idx || str[idx] != ']') { - raise_errmsg("Expecting object", pystr, end_idx); - goto bail; - } - return _build_rval_index_tuple(rval, idx + 1); -bail: - Py_XDECREF(tpl); - Py_DECREF(rval); - return NULL; -} - -static PyObject * -_parse_constant(PyScannerObject *s, char *constant, Py_ssize_t idx) { - PyObject *cstr; - PyObject *rval; - /* constant is "NaN", "Infinity", or "-Infinity" */ - cstr = PyString_InternFromString(constant); - if (cstr == NULL) - return NULL; - - /* rval = parse_constant(constant) */ - rval = PyObject_CallFunctionObjArgs(s->parse_constant, cstr, NULL); - idx += PyString_GET_SIZE(cstr); - Py_DECREF(cstr); - return _build_rval_index_tuple(rval, idx); -} - -static PyObject * -_match_number_str(PyScannerObject *s, PyObject *pystr, Py_ssize_t start) { - char *str = PyString_AS_STRING(pystr); - Py_ssize_t end_idx = PyString_GET_SIZE(pystr) - 1; - Py_ssize_t idx = start; - int is_float = 0; - PyObject *rval; - PyObject *numstr; - - /* read a sign if it's there, make sure it's not the end of the string */ - if (str[idx] == '-') { - idx++; - if (idx > end_idx) { - PyErr_SetNone(PyExc_StopIteration); - return NULL; - } - } - - /* read as many integer digits as we find as long as it doesn't start with 0 */ - if (str[idx] >= '1' && str[idx] <= '9') { - idx++; - while (idx <= end_idx && str[idx] >= '0' && str[idx] <= '9') idx++; - } - /* if it starts with 0 we only expect one integer digit */ - else if (str[idx] == '0') { - idx++; - } - /* no integer digits, error */ - else { - PyErr_SetNone(PyExc_StopIteration); - return NULL; - } - - /* if the next char is '.' followed by a digit then read all float digits */ - if (idx < end_idx && str[idx] == '.' && str[idx + 1] >= '0' && str[idx + 1] <= '9') { - is_float = 1; - idx += 2; - while (idx < end_idx && str[idx] >= '0' && str[idx] <= '9') idx++; - } - - /* if the next char is 'e' or 'E' then maybe read the exponent (or backtrack) */ - if (idx < end_idx && (str[idx] == 'e' || str[idx] == 'E')) { - - /* save the index of the 'e' or 'E' just in case we need to backtrack */ - Py_ssize_t e_start = idx; - idx++; - - /* read an exponent sign if present */ - if (idx < end_idx && (str[idx] == '-' || str[idx] == '+')) idx++; - - /* read all digits */ - while (idx <= end_idx && str[idx] >= '0' && str[idx] <= '9') idx++; - - /* if we got a digit, then parse as float. if not, backtrack */ - if (str[idx - 1] >= '0' && str[idx - 1] <= '9') { - is_float = 1; - } - else { - idx = e_start; - } - } - - /* copy the section we determined to be a number */ - numstr = PyString_FromStringAndSize(&str[start], idx - start); - if (numstr == NULL) - return NULL; - if (is_float) { - /* parse as a float using a fast path if available, otherwise call user defined method */ - if (s->parse_float != (PyObject *)&PyFloat_Type) { - rval = PyObject_CallFunctionObjArgs(s->parse_float, numstr, NULL); - } - else { - rval = PyFloat_FromDouble(PyOS_ascii_atof(PyString_AS_STRING(numstr))); - } - } - else { - /* parse as an int using a fast path if available, otherwise call user defined method */ - if (s->parse_int != (PyObject *)&PyInt_Type) { - rval = PyObject_CallFunctionObjArgs(s->parse_int, numstr, NULL); - } - else { - rval = PyInt_FromString(PyString_AS_STRING(numstr), NULL, 10); - } - } - Py_DECREF(numstr); - return _build_rval_index_tuple(rval, idx); -} - -static PyObject * -_match_number_unicode(PyScannerObject *s, PyObject *pystr, Py_ssize_t start) { - Py_UNICODE *str = PyUnicode_AS_UNICODE(pystr); - Py_ssize_t end_idx = PyUnicode_GET_SIZE(pystr) - 1; - Py_ssize_t idx = start; - int is_float = 0; - PyObject *rval; - PyObject *numstr; - - /* read a sign if it's there, make sure it's not the end of the string */ - if (str[idx] == '-') { - idx++; - if (idx > end_idx) { - PyErr_SetNone(PyExc_StopIteration); - return NULL; - } - } - - /* read as many integer digits as we find as long as it doesn't start with 0 */ - if (str[idx] >= '1' && str[idx] <= '9') { - idx++; - while (idx <= end_idx && str[idx] >= '0' && str[idx] <= '9') idx++; - } - /* if it starts with 0 we only expect one integer digit */ - else if (str[idx] == '0') { - idx++; - } - /* no integer digits, error */ - else { - PyErr_SetNone(PyExc_StopIteration); - return NULL; - } - - /* if the next char is '.' followed by a digit then read all float digits */ - if (idx < end_idx && str[idx] == '.' && str[idx + 1] >= '0' && str[idx + 1] <= '9') { - is_float = 1; - idx += 2; - while (idx < end_idx && str[idx] >= '0' && str[idx] <= '9') idx++; - } - - /* if the next char is 'e' or 'E' then maybe read the exponent (or backtrack) */ - if (idx < end_idx && (str[idx] == 'e' || str[idx] == 'E')) { - Py_ssize_t e_start = idx; - idx++; - - /* read an exponent sign if present */ - if (idx < end_idx && (str[idx] == '-' || str[idx] == '+')) idx++; - - /* read all digits */ - while (idx <= end_idx && str[idx] >= '0' && str[idx] <= '9') idx++; - - /* if we got a digit, then parse as float. if not, backtrack */ - if (str[idx - 1] >= '0' && str[idx - 1] <= '9') { - is_float = 1; - } - else { - idx = e_start; - } - } - - /* copy the section we determined to be a number */ - numstr = PyUnicode_FromUnicode(&str[start], idx - start); - if (numstr == NULL) - return NULL; - if (is_float) { - /* parse as a float using a fast path if available, otherwise call user defined method */ - if (s->parse_float != (PyObject *)&PyFloat_Type) { - rval = PyObject_CallFunctionObjArgs(s->parse_float, numstr, NULL); - } - else { - rval = PyFloat_FromString(numstr, NULL); - } - } - else { - /* no fast path for unicode -> int, just call */ - rval = PyObject_CallFunctionObjArgs(s->parse_int, numstr, NULL); - } - Py_DECREF(numstr); - return _build_rval_index_tuple(rval, idx); -} - -static PyObject * -scan_once_str(PyScannerObject *s, PyObject *pystr, Py_ssize_t idx) -{ - char *str = PyString_AS_STRING(pystr); - Py_ssize_t length = PyString_GET_SIZE(pystr); - Py_ssize_t next_idx = -1; - PyObject *rval; - if (idx >= length) { - PyErr_SetNone(PyExc_StopIteration); - return NULL; - } - switch (str[idx]) { - case '"': - /* string */ - rval = scanstring_str(pystr, idx + 1, - PyString_AS_STRING(s->encoding), - PyObject_IsTrue(s->strict), - &next_idx); - return _build_rval_index_tuple(rval, next_idx); - case '{': - /* object */ - return _parse_object_str(s, pystr, idx + 1); - case '[': - /* array */ - return _parse_array_str(s, pystr, idx + 1); - case 'n': - /* null */ - if ((idx + 3 < length) && str[idx + 1] == 'u' && str[idx + 2] == 'l' && str[idx + 3] == 'l') { - Py_INCREF(Py_None); - return _build_rval_index_tuple(Py_None, idx + 4); - } - break; - case 't': - /* true */ - if ((idx + 3 < length) && str[idx + 1] == 'r' && str[idx + 2] == 'u' && str[idx + 3] == 'e') { - Py_INCREF(Py_True); - return _build_rval_index_tuple(Py_True, idx + 4); - } - break; - case 'f': - /* false */ - if ((idx + 4 < length) && str[idx + 1] == 'a' && str[idx + 2] == 'l' && str[idx + 3] == 's' && str[idx + 4] == 'e') { - Py_INCREF(Py_False); - return _build_rval_index_tuple(Py_False, idx + 5); - } - break; - case 'N': - /* NaN */ - if ((idx + 2 < length) && str[idx + 1] == 'a' && str[idx + 2] == 'N') { - return _parse_constant(s, "NaN", idx); - } - break; - case 'I': - /* Infinity */ - if ((idx + 7 < length) && str[idx + 1] == 'n' && str[idx + 2] == 'f' && str[idx + 3] == 'i' && str[idx + 4] == 'n' && str[idx + 5] == 'i' && str[idx + 6] == 't' && str[idx + 7] == 'y') { - return _parse_constant(s, "Infinity", idx); - } - break; - case '-': - /* -Infinity */ - if ((idx + 8 < length) && str[idx + 1] == 'I' && str[idx + 2] == 'n' && str[idx + 3] == 'f' && str[idx + 4] == 'i' && str[idx + 5] == 'n' && str[idx + 6] == 'i' && str[idx + 7] == 't' && str[idx + 8] == 'y') { - return _parse_constant(s, "-Infinity", idx); - } - break; - } - /* Didn't find a string, object, array, or named constant. Look for a number. */ - return _match_number_str(s, pystr, idx); -} - -static PyObject * -scan_once_unicode(PyScannerObject *s, PyObject *pystr, Py_ssize_t idx) -{ - Py_UNICODE *str = PyUnicode_AS_UNICODE(pystr); - Py_ssize_t length = PyUnicode_GET_SIZE(pystr); - Py_ssize_t next_idx = -1; - PyObject *rval; - if (idx >= length) { - PyErr_SetNone(PyExc_StopIteration); - return NULL; - } - switch (str[idx]) { - case '"': - /* string */ - rval = scanstring_unicode(pystr, idx + 1, - PyObject_IsTrue(s->strict), - &next_idx); - return _build_rval_index_tuple(rval, next_idx); - case '{': - /* object */ - return _parse_object_unicode(s, pystr, idx + 1); - case '[': - /* array */ - return _parse_array_unicode(s, pystr, idx + 1); - case 'n': - /* null */ - if ((idx + 3 < length) && str[idx + 1] == 'u' && str[idx + 2] == 'l' && str[idx + 3] == 'l') { - Py_INCREF(Py_None); - return _build_rval_index_tuple(Py_None, idx + 4); - } - break; - case 't': - /* true */ - if ((idx + 3 < length) && str[idx + 1] == 'r' && str[idx + 2] == 'u' && str[idx + 3] == 'e') { - Py_INCREF(Py_True); - return _build_rval_index_tuple(Py_True, idx + 4); - } - break; - case 'f': - /* false */ - if ((idx + 4 < length) && str[idx + 1] == 'a' && str[idx + 2] == 'l' && str[idx + 3] == 's' && str[idx + 4] == 'e') { - Py_INCREF(Py_False); - return _build_rval_index_tuple(Py_False, idx + 5); - } - break; - case 'N': - /* NaN */ - if ((idx + 2 < length) && str[idx + 1] == 'a' && str[idx + 2] == 'N') { - return _parse_constant(s, "NaN", idx); - } - break; - case 'I': - /* Infinity */ - if ((idx + 7 < length) && str[idx + 1] == 'n' && str[idx + 2] == 'f' && str[idx + 3] == 'i' && str[idx + 4] == 'n' && str[idx + 5] == 'i' && str[idx + 6] == 't' && str[idx + 7] == 'y') { - return _parse_constant(s, "Infinity", idx); - } - break; - case '-': - /* -Infinity */ - if ((idx + 8 < length) && str[idx + 1] == 'I' && str[idx + 2] == 'n' && str[idx + 3] == 'f' && str[idx + 4] == 'i' && str[idx + 5] == 'n' && str[idx + 6] == 'i' && str[idx + 7] == 't' && str[idx + 8] == 'y') { - return _parse_constant(s, "-Infinity", idx); - } - break; - } - /* Didn't find a string, object, array, or named constant. Look for a number. */ - return _match_number_unicode(s, pystr, idx); -} - -static PyObject * -scanner_call(PyObject *self, PyObject *args, PyObject *kwds) -{ - PyObject *pystr; - Py_ssize_t idx; - static char *kwlist[] = {"string", "idx", NULL}; - PyScannerObject *s = (PyScannerObject *)self; - assert(PyScanner_Check(self)); - if (!PyArg_ParseTupleAndKeywords(args, kwds, "OO&:scan_once", kwlist, &pystr, _convertPyInt_AsSsize_t, &idx)) - return NULL; - if (PyString_Check(pystr)) { - return scan_once_str(s, pystr, idx); - } - else if (PyUnicode_Check(pystr)) { - return scan_once_unicode(s, pystr, idx); - } - else { - PyErr_Format(PyExc_TypeError, - "first argument must be a string, not %.80s", - Py_TYPE(pystr)->tp_name); - return NULL; - } -} - -static int -scanner_init(PyObject *self, PyObject *args, PyObject *kwds) -{ - PyObject *ctx; - static char *kwlist[] = {"context", NULL}; - - assert(PyScanner_Check(self)); - PyScannerObject *s = (PyScannerObject *)self; - - if (!PyArg_ParseTupleAndKeywords(args, kwds, "O:make_scanner", kwlist, &ctx)) - return -1; - - s->encoding = NULL; - s->strict = NULL; - s->object_hook = NULL; - s->parse_float = NULL; - s->parse_int = NULL; - s->parse_constant = NULL; - - /* PyString_AS_STRING is used on encoding */ - s->encoding = PyObject_GetAttrString(ctx, "encoding"); - if (s->encoding == Py_None) { - Py_DECREF(Py_None); - s->encoding = PyString_InternFromString(DEFAULT_ENCODING); - } - else if (PyUnicode_Check(s->encoding)) { - PyObject *tmp = PyUnicode_AsEncodedString(s->encoding, NULL, NULL); - Py_DECREF(s->encoding); - s->encoding = tmp; - } - if (s->encoding == NULL || !PyString_Check(s->encoding)) - goto bail; - - /* All of these will fail "gracefully" so we don't need to verify them */ - s->strict = PyObject_GetAttrString(ctx, "strict"); - if (s->strict == NULL) - goto bail; - s->object_hook = PyObject_GetAttrString(ctx, "object_hook"); - if (s->object_hook == NULL) - goto bail; - s->parse_float = PyObject_GetAttrString(ctx, "parse_float"); - if (s->parse_float == NULL) - goto bail; - s->parse_int = PyObject_GetAttrString(ctx, "parse_int"); - if (s->parse_int == NULL) - goto bail; - s->parse_constant = PyObject_GetAttrString(ctx, "parse_constant"); - if (s->parse_constant == NULL) - goto bail; - - return 0; - -bail: - Py_XDECREF(s->encoding); - Py_XDECREF(s->strict); - Py_XDECREF(s->object_hook); - Py_XDECREF(s->parse_float); - Py_XDECREF(s->parse_int); - Py_XDECREF(s->parse_constant); - s->encoding = NULL; - s->strict = NULL; - s->object_hook = NULL; - s->parse_float = NULL; - s->parse_int = NULL; - s->parse_constant = NULL; - return -1; -} - -PyDoc_STRVAR(scanner_doc, "JSON scanner object"); - -static -PyTypeObject PyScannerType = { - PyObject_HEAD_INIT(0) - 0, /* tp_internal */ - "make_scanner", /* tp_name */ - sizeof(PyScannerObject), /* tp_basicsize */ - 0, /* tp_itemsize */ - scanner_dealloc, /* tp_dealloc */ - 0, /* tp_print */ - 0, /* tp_getattr */ - 0, /* tp_setattr */ - 0, /* tp_compare */ - 0, /* tp_repr */ - 0, /* tp_as_number */ - 0, /* tp_as_sequence */ - 0, /* tp_as_mapping */ - 0, /* tp_hash */ - scanner_call, /* tp_call */ - 0, /* tp_str */ - 0,/* PyObject_GenericGetAttr, */ /* tp_getattro */ - 0,/* PyObject_GenericSetAttr, */ /* tp_setattro */ - 0, /* tp_as_buffer */ - Py_TPFLAGS_DEFAULT, /* tp_flags */ - scanner_doc, /* tp_doc */ - 0, /* tp_traverse */ - 0, /* tp_clear */ - 0, /* tp_richcompare */ - 0, /* tp_weaklistoffset */ - 0, /* tp_iter */ - 0, /* tp_iternext */ - 0, /* tp_methods */ - scanner_members, /* tp_members */ - 0, /* tp_getset */ - 0, /* tp_base */ - 0, /* tp_dict */ - 0, /* tp_descr_get */ - 0, /* tp_descr_set */ - 0, /* tp_dictoffset */ - scanner_init, /* tp_init */ - 0,/* PyType_GenericAlloc, */ /* tp_alloc */ - 0,/* PyType_GenericNew, */ /* tp_new */ - 0,/* _PyObject_Del, */ /* tp_free */ -}; - -static int -encoder_init(PyObject *self, PyObject *args, PyObject *kwds) -{ - static char *kwlist[] = {"markers", "default", "encoder", "indent", "key_separator", "item_separator", "sort_keys", "skipkeys", "allow_nan", NULL}; - - assert(PyEncoder_Check(self)); - PyEncoderObject *s = (PyEncoderObject *)self; - PyObject *allow_nan; - - s->markers = NULL; - s->defaultfn = NULL; - s->encoder = NULL; - s->indent = NULL; - s->key_separator = NULL; - s->item_separator = NULL; - s->sort_keys = NULL; - s->skipkeys = NULL; - - if (!PyArg_ParseTupleAndKeywords(args, kwds, "OOOOOOOOO:make_encoder", kwlist, - &s->markers, &s->defaultfn, &s->encoder, &s->indent, &s->key_separator, &s->item_separator, &s->sort_keys, &s->skipkeys, &allow_nan)) - return -1; - - Py_INCREF(s->markers); - Py_INCREF(s->defaultfn); - Py_INCREF(s->encoder); - Py_INCREF(s->indent); - Py_INCREF(s->key_separator); - Py_INCREF(s->item_separator); - Py_INCREF(s->sort_keys); - Py_INCREF(s->skipkeys); - s->fast_encode = (PyCFunction_Check(s->encoder) && PyCFunction_GetFunction(s->encoder) == (PyCFunction)py_encode_basestring_ascii); - s->allow_nan = PyObject_IsTrue(allow_nan); - return 0; -} - -static PyObject * -encoder_call(PyObject *self, PyObject *args, PyObject *kwds) -{ - static char *kwlist[] = {"obj", "_current_indent_level", NULL}; - PyObject *obj; - PyObject *rval; - Py_ssize_t indent_level; - PyEncoderObject *s = (PyEncoderObject *)self; - assert(PyEncoder_Check(self)); - if (!PyArg_ParseTupleAndKeywords(args, kwds, "OO&:_iterencode", kwlist, - &obj, _convertPyInt_AsSsize_t, &indent_level)) - return NULL; - rval = PyList_New(0); - if (rval == NULL) - return NULL; - if (encoder_listencode_obj(s, rval, obj, indent_level)) { - Py_DECREF(rval); - return NULL; - } - return rval; -} - -static PyObject * -_encoded_const(PyObject *obj) -{ - if (obj == Py_None) { - static PyObject *s_null = NULL; - if (s_null == NULL) { - s_null = PyString_InternFromString("null"); - } - return s_null; - } - else if (obj == Py_True) { - static PyObject *s_true = NULL; - if (s_true == NULL) { - s_true = PyString_InternFromString("true"); - } - return s_true; - } - else if (obj == Py_False) { - static PyObject *s_false = NULL; - if (s_false == NULL) { - s_false = PyString_InternFromString("false"); - } - return s_false; - } - else { - PyErr_SetString(PyExc_ValueError, "not a const"); - return NULL; - } -} - -static PyObject * -encoder_encode_float(PyEncoderObject *s, PyObject *obj) -{ - double i = PyFloat_AS_DOUBLE(obj); - if (!Py_IS_FINITE(i)) { - if (!s->allow_nan) { - PyErr_SetString(PyExc_ValueError, "Out of range float values are not JSON compliant"); - return NULL; - } - if (i > 0) { - return PyString_FromString("Infinity"); - } - else if (i < 0) { - return PyString_FromString("-Infinity"); - } - else { - return PyString_FromString("NaN"); - } - } - /* Use a better float format here? */ - return PyObject_Repr(obj); -} - -static PyObject * -encoder_encode_string(PyEncoderObject *s, PyObject *obj) -{ - if (s->fast_encode) - return py_encode_basestring_ascii(NULL, obj); - else - return PyObject_CallFunctionObjArgs(s->encoder, obj, NULL); -} - -static int -encoder_listencode_obj(PyEncoderObject *s, PyObject *rval, PyObject *obj, Py_ssize_t indent_level) -{ - if (obj == Py_None || obj == Py_True || obj == Py_False) { - PyObject *cstr = _encoded_const(obj); - if (cstr == NULL) - return -1; - return PyList_Append(rval, cstr); - } - else if (PyString_Check(obj) || PyUnicode_Check(obj)) - { - PyObject *encoded = encoder_encode_string(s, obj); - if (encoded == NULL) - return -1; - return PyList_Append(rval, encoded); - } - else if (PyInt_Check(obj) || PyLong_Check(obj)) { - PyObject *encoded = PyObject_Str(obj); - if (encoded == NULL) - return -1; - return PyList_Append(rval, encoded); - } - else if (PyFloat_Check(obj)) { - PyObject *encoded = encoder_encode_float(s, obj); - if (encoded == NULL) - return -1; - return PyList_Append(rval, encoded); - } - else if (PyList_Check(obj) || PyTuple_Check(obj)) { - return encoder_listencode_list(s, rval, obj, indent_level); - } - else if (PyDict_Check(obj)) { - return encoder_listencode_dict(s, rval, obj, indent_level); - } - else { - PyObject *ident = NULL; - if (s->markers != Py_None) { - ident = PyLong_FromVoidPtr(obj); - int has_key; - if (ident == NULL) - return -1; - has_key = PyDict_Contains(s->markers, ident); - if (has_key) { - if (has_key != -1) - PyErr_SetString(PyExc_ValueError, "Circular reference detected"); - Py_DECREF(ident); - return -1; - } - if (PyDict_SetItem(s->markers, ident, obj)) { - Py_DECREF(ident); - return -1; - } - } - PyObject *newobj = PyObject_CallFunctionObjArgs(s->defaultfn, obj, NULL); - if (newobj == NULL) { - Py_DECREF(ident); - return -1; - } - int rv = encoder_listencode_obj(s, rval, newobj, indent_level); - Py_DECREF(newobj); - if (rv) { - Py_DECREF(ident); - return -1; - } - if (ident != NULL) { - if (PyDict_DelItem(s->markers, ident)) { - Py_DECREF(ident); - ident = NULL; - return -1; - } - Py_DECREF(ident); - ident = NULL; - } - return rv; - } -} - -static int -encoder_listencode_dict(PyEncoderObject *s, PyObject *rval, PyObject *dct, Py_ssize_t indent_level) -{ - static PyObject *open_dict = NULL; - static PyObject *close_dict = NULL; - static PyObject *empty_dict = NULL; - PyObject *kstr = NULL; - if (open_dict == NULL || close_dict == NULL || empty_dict == NULL) { - open_dict = PyString_InternFromString("{"); - close_dict = PyString_InternFromString("}"); - empty_dict = PyString_InternFromString("{}"); - if (open_dict == NULL || close_dict == NULL || empty_dict == NULL) - return -1; - } - PyObject *ident = NULL; - if (PyDict_Size(dct) == 0) - return PyList_Append(rval, empty_dict); - - if (s->markers != Py_None) { - ident = PyLong_FromVoidPtr(dct); - int has_key; - if (ident == NULL) - goto bail; - has_key = PyDict_Contains(s->markers, ident); - if (has_key) { - if (has_key != -1) - PyErr_SetString(PyExc_ValueError, "Circular reference detected"); - goto bail; - } - if (PyDict_SetItem(s->markers, ident, dct)) { - goto bail; - } - } - - if (PyList_Append(rval, open_dict)) - goto bail; - - if (s->indent != Py_None) { - /* TODO: DOES NOT RUN */ - indent_level += 1; - /* - newline_indent = '\n' + (' ' * (_indent * _current_indent_level)) - separator = _item_separator + newline_indent - buf += newline_indent - */ - } - - /* TODO: C speedup not implemented for sort_keys */ - - PyObject *key, *value; - Py_ssize_t pos = 0; - int skipkeys = PyObject_IsTrue(s->skipkeys); - Py_ssize_t idx = 0; - while (PyDict_Next(dct, &pos, &key, &value)) { - if (PyString_Check(key) || PyUnicode_Check(key)) { - Py_INCREF(key); - kstr = key; - } - else if (PyFloat_Check(key)) { - kstr = encoder_encode_float(s, key); - if (kstr == NULL) - goto bail; - } - else if (PyInt_Check(key) || PyLong_Check(key)) { - kstr = PyObject_Str(key); - if (kstr == NULL) - goto bail; - } - else if (key == Py_True || key == Py_False || key == Py_None) { - kstr = _encoded_const(key); - } - else if (skipkeys) { - continue; - } - else { - /* TODO: include repr of key */ - PyErr_SetString(PyExc_ValueError, "keys must be a string"); - goto bail; - } - - if (idx) { - if (PyList_Append(rval, s->item_separator)) - goto bail; - } - - PyObject *encoded = encoder_encode_string(s, kstr); - Py_DECREF(kstr); - kstr = NULL; - if (encoded == NULL) - goto bail; - if (PyList_Append(rval, encoded)) - goto bail; - if (PyList_Append(rval, s->key_separator)) - goto bail; - if (encoder_listencode_obj(s, rval, value, indent_level)) - goto bail; - idx += 1; - } - if (ident != NULL) { - if (PyDict_DelItem(s->markers, ident)) - goto bail; - Py_DECREF(ident); - ident = NULL; - } - if (s->indent != Py_None) { - /* TODO: DOES NOT RUN */ - indent_level -= 1; - /* - yield '\n' + (' ' * (_indent * _current_indent_level)) - */ - } - if (PyList_Append(rval, close_dict)) - goto bail; - return 0; - -bail: - Py_XDECREF(kstr); - Py_XDECREF(ident); - return -1; -} - - -static int -encoder_listencode_list(PyEncoderObject *s, PyObject *rval, PyObject *seq, Py_ssize_t indent_level) -{ - static PyObject *open_array = NULL; - static PyObject *close_array = NULL; - static PyObject *empty_array = NULL; - if (open_array == NULL || close_array == NULL || empty_array == NULL) { - open_array = PyString_InternFromString("["); - close_array = PyString_InternFromString("]"); - empty_array = PyString_InternFromString("[]"); - if (open_array == NULL || close_array == NULL || empty_array == NULL) - return -1; - } - PyObject *ident = NULL; - PyObject *s_fast = PySequence_Fast(seq, "_iterencode_list needs a sequence"); - if (s_fast == NULL) - return -1; - Py_ssize_t num_items = PySequence_Fast_GET_SIZE(s_fast); - if (num_items == 0) { - Py_DECREF(s_fast); - return PyList_Append(rval, empty_array); - } - - if (s->markers != Py_None) { - ident = PyLong_FromVoidPtr(seq); - int has_key; - if (ident == NULL) - goto bail; - has_key = PyDict_Contains(s->markers, ident); - if (has_key) { - if (has_key != -1) - PyErr_SetString(PyExc_ValueError, "Circular reference detected"); - goto bail; - } - if (PyDict_SetItem(s->markers, ident, seq)) { - goto bail; - } - } - - PyObject **seq_items = PySequence_Fast_ITEMS(s_fast); - if (PyList_Append(rval, open_array)) - goto bail; - Py_ssize_t i; - if (s->indent != Py_None) { - /* TODO: DOES NOT RUN */ - indent_level += 1; - /* - newline_indent = '\n' + (' ' * (_indent * _current_indent_level)) - separator = _item_separator + newline_indent - buf += newline_indent - */ - } - for (i = 0; i < num_items; i++) { - PyObject *obj = seq_items[i]; - if (i) { - if (PyList_Append(rval, s->item_separator)) - goto bail; - } - if (encoder_listencode_obj(s, rval, obj, indent_level)) - goto bail; - } - if (ident != NULL) { - if (PyDict_DelItem(s->markers, ident)) - goto bail; - Py_DECREF(ident); - ident = NULL; - } - if (s->indent != Py_None) { - /* TODO: DOES NOT RUN */ - indent_level -= 1; - /* - yield '\n' + (' ' * (_indent * _current_indent_level)) - */ - } - if (PyList_Append(rval, close_array)) - goto bail; - Py_DECREF(s_fast); - return 0; - -bail: - Py_XDECREF(ident); - Py_DECREF(s_fast); - return -1; -} - -static void -encoder_dealloc(PyObject *self) -{ - assert(PyEncoder_Check(self)); - PyEncoderObject *s = (PyEncoderObject *)self; - Py_XDECREF(s->markers); - s->markers = NULL; - Py_XDECREF(s->defaultfn); - s->defaultfn = NULL; - Py_XDECREF(s->encoder); - s->encoder = NULL; - Py_XDECREF(s->indent); - s->indent = NULL; - Py_XDECREF(s->key_separator); - s->key_separator = NULL; - Py_XDECREF(s->item_separator); - s->item_separator = NULL; - Py_XDECREF(s->sort_keys); - s->sort_keys = NULL; - Py_XDECREF(s->skipkeys); - s->skipkeys = NULL; - self->ob_type->tp_free(self); -} - -PyDoc_STRVAR(encoder_doc, "_iterencode(obj, _current_indent_level) -> iterable"); - -static -PyTypeObject PyEncoderType = { - PyObject_HEAD_INIT(0) - 0, /* tp_internal */ - "make_encoder", /* tp_name */ - sizeof(PyEncoderObject), /* tp_basicsize */ - 0, /* tp_itemsize */ - encoder_dealloc, /* tp_dealloc */ - 0, /* tp_print */ - 0, /* tp_getattr */ - 0, /* tp_setattr */ - 0, /* tp_compare */ - 0, /* tp_repr */ - 0, /* tp_as_number */ - 0, /* tp_as_sequence */ - 0, /* tp_as_mapping */ - 0, /* tp_hash */ - encoder_call, /* tp_call */ - 0, /* tp_str */ - 0,/* PyObject_GenericGetAttr, */ /* tp_getattro */ - 0,/* PyObject_GenericSetAttr, */ /* tp_setattro */ - 0, /* tp_as_buffer */ - Py_TPFLAGS_DEFAULT, /* tp_flags */ - encoder_doc, /* tp_doc */ - 0, /* tp_traverse */ - 0, /* tp_clear */ - 0, /* tp_richcompare */ - 0, /* tp_weaklistoffset */ - 0, /* tp_iter */ - 0, /* tp_iternext */ - 0, /* tp_methods */ - encoder_members, /* tp_members */ - 0, /* tp_getset */ - 0, /* tp_base */ - 0, /* tp_dict */ - 0, /* tp_descr_get */ - 0, /* tp_descr_set */ - 0, /* tp_dictoffset */ - encoder_init, /* tp_init */ - 0,/* PyType_GenericAlloc, */ /* tp_alloc */ - 0,/* PyType_GenericNew, */ /* tp_new */ - 0,/* _PyObject_Del, */ /* tp_free */ -}; - -static PyMethodDef speedups_methods[] = { - {"encode_basestring_ascii", - (PyCFunction)py_encode_basestring_ascii, - METH_O, - pydoc_encode_basestring_ascii}, - {"scanstring", - (PyCFunction)py_scanstring, - METH_VARARGS, - pydoc_scanstring}, - {NULL, NULL, 0, NULL} -}; - -PyDoc_STRVAR(module_doc, -"simplejson speedups\n"); - -void -init_speedups(void) -{ - PyObject *m; - PyScannerType.tp_getattro = PyObject_GenericGetAttr; - PyScannerType.tp_setattro = PyObject_GenericSetAttr; - PyScannerType.tp_alloc = PyType_GenericAlloc; - PyScannerType.tp_new = PyType_GenericNew; - PyScannerType.tp_free = _PyObject_Del; - if (PyType_Ready(&PyScannerType) < 0) - return; - PyEncoderType.tp_getattro = PyObject_GenericGetAttr; - PyEncoderType.tp_setattro = PyObject_GenericSetAttr; - PyEncoderType.tp_alloc = PyType_GenericAlloc; - PyEncoderType.tp_new = PyType_GenericNew; - PyEncoderType.tp_free = _PyObject_Del; - if (PyType_Ready(&PyEncoderType) < 0) - return; - m = Py_InitModule3("_speedups", speedups_methods, module_doc); - Py_INCREF((PyObject*)&PyScannerType); - PyModule_AddObject(m, "make_scanner", (PyObject*)&PyScannerType); - Py_INCREF((PyObject*)&PyEncoderType); - PyModule_AddObject(m, "make_encoder", (PyObject*)&PyEncoderType); -} diff --git a/subscriber/simplejson/decoder.py b/subscriber/simplejson/decoder.py deleted file mode 100644 index d5c1a6b..0000000 --- a/subscriber/simplejson/decoder.py +++ /dev/null @@ -1,336 +0,0 @@ -""" -Implementation of JSONDecoder -""" -import re -import sys -import struct - -from simplejson.scanner import make_scanner -try: - from simplejson._speedups import scanstring as c_scanstring -except ImportError: - c_scanstring = None - -FLAGS = re.VERBOSE | re.MULTILINE | re.DOTALL - -def _floatconstants(): - _BYTES = '7FF80000000000007FF0000000000000'.decode('hex') - if sys.byteorder != 'big': - _BYTES = _BYTES[:8][::-1] + _BYTES[8:][::-1] - nan, inf = struct.unpack('dd', _BYTES) - return nan, inf, -inf - -NaN, PosInf, NegInf = _floatconstants() - - -def linecol(doc, pos): - lineno = doc.count('\n', 0, pos) + 1 - if lineno == 1: - colno = pos - else: - colno = pos - doc.rindex('\n', 0, pos) - return lineno, colno - - -def errmsg(msg, doc, pos, end=None): - # Note that this function is called from _speedups - lineno, colno = linecol(doc, pos) - if end is None: - return '%s: line %d column %d (char %d)' % (msg, lineno, colno, pos) - endlineno, endcolno = linecol(doc, end) - return '%s: line %d column %d - line %d column %d (char %d - %d)' % ( - msg, lineno, colno, endlineno, endcolno, pos, end) - - -_CONSTANTS = { - '-Infinity': NegInf, - 'Infinity': PosInf, - 'NaN': NaN, -} - -STRINGCHUNK = re.compile(r'(.*?)(["\\\x00-\x1f])', FLAGS) -BACKSLASH = { - '"': u'"', '\\': u'\\', '/': u'/', - 'b': u'\b', 'f': u'\f', 'n': u'\n', 'r': u'\r', 't': u'\t', -} - -DEFAULT_ENCODING = "utf-8" - -def py_scanstring(s, end, encoding=None, strict=True, _b=BACKSLASH, _m=STRINGCHUNK.match): - if encoding is None: - encoding = DEFAULT_ENCODING - chunks = [] - _append = chunks.append - begin = end - 1 - while 1: - chunk = _m(s, end) - if chunk is None: - raise ValueError( - errmsg("Unterminated string starting at", s, begin)) - end = chunk.end() - content, terminator = chunk.groups() - if content: - if not isinstance(content, unicode): - content = unicode(content, encoding) - _append(content) - if terminator == '"': - break - elif terminator != '\\': - if strict: - raise ValueError(errmsg("Invalid control character %r at", s, end)) - else: - _append(terminator) - continue - try: - esc = s[end] - except IndexError: - raise ValueError( - errmsg("Unterminated string starting at", s, begin)) - if esc != 'u': - try: - m = _b[esc] - except KeyError: - raise ValueError( - errmsg("Invalid \\escape: %r" % (esc,), s, end)) - end += 1 - else: - esc = s[end + 1:end + 5] - next_end = end + 5 - msg = "Invalid \\uXXXX escape" - try: - if len(esc) != 4: - raise ValueError - uni = int(esc, 16) - if 0xd800 <= uni <= 0xdbff and sys.maxunicode > 65535: - msg = "Invalid \\uXXXX\\uXXXX surrogate pair" - if not s[end + 5:end + 7] == '\\u': - raise ValueError - esc2 = s[end + 7:end + 11] - if len(esc2) != 4: - raise ValueError - uni2 = int(esc2, 16) - uni = 0x10000 + (((uni - 0xd800) << 10) | (uni2 - 0xdc00)) - next_end += 6 - m = unichr(uni) - except ValueError: - raise ValueError(errmsg(msg, s, end)) - end = next_end - _append(m) - return u''.join(chunks), end - - -# Use speedup if available -scanstring = c_scanstring or py_scanstring - -WHITESPACE = re.compile(r'[ \t\n\r]*', FLAGS) -WHITESPACE_STR = ' \t\n\r' - -def JSONObject((s, end), encoding, strict, scan_once, object_hook, _w=WHITESPACE.match, _ws=WHITESPACE_STR): - pairs = {} - nextchar = s[end:end + 1] - # Normally we expect nextchar == '"' - if nextchar != '"': - if nextchar in _ws: - end = _w(s, end).end() - nextchar = s[end:end + 1] - # Trivial empty object - if nextchar == '}': - return pairs, end + 1 - elif nextchar != '"': - raise ValueError(errmsg("Expecting property name", s, end)) - end += 1 - while True: - key, end = scanstring(s, end, encoding, strict) - - # To skip some function call overhead we optimize the fast paths where - # the JSON key separator is ": " or just ":". - if s[end:end + 1] != ':': - end = _w(s, end).end() - if s[end:end + 1] != ':': - raise ValueError(errmsg("Expecting : delimiter", s, end)) - - end += 1 - - try: - if s[end] in _ws: - end += 1 - if s[end] in _ws: - end = _w(s, end + 1).end() - except IndexError: - pass - - try: - value, end = scan_once(s, end) - except StopIteration: - raise ValueError(errmsg("Expecting object", s, end)) - pairs[key] = value - - try: - nextchar = s[end] - if nextchar in _ws: - end = _w(s, end + 1).end() - nextchar = s[end] - except IndexError: - nextchar = '' - end += 1 - - if nextchar == '}': - break - elif nextchar != ',': - raise ValueError(errmsg("Expecting , delimiter", s, end - 1)) - - try: - nextchar = s[end] - if nextchar in _ws: - end += 1 - nextchar = s[end] - if nextchar in _ws: - end = _w(s, end + 1).end() - nextchar = s[end] - except IndexError: - nextchar = '' - - end += 1 - if nextchar != '"': - raise ValueError(errmsg("Expecting property name", s, end - 1)) - - if object_hook is not None: - pairs = object_hook(pairs) - return pairs, end - -def JSONArray((s, end), scan_once, _w=WHITESPACE.match, _ws=WHITESPACE_STR): - values = [] - nextchar = s[end:end + 1] - if nextchar in _ws: - end = _w(s, end + 1).end() - nextchar = s[end:end + 1] - # Look-ahead for trivial empty array - if nextchar == ']': - return values, end + 1 - _append = values.append - while True: - try: - value, end = scan_once(s, end) - except StopIteration: - raise ValueError(errmsg("Expecting object", s, end)) - _append(value) - nextchar = s[end:end + 1] - if nextchar in _ws: - end = _w(s, end + 1).end() - nextchar = s[end:end + 1] - end += 1 - if nextchar == ']': - break - elif nextchar != ',': - raise ValueError(errmsg("Expecting , delimiter", s, end)) - - try: - if s[end] in _ws: - end += 1 - if s[end] in _ws: - end = _w(s, end + 1).end() - except IndexError: - pass - - return values, end - -class JSONDecoder(object): - """ - Simple JSON decoder - - Performs the following translations in decoding by default: - - +---------------+-------------------+ - | JSON | Python | - +===============+===================+ - | object | dict | - +---------------+-------------------+ - | array | list | - +---------------+-------------------+ - | string | unicode | - +---------------+-------------------+ - | number (int) | int, long | - +---------------+-------------------+ - | number (real) | float | - +---------------+-------------------+ - | true | True | - +---------------+-------------------+ - | false | False | - +---------------+-------------------+ - | null | None | - +---------------+-------------------+ - - It also understands ``NaN``, ``Infinity``, and ``-Infinity`` as - their corresponding ``float`` values, which is outside the JSON spec. - """ - - __all__ = ['__init__', 'decode', 'raw_decode'] - - def __init__(self, encoding=None, object_hook=None, parse_float=None, - parse_int=None, parse_constant=None, strict=True): - """ - ``encoding`` determines the encoding used to interpret any ``str`` - objects decoded by this instance (utf-8 by default). It has no - effect when decoding ``unicode`` objects. - - Note that currently only encodings that are a superset of ASCII work, - strings of other encodings should be passed in as ``unicode``. - - ``object_hook``, if specified, will be called with the result - of every JSON object decoded and its return value will be used in - place of the given ``dict``. This can be used to provide custom - deserializations (e.g. to support JSON-RPC class hinting). - - ``parse_float``, if specified, will be called with the string - of every JSON float to be decoded. By default this is equivalent to - float(num_str). This can be used to use another datatype or parser - for JSON floats (e.g. decimal.Decimal). - - ``parse_int``, if specified, will be called with the string - of every JSON int to be decoded. By default this is equivalent to - int(num_str). This can be used to use another datatype or parser - for JSON integers (e.g. float). - - ``parse_constant``, if specified, will be called with one of the - following strings: -Infinity, Infinity, NaN. - This can be used to raise an exception if invalid JSON numbers - are encountered. - """ - self.encoding = encoding - self.object_hook = object_hook - self.parse_float = parse_float or float - self.parse_int = parse_int or int - self.parse_constant = parse_constant or _CONSTANTS.__getitem__ - self.strict = strict - self.parse_object = JSONObject - self.parse_array = JSONArray - self.parse_string = scanstring - self.scan_once = make_scanner(self) - - def decode(self, s, _w=WHITESPACE.match): - """ - Return the Python representation of ``s`` (a ``str`` or ``unicode`` - instance containing a JSON document) - """ - obj, end = self.raw_decode(s, idx=_w(s, 0).end()) - end = _w(s, end).end() - if end != len(s): - raise ValueError(errmsg("Extra data", s, end, len(s))) - return obj - - def raw_decode(self, s, idx=0): - """ - Decode a JSON document from ``s`` (a ``str`` or ``unicode`` beginning - with a JSON document) and return a 2-tuple of the Python - representation and the index in ``s`` where the document ended. - - This can be used to decode a JSON document from a string that may - have extraneous data at the end. - """ - try: - obj, end = self.scan_once(s, idx) - except StopIteration: - raise ValueError("No JSON object could be decoded") - return obj, end - -__all__ = ['JSONDecoder'] diff --git a/subscriber/simplejson/encoder.py b/subscriber/simplejson/encoder.py deleted file mode 100644 index df23d22..0000000 --- a/subscriber/simplejson/encoder.py +++ /dev/null @@ -1,439 +0,0 @@ -""" -Implementation of JSONEncoder -""" -import re - -try: - from simplejson._speedups import encode_basestring_ascii as c_encode_basestring_ascii -except ImportError: - c_encode_basestring_ascii = None -try: - from simplejson._speedups import make_encoder as c_make_encoder -except ImportError: - c_make_encoder = None - -ESCAPE = re.compile(r'[\x00-\x1f\\"\b\f\n\r\t]') -ESCAPE_ASCII = re.compile(r'([\\"]|[^\ -~])') -HAS_UTF8 = re.compile(r'[\x80-\xff]') -ESCAPE_DCT = { - '\\': '\\\\', - '"': '\\"', - '\b': '\\b', - '\f': '\\f', - '\n': '\\n', - '\r': '\\r', - '\t': '\\t', -} -for i in range(0x20): - ESCAPE_DCT.setdefault(chr(i), '\\u%04x' % (i,)) - -# Assume this produces an infinity on all machines (probably not guaranteed) -INFINITY = float('1e66666') -FLOAT_REPR = repr - -def encode_basestring(s): - """ - Return a JSON representation of a Python string - """ - def replace(match): - return ESCAPE_DCT[match.group(0)] - return '"' + ESCAPE.sub(replace, s) + '"' - - -def py_encode_basestring_ascii(s): - if isinstance(s, str) and HAS_UTF8.search(s) is not None: - s = s.decode('utf-8') - def replace(match): - s = match.group(0) - try: - return ESCAPE_DCT[s] - except KeyError: - n = ord(s) - if n < 0x10000: - return '\\u%04x' % (n,) - else: - # surrogate pair - n -= 0x10000 - s1 = 0xd800 | ((n >> 10) & 0x3ff) - s2 = 0xdc00 | (n & 0x3ff) - return '\\u%04x\\u%04x' % (s1, s2) - return '"' + str(ESCAPE_ASCII.sub(replace, s)) + '"' - - -encode_basestring_ascii = c_encode_basestring_ascii or py_encode_basestring_ascii - -class JSONEncoder(object): - """ - Extensible JSON encoder for Python data structures. - - Supports the following objects and types by default: - - +-------------------+---------------+ - | Python | JSON | - +===================+===============+ - | dict | object | - +-------------------+---------------+ - | list, tuple | array | - +-------------------+---------------+ - | str, unicode | string | - +-------------------+---------------+ - | int, long, float | number | - +-------------------+---------------+ - | True | true | - +-------------------+---------------+ - | False | false | - +-------------------+---------------+ - | None | null | - +-------------------+---------------+ - - To extend this to recognize other objects, subclass and implement a - ``.default()`` method with another method that returns a serializable - object for ``o`` if possible, otherwise it should call the superclass - implementation (to raise ``TypeError``). - """ - __all__ = ['__init__', 'default', 'encode', 'iterencode'] - item_separator = ', ' - key_separator = ': ' - def __init__(self, skipkeys=False, ensure_ascii=True, - check_circular=True, allow_nan=True, sort_keys=False, - indent=None, separators=None, encoding='utf-8', default=None): - """ - Constructor for JSONEncoder, with sensible defaults. - - If skipkeys is False, then it is a TypeError to attempt - encoding of keys that are not str, int, long, float or None. If - skipkeys is True, such items are simply skipped. - - If ensure_ascii is True, the output is guaranteed to be str - objects with all incoming unicode characters escaped. If - ensure_ascii is false, the output will be unicode object. - - If check_circular is True, then lists, dicts, and custom encoded - objects will be checked for circular references during encoding to - prevent an infinite recursion (which would cause an OverflowError). - Otherwise, no such check takes place. - - If allow_nan is True, then NaN, Infinity, and -Infinity will be - encoded as such. This behavior is not JSON specification compliant, - but is consistent with most JavaScript based encoders and decoders. - Otherwise, it will be a ValueError to encode such floats. - - If sort_keys is True, then the output of dictionaries will be - sorted by key; this is useful for regression tests to ensure - that JSON serializations can be compared on a day-to-day basis. - - If indent is a non-negative integer, then JSON array - elements and object members will be pretty-printed with that - indent level. An indent level of 0 will only insert newlines. - None is the most compact representation. - - If specified, separators should be a (item_separator, key_separator) - tuple. The default is (', ', ': '). To get the most compact JSON - representation you should specify (',', ':') to eliminate whitespace. - - If specified, default is a function that gets called for objects - that can't otherwise be serialized. It should return a JSON encodable - version of the object or raise a ``TypeError``. - - If encoding is not None, then all input strings will be - transformed into unicode using that encoding prior to JSON-encoding. - The default is UTF-8. - """ - - self.skipkeys = skipkeys - self.ensure_ascii = ensure_ascii - self.check_circular = check_circular - self.allow_nan = allow_nan - self.sort_keys = sort_keys - self.indent = indent - if separators is not None: - self.item_separator, self.key_separator = separators - if default is not None: - self.default = default - self.encoding = encoding - - def default(self, o): - """ - Implement this method in a subclass such that it returns - a serializable object for ``o``, or calls the base implementation - (to raise a ``TypeError``). - - For example, to support arbitrary iterators, you could - implement default like this:: - - def default(self, o): - try: - iterable = iter(o) - except TypeError: - pass - else: - return list(iterable) - return JSONEncoder.default(self, o) - """ - raise TypeError("%r is not JSON serializable" % (o,)) - - def encode(self, o): - """ - Return a JSON string representation of a Python data structure. - - >>> JSONEncoder().encode({"foo": ["bar", "baz"]}) - '{"foo": ["bar", "baz"]}' - """ - # This is for extremely simple cases and benchmarks. - if isinstance(o, basestring): - if isinstance(o, str): - _encoding = self.encoding - if (_encoding is not None - and not (_encoding == 'utf-8')): - o = o.decode(_encoding) - if self.ensure_ascii: - return encode_basestring_ascii(o) - else: - return encode_basestring(o) - # This doesn't pass the iterator directly to ''.join() because the - # exceptions aren't as detailed. The list call should be roughly - # equivalent to the PySequence_Fast that ''.join() would do. - chunks = self.iterencode(o, _one_shot=True) - if not isinstance(chunks, (list, tuple)): - chunks = list(chunks) - return ''.join(chunks) - - def iterencode(self, o, _one_shot=False): - """ - Encode the given object and yield each string - representation as available. - - For example:: - - for chunk in JSONEncoder().iterencode(bigobject): - mysocket.write(chunk) - """ - if self.check_circular: - markers = {} - else: - markers = None - if self.ensure_ascii: - _encoder = encode_basestring_ascii - else: - _encoder = encode_basestring - if self.encoding != 'utf-8': - def _encoder(o, _orig_encoder=_encoder, _encoding=self.encoding): - if isinstance(o, str): - o = o.decode(_encoding) - return _orig_encoder(o) - - def floatstr(o, allow_nan=self.allow_nan, _repr=FLOAT_REPR, _inf=INFINITY, _neginf=-INFINITY): - # Check for specials. Note that this type of test is processor- and/or - # platform-specific, so do tests which don't depend on the internals. - - if o != o: - text = 'NaN' - elif o == _inf: - text = 'Infinity' - elif o == _neginf: - text = '-Infinity' - else: - return _repr(o) - - if not allow_nan: - raise ValueError("Out of range float values are not JSON compliant: %r" - % (o,)) - - return text - - - if _one_shot and c_make_encoder is not None and not self.indent and not self.sort_keys: - _iterencode = c_make_encoder( - markers, self.default, _encoder, self.indent, - self.key_separator, self.item_separator, self.sort_keys, - self.skipkeys, self.allow_nan) - else: - _iterencode = _make_iterencode( - markers, self.default, _encoder, self.indent, floatstr, - self.key_separator, self.item_separator, self.sort_keys, - self.skipkeys, _one_shot) - return _iterencode(o, 0) - -def _make_iterencode(markers, _default, _encoder, _indent, _floatstr, _key_separator, _item_separator, _sort_keys, _skipkeys, _one_shot, - ## HACK: hand-optimized bytecode; turn globals into locals - False=False, - True=True, - ValueError=ValueError, - basestring=basestring, - dict=dict, - float=float, - id=id, - int=int, - isinstance=isinstance, - list=list, - long=long, - str=str, - tuple=tuple, - ): - - def _iterencode_list(lst, _current_indent_level): - if not lst: - yield '[]' - return - if markers is not None: - markerid = id(lst) - if markerid in markers: - raise ValueError("Circular reference detected") - markers[markerid] = lst - buf = '[' - if _indent is not None: - _current_indent_level += 1 - newline_indent = '\n' + (' ' * (_indent * _current_indent_level)) - separator = _item_separator + newline_indent - buf += newline_indent - else: - newline_indent = None - separator = _item_separator - first = True - for value in lst: - if first: - first = False - else: - buf = separator - if isinstance(value, basestring): - yield buf + _encoder(value) - elif value is None: - yield buf + 'null' - elif value is True: - yield buf + 'true' - elif value is False: - yield buf + 'false' - elif isinstance(value, (int, long)): - yield buf + str(value) - elif isinstance(value, float): - yield buf + _floatstr(value) - else: - yield buf - if isinstance(value, (list, tuple)): - chunks = _iterencode_list(value, _current_indent_level) - elif isinstance(value, dict): - chunks = _iterencode_dict(value, _current_indent_level) - else: - chunks = _iterencode(value, _current_indent_level) - for chunk in chunks: - yield chunk - if newline_indent is not None: - _current_indent_level -= 1 - yield '\n' + (' ' * (_indent * _current_indent_level)) - yield ']' - if markers is not None: - del markers[markerid] - - def _iterencode_dict(dct, _current_indent_level): - if not dct: - yield '{}' - return - if markers is not None: - markerid = id(dct) - if markerid in markers: - raise ValueError("Circular reference detected") - markers[markerid] = dct - yield '{' - if _indent is not None: - _current_indent_level += 1 - newline_indent = '\n' + (' ' * (_indent * _current_indent_level)) - item_separator = _item_separator + newline_indent - yield newline_indent - else: - newline_indent = None - item_separator = _item_separator - first = True - if _sort_keys: - items = dct.items() - items.sort(key=lambda kv: kv[0]) - else: - items = dct.iteritems() - for key, value in items: - if isinstance(key, basestring): - pass - # JavaScript is weakly typed for these, so it makes sense to - # also allow them. Many encoders seem to do something like this. - elif isinstance(key, float): - key = _floatstr(key) - elif isinstance(key, (int, long)): - key = str(key) - elif key is True: - key = 'true' - elif key is False: - key = 'false' - elif key is None: - key = 'null' - elif _skipkeys: - continue - else: - raise TypeError("key %r is not a string" % (key,)) - if first: - first = False - else: - yield item_separator - yield _encoder(key) - yield _key_separator - if isinstance(value, basestring): - yield _encoder(value) - elif value is None: - yield 'null' - elif value is True: - yield 'true' - elif value is False: - yield 'false' - elif isinstance(value, (int, long)): - yield str(value) - elif isinstance(value, float): - yield _floatstr(value) - else: - if isinstance(value, (list, tuple)): - chunks = _iterencode_list(value, _current_indent_level) - elif isinstance(value, dict): - chunks = _iterencode_dict(value, _current_indent_level) - else: - chunks = _iterencode(value, _current_indent_level) - for chunk in chunks: - yield chunk - if newline_indent is not None: - _current_indent_level -= 1 - yield '\n' + (' ' * (_indent * _current_indent_level)) - yield '}' - if markers is not None: - del markers[markerid] - - def _iterencode(o, _current_indent_level): - if isinstance(o, basestring): - yield _encoder(o) - elif o is None: - yield 'null' - elif o is True: - yield 'true' - elif o is False: - yield 'false' - elif isinstance(o, (int, long)): - yield str(o) - elif isinstance(o, float): - yield _floatstr(o) - elif isinstance(o, (list, tuple)): - for chunk in _iterencode_list(o, _current_indent_level): - yield chunk - elif isinstance(o, dict): - for chunk in _iterencode_dict(o, _current_indent_level): - yield chunk - else: - if markers is not None: - markerid = id(o) - if markerid in markers: - raise ValueError("Circular reference detected") - markers[markerid] = o - o = _default(o) - for chunk in _iterencode(o, _current_indent_level): - yield chunk - if markers is not None: - del markers[markerid] - - return _iterencode - - - -__all__ = ['JSONEncoder'] diff --git a/subscriber/simplejson/scanner.py b/subscriber/simplejson/scanner.py deleted file mode 100644 index 1bcbcdd..0000000 --- a/subscriber/simplejson/scanner.py +++ /dev/null @@ -1,66 +0,0 @@ -""" -JSON token scanner -""" -import re -try: - from simplejson._speedups import make_scanner as c_make_scanner -except ImportError: - c_make_scanner = None - -__all__ = ['make_scanner'] - -NUMBER_RE = re.compile( - r'(-?(?:0|[1-9]\d*))(\.\d+)?([eE][-+]?\d+)?', - (re.VERBOSE | re.MULTILINE | re.DOTALL)) - -def py_make_scanner(context): - parse_object = context.parse_object - parse_array = context.parse_array - parse_string = context.parse_string - match_number = NUMBER_RE.match - encoding = context.encoding - strict = context.strict - parse_float = context.parse_float - parse_int = context.parse_int - parse_constant = context.parse_constant - object_hook = context.object_hook - - def _scan_once(string, idx): - try: - nextchar = string[idx] - except IndexError: - raise StopIteration - - if nextchar == '"': - return parse_string(string, idx + 1, encoding, strict) - elif nextchar == '{': - return parse_object((string, idx + 1), encoding, strict, _scan_once, object_hook) - elif nextchar == '[': - return parse_array((string, idx + 1), _scan_once) - elif nextchar == 'n' and string[idx:idx + 4] == 'null': - return None, idx + 4 - elif nextchar == 't' and string[idx:idx + 4] == 'true': - return True, idx + 4 - elif nextchar == 'f' and string[idx:idx + 5] == 'false': - return False, idx + 5 - - m = match_number(string, idx) - if m is not None: - integer, frac, exp = m.groups() - if frac or exp: - res = parse_float(integer + (frac or '') + (exp or '')) - else: - res = parse_int(integer) - return res, m.end() - elif nextchar == 'N' and string[idx:idx + 3] == 'NaN': - return parse_constant('NaN'), idx + 3 - elif nextchar == 'I' and string[idx:idx + 8] == 'Infinity': - return parse_constant('Infinity'), idx + 8 - elif nextchar == '-' and string[idx:idx + 9] == '-Infinity': - return parse_constant('-Infinity'), idx + 9 - else: - raise StopIteration - - return _scan_once - -make_scanner = c_make_scanner or py_make_scanner \ No newline at end of file diff --git a/subscriber/simplejson/tests/__init__.py b/subscriber/simplejson/tests/__init__.py deleted file mode 100644 index 17c9796..0000000 --- a/subscriber/simplejson/tests/__init__.py +++ /dev/null @@ -1,23 +0,0 @@ -import unittest -import doctest - -def additional_tests(): - import simplejson - import simplejson.encoder - import simplejson.decoder - suite = unittest.TestSuite() - for mod in (simplejson, simplejson.encoder, simplejson.decoder): - suite.addTest(doctest.DocTestSuite(mod)) - suite.addTest(doctest.DocFileSuite('../../index.rst')) - return suite - -def main(): - suite = additional_tests() - runner = unittest.TextTestRunner() - runner.run(suite) - -if __name__ == '__main__': - import os - import sys - sys.path.insert(0, os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__))))) - main() diff --git a/subscriber/simplejson/tests/test_decode.py b/subscriber/simplejson/tests/test_decode.py deleted file mode 100644 index 4db5ec6..0000000 --- a/subscriber/simplejson/tests/test_decode.py +++ /dev/null @@ -1,22 +0,0 @@ -import decimal -from unittest import TestCase - -import simplejson as S - -class TestDecode(TestCase): - def test_decimal(self): - rval = S.loads('1.1', parse_float=decimal.Decimal) - self.assert_(isinstance(rval, decimal.Decimal)) - self.assertEquals(rval, decimal.Decimal('1.1')) - - def test_float(self): - rval = S.loads('1', parse_int=float) - self.assert_(isinstance(rval, float)) - self.assertEquals(rval, 1.0) - - def test_decoder_optimizations(self): - # Several optimizations were made that skip over calls to - # the whitespace regex, so this test is designed to try and - # exercise the uncommon cases. The array cases are already covered. - rval = S.loads('{ "key" : "value" , "k":"v" }') - self.assertEquals(rval, {"key":"value", "k":"v"}) diff --git a/subscriber/simplejson/tests/test_default.py b/subscriber/simplejson/tests/test_default.py deleted file mode 100644 index d4936e3..0000000 --- a/subscriber/simplejson/tests/test_default.py +++ /dev/null @@ -1,9 +0,0 @@ -from unittest import TestCase - -import simplejson as S - -class TestDefault(TestCase): - def test_default(self): - self.assertEquals( - S.dumps(type, default=repr), - S.dumps(repr(type))) diff --git a/subscriber/simplejson/tests/test_dump.py b/subscriber/simplejson/tests/test_dump.py deleted file mode 100644 index 04a17bf..0000000 --- a/subscriber/simplejson/tests/test_dump.py +++ /dev/null @@ -1,13 +0,0 @@ -from unittest import TestCase -from cStringIO import StringIO - -import simplejson as S - -class TestDump(TestCase): - def test_dump(self): - sio = StringIO() - S.dump({}, sio) - self.assertEquals(sio.getvalue(), '{}') - - def test_dumps(self): - self.assertEquals(S.dumps({}), '{}') diff --git a/subscriber/simplejson/tests/test_encode_basestring_ascii.py b/subscriber/simplejson/tests/test_encode_basestring_ascii.py deleted file mode 100644 index 7128495..0000000 --- a/subscriber/simplejson/tests/test_encode_basestring_ascii.py +++ /dev/null @@ -1,38 +0,0 @@ -from unittest import TestCase - -import simplejson.encoder - -CASES = [ - (u'/\\"\ucafe\ubabe\uab98\ufcde\ubcda\uef4a\x08\x0c\n\r\t`1~!@#$%^&*()_+-=[]{}|;:\',./<>?', '"/\\\\\\"\\ucafe\\ubabe\\uab98\\ufcde\\ubcda\\uef4a\\b\\f\\n\\r\\t`1~!@#$%^&*()_+-=[]{}|;:\',./<>?"'), - (u'\u0123\u4567\u89ab\ucdef\uabcd\uef4a', '"\\u0123\\u4567\\u89ab\\ucdef\\uabcd\\uef4a"'), - (u'controls', '"controls"'), - (u'\x08\x0c\n\r\t', '"\\b\\f\\n\\r\\t"'), - (u'{"object with 1 member":["array with 1 element"]}', '"{\\"object with 1 member\\":[\\"array with 1 element\\"]}"'), - (u' s p a c e d ', '" s p a c e d "'), - (u'\U0001d120', '"\\ud834\\udd20"'), - (u'\u03b1\u03a9', '"\\u03b1\\u03a9"'), - ('\xce\xb1\xce\xa9', '"\\u03b1\\u03a9"'), - (u'\u03b1\u03a9', '"\\u03b1\\u03a9"'), - ('\xce\xb1\xce\xa9', '"\\u03b1\\u03a9"'), - (u'\u03b1\u03a9', '"\\u03b1\\u03a9"'), - (u'\u03b1\u03a9', '"\\u03b1\\u03a9"'), - (u"`1~!@#$%^&*()_+-={':[,]}|;.?", '"`1~!@#$%^&*()_+-={\':[,]}|;.?"'), - (u'\x08\x0c\n\r\t', '"\\b\\f\\n\\r\\t"'), - (u'\u0123\u4567\u89ab\ucdef\uabcd\uef4a', '"\\u0123\\u4567\\u89ab\\ucdef\\uabcd\\uef4a"'), -] - -class TestEncodeBaseStringAscii(TestCase): - def test_py_encode_basestring_ascii(self): - self._test_encode_basestring_ascii(simplejson.encoder.py_encode_basestring_ascii) - - def test_c_encode_basestring_ascii(self): - if not simplejson.encoder.c_encode_basestring_ascii: - return - self._test_encode_basestring_ascii(simplejson.encoder.c_encode_basestring_ascii) - - def _test_encode_basestring_ascii(self, encode_basestring_ascii): - fname = encode_basestring_ascii.__name__ - for input_string, expect in CASES: - result = encode_basestring_ascii(input_string) - self.assertEquals(result, expect, - '%r != %r for %s(%r)' % (result, expect, fname, input_string)) diff --git a/subscriber/simplejson/tests/test_fail.py b/subscriber/simplejson/tests/test_fail.py deleted file mode 100644 index fba7449..0000000 --- a/subscriber/simplejson/tests/test_fail.py +++ /dev/null @@ -1,76 +0,0 @@ -from unittest import TestCase - -import simplejson as S - -# Fri Dec 30 18:57:26 2005 -JSONDOCS = [ - # http://json.org/JSON_checker/test/fail1.json - '"A JSON payload should be an object or array, not a string."', - # http://json.org/JSON_checker/test/fail2.json - '["Unclosed array"', - # http://json.org/JSON_checker/test/fail3.json - '{unquoted_key: "keys must be quoted}', - # http://json.org/JSON_checker/test/fail4.json - '["extra comma",]', - # http://json.org/JSON_checker/test/fail5.json - '["double extra comma",,]', - # http://json.org/JSON_checker/test/fail6.json - '[ , "<-- missing value"]', - # http://json.org/JSON_checker/test/fail7.json - '["Comma after the close"],', - # http://json.org/JSON_checker/test/fail8.json - '["Extra close"]]', - # http://json.org/JSON_checker/test/fail9.json - '{"Extra comma": true,}', - # http://json.org/JSON_checker/test/fail10.json - '{"Extra value after close": true} "misplaced quoted value"', - # http://json.org/JSON_checker/test/fail11.json - '{"Illegal expression": 1 + 2}', - # http://json.org/JSON_checker/test/fail12.json - '{"Illegal invocation": alert()}', - # http://json.org/JSON_checker/test/fail13.json - '{"Numbers cannot have leading zeroes": 013}', - # http://json.org/JSON_checker/test/fail14.json - '{"Numbers cannot be hex": 0x14}', - # http://json.org/JSON_checker/test/fail15.json - '["Illegal backslash escape: \\x15"]', - # http://json.org/JSON_checker/test/fail16.json - '["Illegal backslash escape: \\\'"]', - # http://json.org/JSON_checker/test/fail17.json - '["Illegal backslash escape: \\017"]', - # http://json.org/JSON_checker/test/fail18.json - '[[[[[[[[[[[[[[[[[[[["Too deep"]]]]]]]]]]]]]]]]]]]]', - # http://json.org/JSON_checker/test/fail19.json - '{"Missing colon" null}', - # http://json.org/JSON_checker/test/fail20.json - '{"Double colon":: null}', - # http://json.org/JSON_checker/test/fail21.json - '{"Comma instead of colon", null}', - # http://json.org/JSON_checker/test/fail22.json - '["Colon instead of comma": false]', - # http://json.org/JSON_checker/test/fail23.json - '["Bad value", truth]', - # http://json.org/JSON_checker/test/fail24.json - "['single quote']", - # http://code.google.com/p/simplejson/issues/detail?id=3 - u'["A\u001FZ control characters in string"]', -] - -SKIPS = { - 1: "why not have a string payload?", - 18: "spec doesn't specify any nesting limitations", -} - -class TestFail(TestCase): - def test_failures(self): - for idx, doc in enumerate(JSONDOCS): - idx = idx + 1 - if idx in SKIPS: - S.loads(doc) - continue - try: - S.loads(doc) - except ValueError: - pass - else: - self.fail("Expected failure for fail%d.json: %r" % (idx, doc)) diff --git a/subscriber/simplejson/tests/test_float.py b/subscriber/simplejson/tests/test_float.py deleted file mode 100644 index 09a1a08..0000000 --- a/subscriber/simplejson/tests/test_float.py +++ /dev/null @@ -1,14 +0,0 @@ -import math -from unittest import TestCase - -import simplejson as S - -class TestFloat(TestCase): - def test_floats(self): - for num in [1617161771.7650001, math.pi, math.pi**100, math.pi**-100]: - self.assertEquals(float(S.dumps(num)), num) - - def test_ints(self): - for num in [1, 1L, 1<<32, 1<<64]: - self.assertEquals(S.dumps(num), str(num)) - self.assertEquals(int(S.dumps(num)), num) diff --git a/subscriber/simplejson/tests/test_indent.py b/subscriber/simplejson/tests/test_indent.py deleted file mode 100644 index a430e15..0000000 --- a/subscriber/simplejson/tests/test_indent.py +++ /dev/null @@ -1,41 +0,0 @@ -from unittest import TestCase - -import simplejson as S -import textwrap - -class TestIndent(TestCase): - def test_indent(self): - h = [['blorpie'], ['whoops'], [], 'd-shtaeou', 'd-nthiouh', 'i-vhbjkhnth', - {'nifty': 87}, {'field': 'yes', 'morefield': False} ] - - expect = textwrap.dedent("""\ - [ - [ - "blorpie" - ], - [ - "whoops" - ], - [], - "d-shtaeou", - "d-nthiouh", - "i-vhbjkhnth", - { - "nifty": 87 - }, - { - "field": "yes", - "morefield": false - } - ]""") - - - d1 = S.dumps(h) - d2 = S.dumps(h, indent=2, sort_keys=True, separators=(',', ': ')) - - h1 = S.loads(d1) - h2 = S.loads(d2) - - self.assertEquals(h1, h) - self.assertEquals(h2, h) - self.assertEquals(d2, expect) diff --git a/subscriber/simplejson/tests/test_pass1.py b/subscriber/simplejson/tests/test_pass1.py deleted file mode 100644 index 591a18b..0000000 --- a/subscriber/simplejson/tests/test_pass1.py +++ /dev/null @@ -1,76 +0,0 @@ -from unittest import TestCase - -import simplejson as S - -# from http://json.org/JSON_checker/test/pass1.json -JSON = r''' -[ - "JSON Test Pattern pass1", - {"object with 1 member":["array with 1 element"]}, - {}, - [], - -42, - true, - false, - null, - { - "integer": 1234567890, - "real": -9876.543210, - "e": 0.123456789e-12, - "E": 1.234567890E+34, - "": 23456789012E666, - "zero": 0, - "one": 1, - "space": " ", - "quote": "\"", - "backslash": "\\", - "controls": "\b\f\n\r\t", - "slash": "/ & \/", - "alpha": "abcdefghijklmnopqrstuvwyz", - "ALPHA": "ABCDEFGHIJKLMNOPQRSTUVWYZ", - "digit": "0123456789", - "special": "`1~!@#$%^&*()_+-={':[,]}|;.?", - "hex": "\u0123\u4567\u89AB\uCDEF\uabcd\uef4A", - "true": true, - "false": false, - "null": null, - "array":[ ], - "object":{ }, - "address": "50 St. James Street", - "url": "http://www.JSON.org/", - "comment": "// /* */": " ", - " s p a c e d " :[1,2 , 3 - -, - -4 , 5 , 6 ,7 ], - "compact": [1,2,3,4,5,6,7], - "jsontext": "{\"object with 1 member\":[\"array with 1 element\"]}", - "quotes": "" \u0022 %22 0x22 034 "", - "\/\\\"\uCAFE\uBABE\uAB98\uFCDE\ubcda\uef4A\b\f\n\r\t`1~!@#$%^&*()_+-=[]{}|;:',./<>?" -: "A key can be any string" - }, - 0.5 ,98.6 -, -99.44 -, - -1066 - - -,"rosebud"] -''' - -class TestPass1(TestCase): - def test_parse(self): - # test in/out equivalence and parsing - res = S.loads(JSON) - out = S.dumps(res) - self.assertEquals(res, S.loads(out)) - try: - S.dumps(res, allow_nan=False) - except ValueError: - pass - else: - self.fail("23456789012E666 should be out of range") diff --git a/subscriber/simplejson/tests/test_pass2.py b/subscriber/simplejson/tests/test_pass2.py deleted file mode 100644 index 8cc74e8..0000000 --- a/subscriber/simplejson/tests/test_pass2.py +++ /dev/null @@ -1,14 +0,0 @@ -from unittest import TestCase -import simplejson as S - -# from http://json.org/JSON_checker/test/pass2.json -JSON = r''' -[[[[[[[[[[[[[[[[[[["Not too deep"]]]]]]]]]]]]]]]]]]] -''' - -class TestPass2(TestCase): - def test_parse(self): - # test in/out equivalence and parsing - res = S.loads(JSON) - out = S.dumps(res) - self.assertEquals(res, S.loads(out)) diff --git a/subscriber/simplejson/tests/test_pass3.py b/subscriber/simplejson/tests/test_pass3.py deleted file mode 100644 index 017ea8e..0000000 --- a/subscriber/simplejson/tests/test_pass3.py +++ /dev/null @@ -1,20 +0,0 @@ -from unittest import TestCase - -import simplejson as S - -# from http://json.org/JSON_checker/test/pass3.json -JSON = r''' -{ - "JSON Test Pattern pass3": { - "The outermost value": "must be an object or array.", - "In this test": "It is an object." - } -} -''' - -class TestPass3(TestCase): - def test_parse(self): - # test in/out equivalence and parsing - res = S.loads(JSON) - out = S.dumps(res) - self.assertEquals(res, S.loads(out)) diff --git a/subscriber/simplejson/tests/test_recursion.py b/subscriber/simplejson/tests/test_recursion.py deleted file mode 100644 index d8ffbd5..0000000 --- a/subscriber/simplejson/tests/test_recursion.py +++ /dev/null @@ -1,65 +0,0 @@ -from unittest import TestCase - -import simplejson as S - -class JSONTestObject: - pass - -class RecursiveJSONEncoder(S.JSONEncoder): - recurse = False - def default(self, o): - if o is JSONTestObject: - if self.recurse: - return [JSONTestObject] - else: - return 'JSONTestObject' - return S.JSONEncoder.default(o) - -class TestRecursion(TestCase): - def test_listrecursion(self): - x = [] - x.append(x) - try: - S.dumps(x) - except ValueError: - pass - else: - self.fail("didn't raise ValueError on list recursion") - x = [] - y = [x] - x.append(y) - try: - S.dumps(x) - except ValueError: - pass - else: - self.fail("didn't raise ValueError on alternating list recursion") - y = [] - x = [y, y] - # ensure that the marker is cleared - S.dumps(x) - - def test_dictrecursion(self): - x = {} - x["test"] = x - try: - S.dumps(x) - except ValueError: - pass - else: - self.fail("didn't raise ValueError on dict recursion") - x = {} - y = {"a": x, "b": x} - # ensure that the marker is cleared - S.dumps(x) - - def test_defaultrecursion(self): - enc = RecursiveJSONEncoder() - self.assertEquals(enc.encode(JSONTestObject), '"JSONTestObject"') - enc.recurse = True - try: - enc.encode(JSONTestObject) - except ValueError: - pass - else: - self.fail("didn't raise ValueError on default recursion") diff --git a/subscriber/simplejson/tests/test_scanstring.py b/subscriber/simplejson/tests/test_scanstring.py deleted file mode 100644 index 995176d..0000000 --- a/subscriber/simplejson/tests/test_scanstring.py +++ /dev/null @@ -1,104 +0,0 @@ -import sys -import decimal -from unittest import TestCase - -import simplejson.decoder - -class TestScanString(TestCase): - def test_py_scanstring(self): - self._test_scanstring(simplejson.decoder.py_scanstring) - - def test_c_scanstring(self): - if not simplejson.decoder.c_scanstring: - return - self._test_scanstring(simplejson.decoder.c_scanstring) - - def _test_scanstring(self, scanstring): - self.assertEquals( - scanstring('"z\\ud834\\udd20x"', 1, None, True), - (u'z\U0001d120x', 16)) - - if sys.maxunicode == 65535: - self.assertEquals( - scanstring(u'"z\U0001d120x"', 1, None, True), - (u'z\U0001d120x', 6)) - else: - self.assertEquals( - scanstring(u'"z\U0001d120x"', 1, None, True), - (u'z\U0001d120x', 5)) - - self.assertEquals( - scanstring('"\\u007b"', 1, None, True), - (u'{', 8)) - - self.assertEquals( - scanstring('"A JSON payload should be an object or array, not a string."', 1, None, True), - (u'A JSON payload should be an object or array, not a string.', 60)) - - self.assertEquals( - scanstring('["Unclosed array"', 2, None, True), - (u'Unclosed array', 17)) - - self.assertEquals( - scanstring('["extra comma",]', 2, None, True), - (u'extra comma', 14)) - - self.assertEquals( - scanstring('["double extra comma",,]', 2, None, True), - (u'double extra comma', 21)) - - self.assertEquals( - scanstring('["Comma after the close"],', 2, None, True), - (u'Comma after the close', 24)) - - self.assertEquals( - scanstring('["Extra close"]]', 2, None, True), - (u'Extra close', 14)) - - self.assertEquals( - scanstring('{"Extra comma": true,}', 2, None, True), - (u'Extra comma', 14)) - - self.assertEquals( - scanstring('{"Extra value after close": true} "misplaced quoted value"', 2, None, True), - (u'Extra value after close', 26)) - - self.assertEquals( - scanstring('{"Illegal expression": 1 + 2}', 2, None, True), - (u'Illegal expression', 21)) - - self.assertEquals( - scanstring('{"Illegal invocation": alert()}', 2, None, True), - (u'Illegal invocation', 21)) - - self.assertEquals( - scanstring('{"Numbers cannot have leading zeroes": 013}', 2, None, True), - (u'Numbers cannot have leading zeroes', 37)) - - self.assertEquals( - scanstring('{"Numbers cannot be hex": 0x14}', 2, None, True), - (u'Numbers cannot be hex', 24)) - - self.assertEquals( - scanstring('[[[[[[[[[[[[[[[[[[[["Too deep"]]]]]]]]]]]]]]]]]]]]', 21, None, True), - (u'Too deep', 30)) - - self.assertEquals( - scanstring('{"Missing colon" null}', 2, None, True), - (u'Missing colon', 16)) - - self.assertEquals( - scanstring('{"Double colon":: null}', 2, None, True), - (u'Double colon', 15)) - - self.assertEquals( - scanstring('{"Comma instead of colon", null}', 2, None, True), - (u'Comma instead of colon', 25)) - - self.assertEquals( - scanstring('["Colon instead of comma": false]', 2, None, True), - (u'Colon instead of comma', 25)) - - self.assertEquals( - scanstring('["Bad value", truth]', 2, None, True), - (u'Bad value', 12)) diff --git a/subscriber/simplejson/tests/test_separators.py b/subscriber/simplejson/tests/test_separators.py deleted file mode 100644 index 4506c95..0000000 --- a/subscriber/simplejson/tests/test_separators.py +++ /dev/null @@ -1,42 +0,0 @@ -import textwrap -from unittest import TestCase - -import simplejson as S - - -class TestSeparators(TestCase): - def test_separators(self): - h = [['blorpie'], ['whoops'], [], 'd-shtaeou', 'd-nthiouh', 'i-vhbjkhnth', - {'nifty': 87}, {'field': 'yes', 'morefield': False} ] - - expect = textwrap.dedent("""\ - [ - [ - "blorpie" - ] , - [ - "whoops" - ] , - [] , - "d-shtaeou" , - "d-nthiouh" , - "i-vhbjkhnth" , - { - "nifty" : 87 - } , - { - "field" : "yes" , - "morefield" : false - } - ]""") - - - d1 = S.dumps(h) - d2 = S.dumps(h, indent=2, sort_keys=True, separators=(' ,', ' : ')) - - h1 = S.loads(d1) - h2 = S.loads(d2) - - self.assertEquals(h1, h) - self.assertEquals(h2, h) - self.assertEquals(d2, expect) diff --git a/subscriber/simplejson/tests/test_unicode.py b/subscriber/simplejson/tests/test_unicode.py deleted file mode 100644 index ff50c12..0000000 --- a/subscriber/simplejson/tests/test_unicode.py +++ /dev/null @@ -1,59 +0,0 @@ -from unittest import TestCase - -import simplejson as S - -class TestUnicode(TestCase): - def test_encoding1(self): - encoder = S.JSONEncoder(encoding='utf-8') - u = u'\N{GREEK SMALL LETTER ALPHA}\N{GREEK CAPITAL LETTER OMEGA}' - s = u.encode('utf-8') - ju = encoder.encode(u) - js = encoder.encode(s) - self.assertEquals(ju, js) - - def test_encoding2(self): - u = u'\N{GREEK SMALL LETTER ALPHA}\N{GREEK CAPITAL LETTER OMEGA}' - s = u.encode('utf-8') - ju = S.dumps(u, encoding='utf-8') - js = S.dumps(s, encoding='utf-8') - self.assertEquals(ju, js) - - def test_encoding3(self): - u = u'\N{GREEK SMALL LETTER ALPHA}\N{GREEK CAPITAL LETTER OMEGA}' - j = S.dumps(u) - self.assertEquals(j, '"\\u03b1\\u03a9"') - - def test_encoding4(self): - u = u'\N{GREEK SMALL LETTER ALPHA}\N{GREEK CAPITAL LETTER OMEGA}' - j = S.dumps([u]) - self.assertEquals(j, '["\\u03b1\\u03a9"]') - - def test_encoding5(self): - u = u'\N{GREEK SMALL LETTER ALPHA}\N{GREEK CAPITAL LETTER OMEGA}' - j = S.dumps(u, ensure_ascii=False) - self.assertEquals(j, u'"%s"' % (u,)) - - def test_encoding6(self): - u = u'\N{GREEK SMALL LETTER ALPHA}\N{GREEK CAPITAL LETTER OMEGA}' - j = S.dumps([u], ensure_ascii=False) - self.assertEquals(j, u'["%s"]' % (u,)) - - def test_big_unicode_encode(self): - u = u'\U0001d120' - self.assertEquals(S.dumps(u), '"\\ud834\\udd20"') - self.assertEquals(S.dumps(u, ensure_ascii=False), u'"\U0001d120"') - - def test_big_unicode_decode(self): - u = u'z\U0001d120x' - self.assertEquals(S.loads('"' + u + '"'), u) - self.assertEquals(S.loads('"z\\ud834\\udd20x"'), u) - - def test_unicode_decode(self): - for i in range(0, 0xd7ff): - u = unichr(i) - json = '"\\u%04x"' % (i,) - self.assertEquals(S.loads(json), u) - - def test_default_encoding(self): - self.assertEquals(S.loads(u'{"a": "\xe9"}'.encode('utf-8')), - {'a': u'\xe9'}) diff --git a/subscriber/simplejson/tool.py b/subscriber/simplejson/tool.py deleted file mode 100644 index caa1818..0000000 --- a/subscriber/simplejson/tool.py +++ /dev/null @@ -1,44 +0,0 @@ -r""" -Using simplejson from the shell to validate and -pretty-print:: - - $ echo '{"json":"obj"}' | python -msimplejson - { - "json": "obj" - } - $ echo '{ 1.2:3.4}' | python -msimplejson - Expecting property name: line 1 column 2 (char 2) - -Note that the JSON produced by this module's default settings -is a subset of YAML, so it may be used as a serializer for that as well. -""" -import simplejson - -# -# Pretty printer: -# curl http://mochikit.com/examples/ajax_tables/domains.json | python -msimplejson.tool -# - -def main(): - import sys - if len(sys.argv) == 1: - infile = sys.stdin - outfile = sys.stdout - elif len(sys.argv) == 2: - infile = open(sys.argv[1], 'rb') - outfile = sys.stdout - elif len(sys.argv) == 3: - infile = open(sys.argv[1], 'rb') - outfile = open(sys.argv[2], 'wb') - else: - raise SystemExit("%s [infile [outfile]]" % (sys.argv[0],)) - try: - obj = simplejson.load(infile) - except ValueError, e: - raise SystemExit(e) - simplejson.dump(obj, outfile, sort_keys=True, indent=4) - outfile.write('\n') - - -if __name__ == '__main__': - main() diff --git a/subscriber/static/agg.js b/subscriber/static/agg.js deleted file mode 100644 index c3aa253..0000000 --- a/subscriber/static/agg.js +++ /dev/null @@ -1,36 +0,0 @@ -function showStuff() { - var req = new XMLHttpRequest(); - req.open("GET", "/items", true); - req.onreadystatechange = function() { - if (req.readyState != 4) { - return; - } - gotStuff(req.status, req.responseText); - }; - req.send(null); -} - -function gotStuff(status, text) { - if (status != 200) { - window.setTimeout(showStuff, 5000); - return; - } - - var content = ""; - var items = eval(text); - if (items.length == 0) { - content = "Nothing yet.\n" - } else { - for (var i = 0; i < items.length; ++i) { - content += "
" + items[i].title + - " at " + items[i].time + "
" + - "
" + items[i].content + "
\n"; - } - } - - document.getElementById("content").innerHTML = content; - window.setTimeout(showStuff, 5000); -} - -window.onload = showStuff; diff --git a/subscriber/subscriber.html b/subscriber/subscriber.html deleted file mode 100644 index 3647d1d..0000000 --- a/subscriber/subscriber.html +++ /dev/null @@ -1,35 +0,0 @@ - - - Subscriber - - - - - -

Subscriber aggregation page

- -
-{% if not entries %} -Nothing yet. -{% else %} -{% for entry in entries %} -
-
- {% if entry.title %}{{entry.title}}{% else %}No title{% endif %} - at {{entry.updated}} - {% if entry.link %} - - {% endif %} -
-
- {% if entry.content %}{{entry.content}}{% else %}No content{% endif %} -
-
-{% endfor %} -{% endif %} -
- - - diff --git a/subscriber_clients/php/example.php b/subscriber_clients/php/example.php deleted file mode 100644 index c247676..0000000 --- a/subscriber_clients/php/example.php +++ /dev/null @@ -1,25 +0,0 @@ -subscribe($feed); - -// unsubscribe from a feed -$s->unsubscribe($feed); - -?> - diff --git a/subscriber_clients/php/subscriber.php b/subscriber_clients/php/subscriber.php deleted file mode 100644 index 139ec27..0000000 --- a/subscriber_clients/php/subscriber.php +++ /dev/null @@ -1,120 +0,0 @@ -hub_url = $hub_url; - $this->callback_url = $callback_url; - $this->credentials = $credentials; - } - - // $use_regexp lets you choose whether to use google AJAX feed api (faster, but cached) or a regexp to read from site - public function find_feed($url, $http_function = false) { - // using google feed API - $url = "http://ajax.googleapis.com/ajax/services/feed/lookup?key={$this->google_key}&v=1.0&q=".urlencode($url); - // fetch the content - if ($http_function) - $response = $http_function($url); - else - $response = $this->http($url); - - $result = json_decode($response, true); - $rss_url = $result['responseData']['url']; - return $rss_url; - } - - public function subscribe($topic_url, $http_function = false) { - return $this->change_subscription("subscribe", $topic_url, $http_function = false); - } - - public function unsubscribe($topic_url, $http_function = false) { - return $this->change_subscription("unsubscribe", $topic_url, $http_function = false); - } - - // helper function since sub/unsub are handled the same way - private function change_subscription($mode, $topic_url, $http_function = false) { - if (!isset($topic_url)) - throw new Exception('Please specify a topic url'); - - // lightweight check that we're actually working w/ a valid url - if (!preg_match("|^https?://|i",$topic_url)) - throw new Exception('The specified topic url does not appear to be valid: '.$topic_url); - - // set the mode subscribe/unsubscribe - $post_string = "hub.mode=".$mode; - $post_string .= "&hub.callback=".urlencode($this->callback_url); - $post_string .= "&hub.verify=".$this->verify; - $post_string .= "&hub.verify_token=".$this->verify_token; - $post_string .= "&hub.lease_seconds=".$this->lease_seconds; - - // append the topic url parameters - $post_string .= "&hub.topic=".urlencode($topic_url); - - // make the http post request and return true/false - // easy to over-write to use your own http function - if ($http_function) - return $http_function($this->hub_url,$post_string); - else - return $this->http($this->hub_url,$post_string); - } - - // default http function that uses curl to post to the hub endpoint - private function http($url, $post_string) { - - // add any additional curl options here - $options = array(CURLOPT_URL => $url, - CURLOPT_USERAGENT => "PubSubHubbub-Subscriber-PHP/1.0", - CURLOPT_RETURNTRANSFER => true); - - if ($post_string) { - $options[CURLOPT_POST] = true; - $options[CURLOPT_POSTFIELDS] = $post_string; - } - - if ($this->credentials) - $options[CURLOPT_USERPWD] = $this->credentials; - - $ch = curl_init(); - curl_setopt_array($ch, $options); - - $response = curl_exec($ch); - $info = curl_getinfo($ch); - - // all good -- anything in the 200 range - if (substr($info['http_code'],0,1) == "2") { - return $response; - } - return false; - } -} - - -?> \ No newline at end of file diff --git a/testsuite/README b/testsuite/README deleted file mode 100644 index 3b857e3..0000000 --- a/testsuite/README +++ /dev/null @@ -1,20 +0,0 @@ -PubSubHubbub Hub Test Suite ---------------------------- - -This suite is intended to be used for hub compliancy. The test examples came -directly from the current 0.1 PubSubHubbub Core working draft. However, not -everything can be tested currently. This may change as the spec changes. - -This requires Ruby, RSpec and Mechanize, the later two can be installed with -Ruby Gems using "gem install rspec mechanize". RSpec is a great approach to -testing and Ruby allows for nice DSL-like testing. The interface is HTTP, so -it's language independent. - -Using the Test Suite: - -$ HUB_URL= spec hub_spec.rb --format specdoc - -Example: - -$ HUB_URL=http://localhost:8000 spec hub_spec.rb --format specdoc - diff --git a/testsuite/hub.rb b/testsuite/hub.rb deleted file mode 100644 index 54bf3c6..0000000 --- a/testsuite/hub.rb +++ /dev/null @@ -1,69 +0,0 @@ -require 'net/http' -require 'uri' - -require 'mechanize' - -class Hub - attr_reader :endpoint - - def initialize(endpoint) - @endpoint = URI.parse(endpoint) - @endpoint.path = '/' if @endpoint.path.empty? - - # This is for a hack to deal with non-auto running tasks on App Engine!? - @is_gae = Net::HTTP.get(@endpoint.host, '/_ah/admin/queues', @endpoint.port).include?('Google') - end - - def subscribe(callback, topic, verify, verify_token=nil) - post_as_subscriber('subscribe', callback, topic, verify, verify_token) - end - - def unsubscribe(callback, topic, verify, verify_token=nil) - post_as_subscriber('unsubscribe', callback, topic, verify, verify_token) - end - - def publish(url) - post_as_publisher('publish', url) - end - - def post_as_subscriber(mode, callback, topic, verify, verify_token=nil) - form_data = { - 'hub.mode' => mode, - 'hub.callback' => callback, - 'hub.topic' => topic, - } - form_data['hub.verify_token'] = verify_token if verify_token - if verify.is_a? String - form_data['hub.verify'] = verify - elsif verify.is_a? Array - # Part 1/2 of multivalue hack - verify.each_with_index do |v, i| - form_data["hub.verify--.#{i}"] = v - end - end - req = Net::HTTP::Post.new(@endpoint.path) - req.form_data = form_data - req.body = req.body.gsub(/\-\-\.\d/, '') # Part 2/2 of multivalue hack - Net::HTTP.new(@endpoint.host, @endpoint.port).start do |http| - http.request(req) - end - end - - def post_as_publisher(mode, url) - res = Net::HTTP.post_form(@endpoint, { - 'hub.mode' => mode, - 'hub.url' => url, - }) - run_feed_pull_task if @is_gae && res.kind_of?(Net::HTTPSuccess) - return res - end - - # In response to http://code.google.com/p/googleappengine/issues/detail?id=1796 - def run_feed_pull_task - page = WWW::Mechanize.new.get("http://#{@endpoint.host}:#{@endpoint.port}/_ah/admin/tasks?queue=feed-pulls") - payload = page.form_with(:action => '/work/pull_feeds')['payload'] rescue nil - return unless payload - Net::HTTP.start(@endpoint.host, @endpoint.port) {|http| http.request_post('/work/pull_feeds', payload, {'X-AppEngine-Development-Payload'=>'1'}) } - page.form_with(:action => '/_ah/admin/tasks').click_button # Delete the task - end -end \ No newline at end of file diff --git a/testsuite/hub_spec.rb b/testsuite/hub_spec.rb deleted file mode 100644 index cbae0fe..0000000 --- a/testsuite/hub_spec.rb +++ /dev/null @@ -1,137 +0,0 @@ -require 'hub' -require 'mocks' -require 'timeout' - -HUB_URL = ENV['HUB_URL'] -raise "Specify a hub URL by setting the HUB_URL environment variable." unless HUB_URL - -def wait_on(something) - begin - Timeout::timeout(3) { break unless something.nil? while true } - rescue Timeout::Error - nil - end -end - -def as_optional - # TODO: record as optional spec failure -end - -shared_examples_for "a hub with publisher and subscriber" do - before(:all) do - @hub = Hub.new(HUB_URL) - @publisher = Publisher.new(@hub) - @subscriber = Subscriber.new(@hub) - end - - after(:all) do - @publisher.stop - @subscriber.stop - end -end - -describe Hub, "publisher interface" do - it_should_behave_like "a hub with publisher and subscriber" - - it "accepts POST request for publish notifications" do - @hub.publish(@publisher.content_url).should be_a_kind_of(Net::HTTPSuccess) - end - - it "SHOULD arrange for a content fetch request after publish notification" # shouldn't it always? - - it "MUST return 204 No Content if publish notification was accepted" do - @hub.publish(@publisher.content_url).should be_an_instance_of(Net::HTTPNoContent) - end - - it "MUST return appropriate HTTP error response code if not accepted" do - @hub.post_as_publisher(nil, nil) .should be_a_kind_of(Net::HTTPClientError) - @hub.post_as_publisher('not publish', nil).should be_a_kind_of(Net::HTTPClientError) - end - - it "sends an HTTP GET request to the topic URL to fetch content" do - # Because GAE-PSH doesn't fetch content unless there are subscriptions, we subscribe - @hub.subscribe(@subscriber.callback_url, @publisher.content_url, 'sync', Subscriber::VERIFY_TOKEN) - - @publisher.last_request_method = nil - @hub.publish(@publisher.content_url) - sleep 1 - wait_on @publisher.last_request_method - @publisher.last_request_method.should == "GET" - end - - it "SHOULD include a header field X-Hub-Subscribers whose value is an integer in content fetch request" do - # Because GAE-PSH doesn't fetch content unless there are subscriptions, we subscribe - @hub.subscribe(@subscriber.callback_url, @publisher.content_url, 'sync', Subscriber::VERIFY_TOKEN) - - @publisher.last_headers = nil - @hub.publish(@publisher.content_url) - sleep 1 - wait_on @publisher.last_headers - @publisher.last_headers.should include("X-Hub-Subscribers") rescue as_optional - end - - -end - -describe Hub, "subscriber interface" do - it_should_behave_like "a hub with publisher and subscriber" - - it "accepts POST request for subscription requests" do - @hub.subscribe(@subscriber.callback_url, @publisher.content_url, 'sync', Subscriber::VERIFY_TOKEN).should be_a_kind_of(Net::HTTPSuccess) - end - - it "REQUIRES mode, callback, topic, and verify parameters in the subscription request" do - @hub.post_as_subscriber(nil, @subscriber.callback_url, @publisher.content_url, nil, Subscriber::VERIFY_TOKEN).should_not be_a_kind_of(Net::HTTPSuccess) - @hub.subscribe(nil, @publisher.content_url, 'sync', Subscriber::VERIFY_TOKEN).should_not be_a_kind_of(Net::HTTPSuccess) - @hub.subscribe(@subscriber.callback_url, nil, 'sync', Subscriber::VERIFY_TOKEN).should_not be_a_kind_of(Net::HTTPSuccess) - @hub.subscribe(@subscriber.callback_url, @publisher.content_url, nil, Subscriber::VERIFY_TOKEN).should_not be_a_kind_of(Net::HTTPSuccess) - end - - it "MUST ignore verify keywords it does not understand" do - @hub.subscribe(@subscriber.callback_url, @publisher.content_url, ['sync','foobar','async'], Subscriber::VERIFY_TOKEN).should be_a_kind_of(Net::HTTPSuccess) - end - - it "MUST return 204 No Content if subscription was created and verified" do - @hub.subscribe(@subscriber.callback_url, @publisher.content_url, 'sync', Subscriber::VERIFY_TOKEN).should be_a_kind_of(Net::HTTPNoContent) - end - - it "MUST return 202 Accepted if the subscription was created but has yet to be verified" do - @hub.subscribe(@subscriber.callback_url, @publisher.content_url, 'async', Subscriber::VERIFY_TOKEN).should be_a_kind_of(Net::HTTPAccepted) - end - - it "MUST return appropriate HTTP error response code in case of any error" do - @hub.post_as_subscriber(nil, nil, nil, nil) .should be_a_kind_of(Net::HTTPClientError) - @hub.post_as_subscriber('not subscribe', nil, nil, nil) .should be_a_kind_of(Net::HTTPClientError) - end - - it "SHOULD return a description of an error in the response body in plain text" - - it "MUST complete verification before returning a response in synchronous mode" - - it "must verify subscriber with a GET request to the callback URL" do - request_method = nil - @subscriber.onrequest = lambda {|req| request_method = req.request_method } - @hub.subscribe(@subscriber.callback_url, @publisher.content_url, 'sync', Subscriber::VERIFY_TOKEN) - wait_on request_method - request_method.should == "GET" - end - - it "is REQUIRED to include mode, topic and challenge query parameters in the verification request" do - query_string = nil - @subscriber.onrequest = lambda {|req| query_string = req.query_string } - @hub.subscribe(@subscriber.callback_url, @publisher.content_url, 'sync', Subscriber::VERIFY_TOKEN) - wait_on query_string - query_string.should include("hub.mode=") - query_string.should include("hub.topic=") - query_string.should include("hub.challenge=") - end - - it "expects an HTTP success code with the challenge parameter in the response body to verify subscription" - - it "expects subscriber to return 404 Not Found if they do not agree with the subscription" - - it "MUST consider other client and server response codes to mean subscription is not verified" - - it "SHOULD retry verification until a definite acknowledgement is received" - -end diff --git a/testsuite/mocks.rb b/testsuite/mocks.rb deleted file mode 100644 index f466a58..0000000 --- a/testsuite/mocks.rb +++ /dev/null @@ -1,132 +0,0 @@ -require 'webrick' - -class Subscriber - PORT = 8089 - VERIFY_TOKEN = 'qfwef9' - - attr_reader :callback_url - attr_accessor :onrequest - - def initialize(hub) - @hub = hub - @server = WEBrick::HTTPServer.new(:Port => PORT, :Logger => WEBrick::Log.new(nil, 0), :AccessLog => WEBrick::Log.new(nil, 0)) - @callback_url = "http://localhost:#{PORT}/callback" - @onrequest = lambda {|req|} - mount "/callback" do |req,res| - @onrequest.call(req) - res.status = 200 - if req.request_method == 'GET' - res.body = /hub.challenge=([^$|&]+)/.match(req.query_string)[1] - else - - end - end - @server_thread = Thread.new do - trap("INT"){ @server.shutdown } - @server.start - end - end - - def mount(path, &block) - @server.mount(path, WEBrick::HTTPServlet::ProcHandler.new(block)) - end - - def stop - @server.shutdown - @server_thread.join - end -end - - -class Publisher - PORT = 8088 - - attr_reader :content_url - attr_reader :content - attr_accessor :onrequest - - attr_accessor :last_request_method - attr_accessor :last_headers - - def initialize(hub) - @hub = hub - @server = WEBrick::HTTPServer.new(:Port => PORT, :Logger => WEBrick::Log.new(nil, 0), :AccessLog => WEBrick::Log.new(nil, 0)) - @content_url = "http://localhost:#{PORT}/happycats.xml" - @last_request_method = nil - @last_headers = nil - @onrequest = lambda {|req|} - @content =< - - - - - - 2008-08-11T02:15:01Z - - - - Heathcliff - - http://publisher.example.com/happycat25.xml - 2008-08-11T02:15:01Z - - What a happy cat. Full content goes here. - - - - - - Heathcliff - - http://publisher.example.com/happycat25.xml - 2008-08-11T02:15:01Z - - What a happy cat! - - - - - - Garfield - - http://publisher.example.com/happycat25.xml - 2008-08-11T02:15:01Z - - - - - Nermal - - http://publisher.example.com/happycat25.xml - 2008-07-10T12:28:13Z - - - -EOF - mount "/happycats.xml" do |req,res| - @onrequest.call(req) - @last_request_method = req.request_method - @last_headers = req.header - res.status = 200 - res['Content-Type'] = 'application/atom+xml' - res.body = @content - end - @server_thread = Thread.new do - trap("INT"){ @server.shutdown } - @server.start - end - end - - def mount(path, &block) - @server.mount(path, WEBrick::HTTPServlet::ProcHandler.new(block)) - end - - def stop - @server.shutdown - @server_thread.join - end -end From 845df888aed2e6729abc44826f8fba04d4352ad0 Mon Sep 17 00:00:00 2001 From: Julien Genestoux Date: Tue, 19 Nov 2013 15:13:48 +0100 Subject: [PATCH 59/76] Create README.md --- README.md | 16 ++++++++++++++++ 1 file changed, 16 insertions(+) create mode 100644 README.md diff --git a/README.md b/README.md new file mode 100644 index 0000000..47222f7 --- /dev/null +++ b/README.md @@ -0,0 +1,16 @@ +PubSubHubbub +============ + +PubSubHubbub is an open protocol for distributed publish/subscribe communication on the Internet. It generalizes the concept of webhooks +and allows data produces and data consumers to work in a decoupled way. + +PubSubHubbub provides a way to subscribe, unsubscribe and receive updates from a resource, whether it's an RSS or Atom feed or any web accessible document (JSON...). + +Open hubs are provided by: +* [Superfeedr](http://pubsubhubbub.superfeedr.com/) +* [Google](http://pubsubhubbub.appspot.com/) + +Several other publishing platforms, like Wordpress, include their own hub. + +Learn more about the project at [Google Code](http://code.google.com/p/pubsubhubbub/) (some info might be out of date) or use the [test suite to test compliance](http://tests.superfeedr.com/) for an existing hub. + From 1f7047fbbd364a4d927d5d4c289dffe06c2c72b2 Mon Sep 17 00:00:00 2001 From: Julien Genestoux Date: Tue, 19 Nov 2013 15:33:35 +0100 Subject: [PATCH 60/76] Update README.md Linking to current rev of the spec. --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index 47222f7..f96c0b3 100644 --- a/README.md +++ b/README.md @@ -6,6 +6,8 @@ and allows data produces and data consumers to work in a decoupled way. PubSubHubbub provides a way to subscribe, unsubscribe and receive updates from a resource, whether it's an RSS or Atom feed or any web accessible document (JSON...). +The current version of the spec is 0.4. Please, [read it here](http://pubsubhubbub.github.io/PubSubHubbub/pubsubhubbub-core-0.4.html). + Open hubs are provided by: * [Superfeedr](http://pubsubhubbub.superfeedr.com/) * [Google](http://pubsubhubbub.appspot.com/) From 0e43d3edbb15ccb6a61616b0f0817426bcbd9576 Mon Sep 17 00:00:00 2001 From: julien Date: Tue, 4 Feb 2014 10:25:34 +0100 Subject: [PATCH 61/76] adding an index page that redirects to the latest version of the spec --- index.html | 5 +++++ 1 file changed, 5 insertions(+) create mode 100644 index.html diff --git a/index.html b/index.html new file mode 100644 index 0000000..7b90f5f --- /dev/null +++ b/index.html @@ -0,0 +1,5 @@ + + +

click here for the latest version of the PubSubHubbub spec.

From 5cda5d8067fadd56e18611300ebf5b5f5d8807d8 Mon Sep 17 00:00:00 2001 From: julien Date: Tue, 4 Feb 2014 10:55:05 +0100 Subject: [PATCH 62/76] cleanup format. No semantic changes --- pubsubhubbub-core-0.4.xml | 1003 ++++++++++++------------------------- 1 file changed, 329 insertions(+), 674 deletions(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 0aa3035..0306f9d 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -1,683 +1,338 @@ - - - - - - - - - - - - - - - - - - PubSubHubbub Core 0.4 -- Working Draft - - - Google, Inc - -
- brad@danga.com -
- - - - Google, Inc - -
- bslatkin@gmail.com -
- - - - Six Apart Ltd. - -
- mart@degeneration.co.uk -
- - - - Notifixious Inc. - -
- julien@superfeedr.com -
- - - - - - An open, simple, web-scale and decentralized pubsub protocol. - Anybody can play. - - As opposed to more developed (and more complex) pubsub specs like Jabber Publish-Subscribe this spec's base profile - (the barrier-to-entry to speak it) is dead simple. The fancy bits required - for high-volume publishers and subscribers are optional. The base profile - is HTTP-based, as opposed to XMPP (see more on this below). - - To dramatically simplify this spec in several places where we had to - choose between supporting A or B, we took it upon ourselves to say "only - A", rather than making it an implementation decision. - - We offer this spec in hopes that it fills a need or at least advances - the state of the discussion in the pubsub space. Polling sucks. We think - a decentralized pubsub layer is a fundamental, missing layer in the - Internet architecture today and its existence, more than just enabling - the obvious lower latency feed readers, would enable many cool - applications, most of which we can't even imagine. But we're looking - forward to decentralized social networking. - - - - -
- The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", - "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this - document are to be interpreted as described in . Domain name examples use . -
- -
- - An HTTP resource URL. The - unit to which one can subscribe to changes. - - The server (URL) which implements both sides of this - protocol. Any hub MAY implement its own policies on who can use it. - - An owner of a topic. Notifies the hub when - the topic feed has been updated. As in almost all pubsub systems, the - publisher is unaware of the subscribers, if any. Other pubsub systems - might call the publisher the "source". - - An entity (person or program) that wants - to be notified of changes on a topic. The subscriber must be - directly network-accessible and is identified by its Subscriber - Callback URL. - - A unique relation to a topic by a - subscriber that indicates it should receive updates for that topic. A - subscription's unique key is the tuple (Topic URL, Subscriber Callback - URL). Subscriptions may (at the hub's decision) have expiration times - akin to DHCP leases which must be periodically renewed. - - The URL at which a subscriber wishes to receive - notifications. - - An event that causes updates to multiple topics. - For each event that happens (e.g. "Brad posted to the Linux - Community."), multiple topics could be affected (e.g. "Brad posted." - and "Linux community has new post"). Publisher events cause topics to - be updated and the hub looks up all subscriptions for affected topics, - sending out notifications to subscribers. - - A payload describing how a topic's - contents have changed, or the full updated content. - Depending on the topic's content type, the difference (or "delta") may be - computed by the hub and sent to all subscribers. - -
- -
- (This section is non-normative.) - - - Publishers notify their hub(s) URLs when their topic(s) - change. - - Subscribers POST to one or more of the advertised hubs for a - topic they're interested in. Alternatively, some hubs may offer - auto-polling capability, to let {their,any} subscribers subscribe to - topics which don't advertise a hub. - - The hub caches minimal metadata (id, data, entry digest) about - each topic's previous state. When the hub re-fetches a topic feed (on - its own initiative or as a result of a publisher's ping) and finds a - delta, it enqueues a notification to all registered subscribers. - -
- -
- A potential subscriber initiates discovery by retrieving (GET or HEAD request) - the topic to which it wants to subscribe. The HTTP response from the publisher MUST - include at least one Link Header with - rel=hub (a hub link header) as well as exactly one Link Header - with rel=self (the self link header). - The former MUST indicate the exact URL of a PubSubHubbub hub designated by the publisher. - If more than one URL is specified, it is expected that the publisher pings each - of these URLs, so the subscriber may subscribe to one or more of these. - The latter will point to the permanent URL for the resource being polled. - - - In the absence of HTTP Link headers, subscribers MAY fall back to - other methods to discover the hub(s) and the canonical URI of the topic. - If the topic is an XML based feed, it MAY use embedded link elements - as described in Appendix B of Web Linking. - Similarly, for HTML pages, it MAY use embedded link elements as described - in Appendix A of Web Linking. Finally, publishers - MAY also use the Well-Known Uniform Resource Identifiers - .host-meta to include the <Link> element with rel="hub". -
- -
- Subscribing to a topic URL consists of four parts that may occur - immediately in sequence or have a delay. - - Requesting a subscription using the hub - Validating the subscription with the publisher (OPTIONAL) - Confirming the subscription was actually desired by the subscriber - Periodically reconfirming the subscription is still active (OPTIONAL) - - - Unsubscribing works in the same way, except with a single parameter - changed to indicate the desire to unsubscribe. Also, the Hub will not validate - unsubscription requests with the publisher. - -
- Subscription is initiated by the subscriber making an HTTPS - or HTTP POST request to the hub URL. This request - has a Content-Type of application/x-www-form-urlencoded (described in - Section 17.13.4 of ) and the - following parameters in its body: - - - REQUIRED. The subscriber's callback URL - where notifications should be delivered. It is considered good practice - to use a unique callback URL for each subscription. - - REQUIRED. The literal string "subscribe" or - "unsubscribe", depending on the goal of the request. - - REQUIRED. The topic URL that the subscriber - wishes to subscribe to or unsubscribe from. - - OPTIONAL. Number of seconds for - which the subscriber would like to have the subscription active. Hubs MAY - choose to respect this value or not, depending on their own policies. - This parameter MAY be present for unsubscription requests and MUST be - ignored by the hub in that case. - - OPTIONAL. A subscriber-provided secret - string that will be used to compute an HMAC digest for authorized content distribution. If not - supplied, the HMAC digest will not be present for content - distribution requests. This parameter SHOULD only be specified when - the request was made over HTTPS. This - parameter MUST be less than 200 bytes in length. - - - - Subscribers MAY also include additional HTTP request parameters, as well - as HTTP Headers if they are required by the hub. - In the context of social web applications, it is considered good - practice to include a From HTTP header (as described in section 14.22 - of Hypertext Transfer Protocol) to indicate - on behalf of which user the subscription is being performed. - - - Hubs MUST ignore additional request parameters they do not - understand. - - Hubs MUST allow subscribers to re-request subscriptions that are - already activated. Each subsequent request to a hub to subscribe or - unsubscribe MUST override the previous subscription state for a - specific topic URL and callback URL combination once the action is - verified. Any failures to confirm the subscription action MUST leave - the subscription state unchanged. This is required so subscribers can - renew their subscriptions before the lease seconds period is over - without any interruption. - -
- - The topic and callback URLs MAY use HTTP - or HTTPS schemes. The topic URL MUST - be the one advertised by the publisher in a Self Link Header - during the discovery phase. (See ). - Hubs MAY refuse subscriptions if the topic URL does not correspond to the one - advertised by the publisher. The topic URL can otherwise be free-form - following the URI spec. Hubs MUST always - decode non-reserved characters for these URL parameters; see section 2.4 on - "When to Encode or Decode" in the URI spec. - - The callback URL MAY contain arbitrary query string parameters - (e.g., ?foo=bar&red=fish). Hubs MUST - preserve the query string during subscription verification by - appending new parameters to the end of the list using the & (ampersand) character to join. Existing - parameters with names that overlap with those used by verification - requests will not be overwritten. For event notification, the - callback URL will be POSTed to including any query-string parameters - in the URL portion of the request, not as POST body parameters. - + + + + + + + + + PubSubHubbub Core 0.4 -- Working Draft + + Google, Inc +
+ brad@danga.com +
+ + + Google, Inc +
+ bslatkin@gmail.com +
+ + + Six Apart Ltd. +
+ mart@degeneration.co.uk +
+ + + Notifixious Inc. +
+ julien@superfeedr.com +
+ + + + An open, simple, web-scale and decentralized pubsub protocol. Anybody can play. + As opposed to more developed (and more complex) pubsub specs like Jabber Publish-Subscribe this spec's base profile (the barrier-to-entry to speak it) is dead simple. The fancy bits required for high-volume publishers and subscribers are optional. The base profile is HTTP-based, as opposed to XMPP (see more on this below). + To dramatically simplify this spec in several places where we had to choose between supporting A or B, we took it upon ourselves to say "only A", rather than making it an implementation decision. + We offer this spec in hopes that it fills a need or at least advances the state of the discussion in the pubsub space. Polling sucks. We think a decentralized pubsub layer is a fundamental, missing layer in the Internet architecture today and its existence, more than just enabling the obvious lower latency feed readers, would enable many cool applications, most of which we can't even imagine. But we're looking forward to decentralized social networking. + + + +
+ The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in . Domain name examples use .
- -
- - The hub MUST respond to a subscription request with an HTTP 202 "Accepted" - response to indicate that the request was received and will now - be verified () and validated () by the hub. The hub SHOULD perform the - verification and validation of intent as soon as possible. - - If a hub finds any errors in the subscription request, an - appropriate HTTP error response code (4xx or 5xx) MUST be returned. In - the event of an error, hubs SHOULD return a description of the error - in the response body as plain text. Hubs MAY decide to reject some - callback URLs or topic URLs based on their own policies (e.g., domain - authorization, topic URL port numbers). +
+ + + An HTTP resource URL. The unit to which one can subscribe to changes. + The server (URL) which implements both sides of this protocol. Any hub MAY implement its own policies on who can use it. + An owner of a topic. Notifies the hub when the topic feed has been updated. As in almost all pubsub systems, the publisher is unaware of the subscribers, if any. Other pubsub systems might call the publisher the "source". + An entity (person or program) that wants to be notified of changes on a topic. The subscriber must be directly network-accessible and is identified by its Subscriber Callback URL. + A unique relation to a topic by a subscriber that indicates it should receive updates for that topic. A subscription's unique key is the tuple (Topic URL, Subscriber Callback URL). Subscriptions may (at the hub's decision) have expiration times akin to DHCP leases which must be periodically renewed. + The URL at which a subscriber wishes to receive notifications. + An event that causes updates to multiple topics. For each event that happens (e.g. "Brad posted to the Linux Community."), multiple topics could be affected (e.g. "Brad posted." and "Linux community has new post"). Publisher events cause topics to be updated and the hub looks up all subscriptions for affected topics, sending out notifications to subscribers. + A payload describing how a topic's contents have changed, or the full updated content. Depending on the topic's content type, the difference (or "delta") may be computed by the hub and sent to all subscribers. + +
- -
- -
- Subscriptions MAY be validated by the Hubs who may require - more details to accept or refuse a subscription. The Hub MAY also - check with the publisher whether the subscription should be accepted. - - If (and when), the subscription is accepted, the hub MUST perform the verification of intent of the subscriber. - - If (and when), the subscription is denied, the hub MUST inform the subscriber - by sending an HTTP GET request to the subscriber's - callback URL as given in the subscription request. This request has the following - query string arguments appended (format described in Section 17.13.4 of - ): - - REQUIRED. The literal string "denied". - REQUIRED. The topic URL given in the corresponding - subscription request. - OPTIONAL. The hub may include a reason - for which the subscription has been denied. - - - Hubs may provide an additional HTTP Location header (as described in section 14.30 - of Hypertext Transfer Protocol) to indicate that the - subscriber may retry subscribing to a different hub.topic. This allows - for limited distribution to specific groups or users in the context of social web - applications. - - The subscription MAY be denied by the hub at any point (even - if it was previously accepted). The Subscriber SHOULD then consider that - the subscription is not possible anymore. - +
+ (This section is non-normative.) + + + Publishers notify their hub(s) URLs when their topic(s) change. + Subscribers POST to one or more of the advertised hubs for a topic they're interested in. Alternatively, some hubs may offer auto-polling capability, to let {their,any} subscribers subscribe to topics which don't advertise a hub. + The hub caches minimal metadata (id, data, entry digest) about each topic's previous state. When the hub re-fetches a topic feed (on its own initiative or as a result of a publisher's ping) and finds a delta, it enqueues a notification to all registered subscribers. + +
- -
- In order to prevent an attacker from creating unwanted subscriptions - on behalf of a subscriber (or unsubscribing desired ones), a hub must - ensure that the subscriber did indeed send the subscription request. - - The hub verifies a subscription request by sending an HTTP GET request to the subscriber's callback - URL as given in the subscription request. This request has the following - query string arguments appended (format described in Section 17.13.4 of - ): - - - REQUIRED. The literal string "subscribe" or - "unsubscribe", which matches the original request to the hub from - the subscriber. - - REQUIRED. The topic URL given in the - corresponding subscription request. - - REQUIRED. A hub-generated, random string - that MUST be echoed by the subscriber to verify the - subscription. - - REQUIRED/OPTIONAL. The - hub-determined number of seconds that the subscription will stay - active before expiring, measured from the time the verification - request was made from the hub to the subscriber. Hubs MUST supply - this parameter for subscription requests. This parameter MAY be - present for unsubscribe requests and MUST be ignored by subscribers - during unsubscription. - - - -
- - The subscriber MUST confirm that the hub.topic - corresponds to a pending subscription or unsubscription that it - wishes to carry out. If so, the subscriber MUST respond with an HTTP - success (2xx) code with a response body equal to the hub.challenge parameter. If the subscriber does - not agree with the action, the subscriber MUST respond with a 404 "Not - Found" response. - - The hub MUST consider other server response codes (3xx, 4xx, 5xx) - to mean that the verification request has failed. If the subscriber - returns an HTTP success (2xx) but the content body does not match the - hub.challenge parameter, the hub MUST also - consider verification to have failed. - - Hubs MAY make the hub.lease_seconds - equal to the value the subscriber passed in their subscription - request but MAY change the value depending on the hub's policies. To - sustain a subscription, the subscriber MUST re-request the - subscription on the hub before hub.lease_seconds seconds has elapsed. - +
+ A potential subscriber initiates discovery by retrieving (GET or HEAD request) the topic to which it wants to subscribe. The HTTP response from the publisher MUST include at least one Link Header with rel=hub (a hub link header) as well as exactly one Link Header with rel=self (the self link header). The former MUST indicate the exact URL of a PubSubHubbub hub designated by the publisher. If more than one URL is specified, it is expected that the publisher pings each of these URLs, so the subscriber may subscribe to one or more of these. The latter will point to the permanent URL for the resource being polled. + In the absence of HTTP Link headers, subscribers MAY fall back to other methods to discover the hub(s) and the canonical URI of the topic. If the topic is an XML based feed, it MAY use embedded link elements as described in Appendix B of Web Linking. Similarly, for HTML pages, it MAY use embedded link elements as described in Appendix A of Web Linking. Finally, publishers MAY also use the Well-Known Uniform Resource Identifiers .host-meta to include the <Link> element with rel="hub".
- - -
- -
- -
- The publisher MUST inform the hubs it previously designated when a topic - has been updated. The hub and the publisher can agree on any mechanism, as - long as the hub is eventually able send the updated payload to the - subscribers. -
- -
- - A content distribution request is an HTTP POST request from hub to the subscriber's - callback URL with the payload of the notification. This request MUST - have a Content-Type corresponding to the - type of the topic. The hub MAY reduce the payload to a diff between two - consecutive versions if its format allows it. - - The request MUST include a Link Header - with rel=hub pointing to the Hub as well as a Link - Header with rel=self set to the topic that's being updated. The Hub - SHOULD combine both headers into a single Link - Header. - - The successful response from the subscriber's callback URL MUST be an - HTTP success (2xx) code. The hub MUST consider all other subscriber - response codes as failures; that means subscribers MUST NOT use HTTP - redirects for moving subscriptions. The response body from the - subscriber MUST be ignored by the hub. Hubs SHOULD retry notifications - repeatedly until successful (up to some reasonable maximum over a - reasonable time period). Subscribers SHOULD respond to notifications as - quickly as possible; their success response code SHOULD only indicate - receipt of the message, not acknowledgment that it was successfully - processed by the subscriber. - -
- -
- - If the subscriber supplied a value for hub.secret in their subscription request, the hub - MUST generate an HMAC signature of the payload and include that - signature in the request headers of the content distribution request. - The X-Hub-Signature header's value MUST be - in the form sha1=signature where signature is a 40-byte, hexadecimal representation - of a SHA1 signature. The signature MUST be - computed using the HMAC algorithm with the - request body as the data and the hub.secret - as the key. - - When subscribers receive a content distribution request with the - X-Hub-Signature header specified, they - SHOULD recompute the SHA1 signature with the shared secret using the - same method as the hub. If the signature does not match, subscribers - MUST still return a 2xx success response to acknowledge receipt, but - locally ignore the message as invalid. Using this technique along with - HTTPS for subscription requests enables - simple subscribers to receive authenticated notifications from hubs - without the need for subscribers to run an HTTPS - server. - - Please note however that this signature only ensures that the payload - was not forged. Since the notification also includes headers, these should - not be considered as safe by the subscriber, unless of course the subscriber - uses HTTPS callbacks. - -
- - - - - - - - HMAC: Keyed-Hashing for Message Authentication - - IBM, T.J. Watson Research Center - - - University of California at San Diego, Dept of Computer Science and Engineering - - - IBM T.J. Watson Research Center - - - - - - - - Reserved Top Level DNS Names - - - - - - - - - - - - - - - - Key words for use in RFCs to Indicate Requirement - Levels - - - Alis Technologies - - - - - - - - - Hypertext Transfer Protocol -- HTTP/1.1 - - - UC Irvine - - - - Compaq/W3C - - - - Compaq - - - - W3C/MIT - - - - Xerox - - - - Microsoft - - - - W3C/MIT - - - - - - - - - HTTP Over TLS - - - - - This memo describes how to use Transport Layer Security (TLS) to secure Hypertext Transfer Protocol (HTTP) connections over the Internet. This memo provides information for the Internet community. - - - - - - - - Web Linking - - - - - This document specifies relation types for Web links, and defines a - registry for them. It also defines the use of such links in HTTP - headers with the Link header field. - - - - - - - - US Secure Hash Algorithm 1 (SHA1) - - - - - - - The purpose of this document is to make the SHA-1 (Secure Hash Algorithm 1) hash algorithm conveniently available to the Internet community. This memo provides information for the Internet community. - - - - - - - - - Uniform Resource Identifiers (URI): Generic Syntax - - - - - - - - - - - - Defining Well-Known Uniform Resource Identifiers (URIs) - - - - - - - - - - - - - - - - HTML 4.01 Specification - - - - - - - - - - - - - - - - - - - - - - Publish-Subscribe - - - - - - - - - - - - - - - - -
- Feedback on this specification is welcomed via the - PubSubHubbub W3C Community Group. For - more information, see the - W3C PubSubHubbub Community Group. - - -
- +
+ Subscribing to a topic URL consists of four parts that may occur immediately in sequence or have a delay. + + + Requesting a subscription using the hub + Validating the subscription with the publisher (OPTIONAL) + Confirming the subscription was actually desired by the subscriber + Periodically reconfirming the subscription is still active (OPTIONAL) + + + Unsubscribing works in the same way, except with a single parameter changed to indicate the desire to unsubscribe. Also, the Hub will not validate unsubscription requests with the publisher. +
+ Subscription is initiated by the subscriber making an HTTPS or HTTP POST request to the hub URL. This request has a Content-Type of application/x-www-form-urlencoded (described in Section 17.13.4 of ) and the following parameters in its body: + + + REQUIRED. The subscriber's callback URL where notifications should be delivered. It is considered good practice to use a unique callback URL for each subscription. + REQUIRED. The literal string "subscribe" or "unsubscribe", depending on the goal of the request. + REQUIRED. The topic URL that the subscriber wishes to subscribe to or unsubscribe from. + OPTIONAL. Number of seconds for which the subscriber would like to have the subscription active. Hubs MAY choose to respect this value or not, depending on their own policies. This parameter MAY be present for unsubscription requests and MUST be ignored by the hub in that case. + OPTIONAL. A subscriber-provided secret string that will be used to compute an HMAC digest for authorized content distribution. If not supplied, the HMAC digest will not be present for content distribution requests. This parameter SHOULD only be specified when the request was made over HTTPS. This parameter MUST be less than 200 bytes in length. + + + Subscribers MAY also include additional HTTP request parameters, as well as HTTP Headers if they are required by the hub. In the context of social web applications, it is considered good practice to include a From HTTP header (as described in section 14.22 of Hypertext Transfer Protocol) to indicate on behalf of which user the subscription is being performed. + Hubs MUST ignore additional request parameters they do not understand. + Hubs MUST allow subscribers to re-request subscriptions that are already activated. Each subsequent request to a hub to subscribe or unsubscribe MUST override the previous subscription state for a specific topic URL and callback URL combination once the action is verified. Any failures to confirm the subscription action MUST leave the subscription state unchanged. This is required so subscribers can renew their subscriptions before the lease seconds period is over without any interruption. +
+ The topic and callback URLs MAY use HTTP or HTTPS schemes. The topic URL MUST be the one advertised by the publisher in a Self Link Header during the discovery phase. (See ). Hubs MAY refuse subscriptions if the topic URL does not correspond to the one advertised by the publisher. The topic URL can otherwise be free-form following the URI spec. Hubs MUST always decode non-reserved characters for these URL parameters; see section 2.4 on "When to Encode or Decode" in the URI spec. + The callback URL MAY contain arbitrary query string parameters (e.g., ?foo=bar&red=fish). Hubs MUST preserve the query string during subscription verification by appending new parameters to the end of the list using the & (ampersand) character to join. Existing parameters with names that overlap with those used by verification requests will not be overwritten. For event notification, the callback URL will be POSTed to including any query-string parameters in the URL portion of the request, not as POST body parameters. +
+
+ The hub MUST respond to a subscription request with an HTTP 202 "Accepted" response to indicate that the request was received and will now be verified () and validated () by the hub. The hub SHOULD perform the verification and validation of intent as soon as possible. + If a hub finds any errors in the subscription request, an appropriate HTTP error response code (4xx or 5xx) MUST be returned. In the event of an error, hubs SHOULD return a description of the error in the response body as plain text. Hubs MAY decide to reject some callback URLs or topic URLs based on their own policies (e.g., domain authorization, topic URL port numbers). +
+
+
+ Subscriptions MAY be validated by the Hubs who may require more details to accept or refuse a subscription. The Hub MAY also check with the publisher whether the subscription should be accepted. + If (and when), the subscription is accepted, the hub MUST perform the verification of intent of the subscriber. + If (and when), the subscription is denied, the hub MUST inform the subscriber by sending an HTTP GET request to the subscriber's callback URL as given in the subscription request. This request has the following query string arguments appended (format described in Section 17.13.4 of ): + + + REQUIRED. The literal string "denied". + REQUIRED. The topic URL given in the corresponding subscription request. + OPTIONAL. The hub may include a reason for which the subscription has been denied. + + + Hubs may provide an additional HTTP Location header (as described in section 14.30 of Hypertext Transfer Protocol) to indicate that the subscriber may retry subscribing to a different hub.topic. This allows for limited distribution to specific groups or users in the context of social web applications. + The subscription MAY be denied by the hub at any point (even if it was previously accepted). The Subscriber SHOULD then consider that the subscription is not possible anymore. +
+
+ In order to prevent an attacker from creating unwanted subscriptions on behalf of a subscriber (or unsubscribing desired ones), a hub must ensure that the subscriber did indeed send the subscription request. + The hub verifies a subscription request by sending an HTTP GET request to the subscriber's callback URL as given in the subscription request. This request has the following query string arguments appended (format described in Section 17.13.4 of ): + + + REQUIRED. The literal string "subscribe" or "unsubscribe", which matches the original request to the hub from the subscriber. + REQUIRED. The topic URL given in the corresponding subscription request. + REQUIRED. A hub-generated, random string that MUST be echoed by the subscriber to verify the subscription. + REQUIRED/OPTIONAL. The hub-determined number of seconds that the subscription will stay active before expiring, measured from the time the verification request was made from the hub to the subscriber. Hubs MUST supply this parameter for subscription requests. This parameter MAY be present for unsubscribe requests and MUST be ignored by subscribers during unsubscription. + + +
+ The subscriber MUST confirm that the hub.topic corresponds to a pending subscription or unsubscription that it wishes to carry out. If so, the subscriber MUST respond with an HTTP success (2xx) code with a response body equal to the hub.challenge parameter. If the subscriber does not agree with the action, the subscriber MUST respond with a 404 "Not Found" response. + The hub MUST consider other server response codes (3xx, 4xx, 5xx) to mean that the verification request has failed. If the subscriber returns an HTTP success (2xx) but the content body does not match the hub.challenge parameter, the hub MUST also consider verification to have failed. + Hubs MAY make the hub.lease_seconds equal to the value the subscriber passed in their subscription request but MAY change the value depending on the hub's policies. To sustain a subscription, the subscriber MUST re-request the subscription on the hub before hub.lease_seconds seconds has elapsed. +
+
+
+
+ The publisher MUST inform the hubs it previously designated when a topic has been updated. The hub and the publisher can agree on any mechanism, as long as the hub is eventually able send the updated payload to the subscribers. +
+
+ A content distribution request is an HTTP POST request from hub to the subscriber's callback URL with the payload of the notification. This request MUST have a Content-Type corresponding to the type of the topic. The hub MAY reduce the payload to a diff between two consecutive versions if its format allows it. + The request MUST include a Link Header with rel=hub pointing to the Hub as well as a Link Header with rel=self set to the topic that's being updated. The Hub SHOULD combine both headers into a single Link Header. + The successful response from the subscriber's callback URL MUST be an HTTP success (2xx) code. The hub MUST consider all other subscriber response codes as failures; that means subscribers MUST NOT use HTTP redirects for moving subscriptions. The response body from the subscriber MUST be ignored by the hub. Hubs SHOULD retry notifications repeatedly until successful (up to some reasonable maximum over a reasonable time period). Subscribers SHOULD respond to notifications as quickly as possible; their success response code SHOULD only indicate receipt of the message, not acknowledgment that it was successfully processed by the subscriber. +
+
+ If the subscriber supplied a value for hub.secret in their subscription request, the hub MUST generate an HMAC signature of the payload and include that signature in the request headers of the content distribution request. The X-Hub-Signature header's value MUST be in the form sha1=signature where signature is a 40-byte, hexadecimal representation of a SHA1 signature. The signature MUST be computed using the HMAC algorithm with the request body as the data and the hub.secret as the key. + When subscribers receive a content distribution request with the X-Hub-Signature header specified, they SHOULD recompute the SHA1 signature with the shared secret using the same method as the hub. If the signature does not match, subscribers MUST still return a 2xx success response to acknowledge receipt, but locally ignore the message as invalid. Using this technique along with HTTPS for subscription requests enables simple subscribers to receive authenticated notifications from hubs without the need for subscribers to run an HTTPS server. + Please note however that this signature only ensures that the payload was not forged. Since the notification also includes headers, these should not be considered as safe by the subscriber, unless of course the subscriber uses HTTPS callbacks. +
+ + + + + + HMAC: Keyed-Hashing for Message Authentication + + IBM, T.J. Watson Research Center + + + University of California at San Diego, Dept of Computer Science and Engineering + + + IBM T.J. Watson Research Center + + + + + + + + Reserved Top Level DNS Names + + + + + + + + + + + + + Key words for use in RFCs to Indicate Requirement Levels + + Alis Technologies + + + + + + + + Hypertext Transfer Protocol -- HTTP/1.1 + + UC Irvine + + + Compaq/W3C + + + Compaq + + + W3C/MIT + + + Xerox + + + Microsoft + + + W3C/MIT + + + + + + + + HTTP Over TLS + + + + + + This memo describes how to use Transport Layer Security (TLS) to secure Hypertext Transfer Protocol (HTTP) connections over the Internet.This memo provides information for the Internet community. + + + + + + + + Web Linking + + + + + + This document specifies relation types for Web links, and defines a registry for them.It also defines the use of such links in HTTP headers with the Link header field. + + + + + + + + US Secure Hash Algorithm 1 (SHA1) + + + + + + + + + The purpose of this document is to make the SHA-1 (Secure Hash Algorithm 1) hash algorithm conveniently available to the Internet community.This memo provides information for the Internet community. + + + + + + + + Uniform Resource Identifiers (URI): Generic Syntax + + + + + + + + + + Defining Well-Known Uniform Resource Identifiers (URIs) + + + + + + + + + + + + + HTML 4.01 Specification + + + + + + + + + + + + + + + + + Publish-Subscribe + + + + + + + + + + + + + + + +
+ Feedback on this specification is welcomed via the PubSubHubbub W3C Community Group.For more information, see the W3C PubSubHubbub Community Group. +
+ From 77d3816e6f0b9c264ea7ebbb3b5ca7c49b5c0ad2 Mon Sep 17 00:00:00 2001 From: julien Date: Tue, 4 Feb 2014 10:56:20 +0100 Subject: [PATCH 63/76] regenerated html output from clean xml --- pubsubhubbub-core-0.4.html | 76 ++++++++++++++++++++++++-------------- 1 file changed, 49 insertions(+), 27 deletions(-) diff --git a/pubsubhubbub-core-0.4.html b/pubsubhubbub-core-0.4.html index 4eda9c6..6f5f641 100644 --- a/pubsubhubbub-core-0.4.html +++ b/pubsubhubbub-core-0.4.html @@ -12,6 +12,28 @@ a { text-decoration: none; } + /* info code from SantaKlauss at http://www.madaboutstyle.com/tooltip2.html */ + a.info { + /* This is the key. */ + position: relative; + z-index: 24; + text-decoration: none; + } + a.info:hover { + z-index: 25; + color: #FFF; background-color: #900; + } + a.info span { display: none; } + a.info:hover span.info { + /* The span will display just on :hover state. */ + display: block; + position: absolute; + font-size: smaller; + top: 2em; left: -5em; width: 15em; + padding: 2px; border: 1px solid #333; + color: #900; background-color: #EEE; + text-align: left; + } a.smpl { color: black; } @@ -324,7 +346,7 @@ content: "December 2010"; } @top-center { - content: "Abbreviated Title";3 + content: "Abbreviated Title"; } @bottom-left { content: "Doe"; @@ -368,14 +390,14 @@ - + - - - + + + @@ -397,7 +419,7 @@ Google, Inc - Expires: December 22, 2013 + Expires: August 8, 2014 M. Atkins @@ -414,7 +436,7 @@ - June 20, 2013 + February 4, 2014 @@ -427,7 +449,7 @@

Abstract

-

An open, simple, web-scale and decentralized pubsub protocol. Anybody can play.

+

An open, simple, web-scale and decentralized pubsub protocol. Anybody can play.

As opposed to more developed (and more complex) pubsub specs like Jabber Publish-Subscribe [XEP-0060] this spec's base profile (the barrier-to-entry to speak it) is dead simple. The fancy bits required for high-volume publishers and subscribers are optional. The base profile is HTTP-based, as opposed to XMPP (see more on this below).

To dramatically simplify this spec in several places where we had to choose between supporting A or B, we took it upon ourselves to say "only A", rather than making it an implementation decision.

We offer this spec in hopes that it fills a need or at least advances the state of the discussion in the pubsub space. Polling sucks. We think a decentralized pubsub layer is a fundamental, missing layer in the Internet architecture today and its existence, more than just enabling the obvious lower latency feed readers, would enable many cool applications, most of which we can't even imagine. But we're looking forward to decentralized social networking.

@@ -437,11 +459,11 @@

This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79.

Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet-Drafts is at http://datatracker.ietf.org/drafts/current/.

Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress."

-

This Internet-Draft will expire on December 22, 2013.

+

This Internet-Draft will expire on August 8, 2014.

Copyright Notice

-

Copyright (c) 2013 IETF Trust and the persons identified as the document authors. All rights reserved.

+

Copyright (c) 2014 IETF Trust and the persons identified as the document authors. All rights reserved.

This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (http://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Simplified BSD License.

@@ -486,9 +508,9 @@

2. Definitions

Subscriber Callback URL:
The URL [RFC3986] at which a subscriber wishes to receive notifications.
Event:
-
An event that causes updates to multiple topics. For each event that happens (e.g. "Brad posted to the Linux Community."), multiple topics could be affected (e.g. "Brad posted." and "Linux community has new post"). Publisher events cause topics to be updated and the hub looks up all subscriptions for affected topics, sending out notifications to subscribers.
+
An event that causes updates to multiple topics. For each event that happens (e.g. "Brad posted to the Linux Community."), multiple topics could be affected (e.g. "Brad posted." and "Linux community has new post"). Publisher events cause topics to be updated and the hub looks up all subscriptions for affected topics, sending out notifications to subscribers.
Notification:
-
A payload describing how a topic's contents have changed, or the full updated content. Depending on the topic's content type, the difference (or "delta") may be computed by the hub and sent to all subscribers.
+
A payload describing how a topic's contents have changed, or the full updated content. Depending on the topic's content type, the difference (or "delta") may be computed by the hub and sent to all subscribers.

3. High-level protocol flow

(This section is non-normative.)

@@ -500,8 +522,8 @@

3. High-level protocol flow<
  • The hub caches minimal metadata (id, data, entry digest) about each topic's previous state. When the hub re-fetches a topic feed (on its own initiative or as a result of a publisher's ping) and finds a delta, it enqueues a notification to all registered subscribers.

    • 4. Discovery

    -

    A potential subscriber initiates discovery by retrieving (GET or HEAD request) the topic to which it wants to subscribe. The HTTP [RFC2616] response from the publisher MUST include at least one Link Header [RFC5988] with rel=hub (a hub link header) as well as exactly one Link Header [RFC5988] with rel=self (the self link header). The former MUST indicate the exact URL of a PubSubHubbub hub designated by the publisher. If more than one URL is specified, it is expected that the publisher pings each of these URLs, so the subscriber may subscribe to one or more of these. The latter will point to the permanent URL for the resource being polled.

    -

    In the absence of HTTP [RFC2616] Link headers, subscribers MAY fall back to other methods to discover the hub(s) and the canonical URI of the topic. If the topic is an XML based feed, it MAY use embedded link elements as described in Appendix B of Web Linking [RFC5988]. Similarly, for HTML pages, it MAY use embedded link elements as described in Appendix A of Web Linking [RFC5988]. Finally, publishers MAY also use the Well-Known Uniform Resource Identifiers [RFC5785] .host-meta to include the <Link> element.

    +

    A potential subscriber initiates discovery by retrieving (GET or HEAD request) the topic to which it wants to subscribe. The HTTP [RFC2616] response from the publisher MUST include at least one Link Header [RFC5988] with rel=hub (a hub link header) as well as exactly one Link Header [RFC5988] with rel=self (the self link header). The former MUST indicate the exact URL of a PubSubHubbub hub designated by the publisher. If more than one URL is specified, it is expected that the publisher pings each of these URLs, so the subscriber may subscribe to one or more of these. The latter will point to the permanent URL for the resource being polled.

    +

    In the absence of HTTP [RFC2616] Link headers, subscribers MAY fall back to other methods to discover the hub(s) and the canonical URI of the topic. If the topic is an XML based feed, it MAY use embedded link elements as described in Appendix B of Web Linking [RFC5988]. Similarly, for HTML pages, it MAY use embedded link elements as described in Appendix A of Web Linking [RFC5988]. Finally, publishers MAY also use the Well-Known Uniform Resource Identifiers [RFC5785] .host-meta to include the <Link> element with rel="hub".

    5. Subscribing and Unsubscribing

    Subscribing to a topic URL consists of four parts that may occur immediately in sequence or have a delay.

    @@ -525,15 +547,15 @@

    5.1. Subscriber Sends Su
    hub.topic
    REQUIRED. The topic URL that the subscriber wishes to subscribe to or unsubscribe from.
    hub.lease_seconds
    -
    OPTIONAL. Number of seconds for which the subscriber would like to have the subscription active. Hubs MAY choose to respect this value or not, depending on their own policies. This parameter MAY be present for unsubscription requests and MUST be ignored by the hub in that case.
    +
    OPTIONAL. Number of seconds for which the subscriber would like to have the subscription active. Hubs MAY choose to respect this value or not, depending on their own policies. This parameter MAY be present for unsubscription requests and MUST be ignored by the hub in that case.
    hub.secret
    OPTIONAL. A subscriber-provided secret string that will be used to compute an HMAC digest for authorized content distribution [authednotify]. If not supplied, the HMAC digest will not be present for content distribution requests. This parameter SHOULD only be specified when the request was made over HTTPS [RFC2818]. This parameter MUST be less than 200 bytes in length.
    -

    Subscribers MAY also include additional HTTP [RFC2616] request parameters, as well as HTTP [RFC2616] Headers if they are required by the hub. In the context of social web applications, it is considered good practice to include a From HTTP [RFC2616] header (as described in section 14.22 of Hypertext Transfer Protocol [RFC2616]) to indicate on behalf of which user the subscription is being performed.

    +

    Subscribers MAY also include additional HTTP [RFC2616] request parameters, as well as HTTP [RFC2616] Headers if they are required by the hub. In the context of social web applications, it is considered good practice to include a From HTTP [RFC2616] header (as described in section 14.22 of Hypertext Transfer Protocol [RFC2616]) to indicate on behalf of which user the subscription is being performed.

    Hubs MUST ignore additional request parameters they do not understand.

    Hubs MUST allow subscribers to re-request subscriptions that are already activated. Each subsequent request to a hub to subscribe or unsubscribe MUST override the previous subscription state for a specific topic URL and callback URL combination once the action is verified. Any failures to confirm the subscription action MUST leave the subscription state unchanged. This is required so subscribers can renew their subscriptions before the lease seconds period is over without any interruption.

    5.1.1. Subscription Parameter Details

    -

    The topic and callback URLs MAY use HTTP [RFC2616] or HTTPS [RFC2818] schemes. The topic URL MUST be the one advertised by the publisher in a Self Link Header during the discovery phase. (See Section 4). Hubs MAY refuse subscriptions if the topic URL does not correspond to the one advertised by the publisher. The topic URL can otherwise be free-form following the URI spec [RFC3986]. Hubs MUST always decode non-reserved characters for these URL parameters; see section 2.4 on "When to Encode or Decode" in the URI spec [RFC3986].

    +

    The topic and callback URLs MAY use HTTP [RFC2616] or HTTPS [RFC2818] schemes. The topic URL MUST be the one advertised by the publisher in a Self Link Header during the discovery phase. (See Section 4). Hubs MAY refuse subscriptions if the topic URL does not correspond to the one advertised by the publisher. The topic URL can otherwise be free-form following the URI spec [RFC3986]. Hubs MUST always decode non-reserved characters for these URL parameters; see section 2.4 on "When to Encode or Decode" in the URI spec [RFC3986].

    The callback URL MAY contain arbitrary query string parameters (e.g., ?foo=bar&red=fish). Hubs MUST preserve the query string during subscription verification by appending new parameters to the end of the list using the & (ampersand) character to join. Existing parameters with names that overlap with those used by verification requests will not be overwritten. For event notification, the callback URL will be POSTed to including any query-string parameters in the URL portion of the request, not as POST body parameters.

    5.1.2. Subscription Response Details

    The hub MUST respond to a subscription request with an HTTP [RFC2616] 202 "Accepted" response to indicate that the request was received and will now be verified (Section 5.3) and validated (Section 5.2) by the hub. The hub SHOULD perform the verification and validation of intent as soon as possible.

    @@ -580,7 +602,7 @@

    7. The request MUST include a Link Header [RFC5988] with rel=hub pointing to the Hub as well as a Link Header [RFC5988] with rel=self set to the topic that's being updated. The Hub SHOULD combine both headers into a single Link Header [RFC5988].

    The successful response from the subscriber's callback URL MUST be an HTTP [RFC2616] success (2xx) code. The hub MUST consider all other subscriber response codes as failures; that means subscribers MUST NOT use HTTP redirects for moving subscriptions. The response body from the subscriber MUST be ignored by the hub. Hubs SHOULD retry notifications repeatedly until successful (up to some reasonable maximum over a reasonable time period). Subscribers SHOULD respond to notifications as quickly as possible; their success response code SHOULD only indicate receipt of the message, not acknowledgment that it was successfully processed by the subscriber.

    8. Authenticated Content Distribution

    -

    If the subscriber supplied a value for hub.secret in their subscription request, the hub MUST generate an HMAC signature of the payload and include that signature in the request headers of the content distribution request. The X-Hub-Signature header's value MUST be in the form sha1=signature where signature is a 40-byte, hexadecimal representation of a SHA1 signature [RFC3174]. The signature MUST be computed using the HMAC algorithm [RFC2104] with the request body as the data and the hub.secret as the key.

    +

    If the subscriber supplied a value for hub.secret in their subscription request, the hub MUST generate an HMAC signature of the payload and include that signature in the request headers of the content distribution request. The X-Hub-Signature header's value MUST be in the form sha1=signature where signature is a 40-byte, hexadecimal representation of a SHA1 signature [RFC3174]. The signature MUST be computed using the HMAC algorithm [RFC2104] with the request body as the data and the hub.secret as the key.

    When subscribers receive a content distribution request with the X-Hub-Signature header specified, they SHOULD recompute the SHA1 signature with the shared secret using the same method as the hub. If the signature does not match, subscribers MUST still return a 2xx success response to acknowledge receipt, but locally ignore the message as invalid. Using this technique along with HTTPS [RFC2818] for subscription requests enables simple subscribers to receive authenticated notifications from hubs without the need for subscribers to run an HTTPS [RFC2818] server.

    Please note however that this signature only ensures that the payload was not forged. Since the notification also includes headers, these should not be considered as safe by the subscriber, unless of course the subscriber uses HTTPS [RFC2818] callbacks.

    9. References

    @@ -590,25 +612,25 @@

    9. References

    [RFC2104] - Krawczyk, H., Bellare, M. and R. Canetti, "HMAC: Keyed-Hashing for Message Authentication", RFC 2104, + Krawczyk, H., Bellare, M. and R. Canetti, "HMAC: Keyed-Hashing for Message Authentication", RFC 2104, Feb 1997. [RFC2119] - Bradner, B., "Key words for use in RFCs to Indicate Requirement Levels", RFC 2119, + Bradner, B., "Key words for use in RFCs to Indicate Requirement Levels", RFC 2119, Mar 1997. [RFC2606] - Eastlake, D. and A. Panitz, "Reserved Top Level DNS Names", RFC 2606, + Eastlake, D. and A. Panitz, "Reserved Top Level DNS Names", RFC 2606, Jun 1999. [RFC2616] - Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P. and T. Berners-Lee, "Hypertext Transfer Protocol -- HTTP/1.1", RFC 2616, + Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P. and T. Berners-Lee, "Hypertext Transfer Protocol -- HTTP/1.1", RFC 2616, Jun 1999. @@ -626,13 +648,13 @@

    9. References

    [RFC3986] - Berners-Lee, T., "Uniform Resource Identifiers (URI): Generic Syntax", RFC 3986, + Berners-Lee, T., "Uniform Resource Identifiers (URI): Generic Syntax", RFC 3986, Jan 2005. [RFC5785] - Nottingham, M. and E. Hammer-Lahav, "Defining Well-Known Uniform Resource Identifiers (URIs)", RFC 5785, + Nottingham, M. and E. Hammer-Lahav, "Defining Well-Known Uniform Resource Identifiers (URIs)", RFC 5785, Apr 2010. @@ -650,12 +672,12 @@

    9. References

    [XEP-0060] - Millard, P., Saint-Andre, P. and R. Meijer, "Publish-Subscribe", XSF XEP 0060, + Millard, P., Saint-Andre, P. and R. Meijer, "Publish-Subscribe", XSF XEP 0060, Jul 2010.

    Appendix A. Specification Feedback

    -

    Feedback on this specification is welcomed via the PubSubHubbub W3C Community Group. For more information, see the W3C PubSubHubbub Community Group.

    +

    Feedback on this specification is welcomed via the PubSubHubbub W3C Community Group.For more information, see the W3C PubSubHubbub Community Group.

    Authors' Addresses

    @@ -746,4 +768,4 @@

    - \ No newline at end of file + From e33182056c2d3d4b30f2b8ad1b5ff6a29b5f605b Mon Sep 17 00:00:00 2001 From: julien Date: Tue, 4 Feb 2014 10:58:12 +0100 Subject: [PATCH 64/76] updated README --- README.md | 6 ++---- 1 file changed, 2 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index f96c0b3..973682d 100644 --- a/README.md +++ b/README.md @@ -1,7 +1,7 @@ PubSubHubbub ============ -PubSubHubbub is an open protocol for distributed publish/subscribe communication on the Internet. It generalizes the concept of webhooks +**PubSubHubbub** is an open protocol for distributed publish/subscribe communication on the Internet. It generalizes the concept of webhooks and allows data produces and data consumers to work in a decoupled way. PubSubHubbub provides a way to subscribe, unsubscribe and receive updates from a resource, whether it's an RSS or Atom feed or any web accessible document (JSON...). @@ -12,7 +12,5 @@ Open hubs are provided by: * [Superfeedr](http://pubsubhubbub.superfeedr.com/) * [Google](http://pubsubhubbub.appspot.com/) -Several other publishing platforms, like Wordpress, include their own hub. - -Learn more about the project at [Google Code](http://code.google.com/p/pubsubhubbub/) (some info might be out of date) or use the [test suite to test compliance](http://tests.superfeedr.com/) for an existing hub. +Several other publishing platforms, like Wordpress, include their own hubs. From fd27c84ee3dfcf9b51c45fe6da7543a1a1b58c37 Mon Sep 17 00:00:00 2001 From: Julien Genestoux Date: Tue, 10 Feb 2015 16:03:34 +0100 Subject: [PATCH 65/76] Update README.md Adding a link to the getting started tutorial. --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index 973682d..f8e4816 100644 --- a/README.md +++ b/README.md @@ -14,3 +14,5 @@ Open hubs are provided by: Several other publishing platforms, like Wordpress, include their own hubs. +If you're looking for a tutorial on how to get started with PubSubHubbub, [check this one](http://blog.superfeedr.com/howto-pubsubhubbub/) published by Superfeedr. + From 484b5bef4995bec38c2f60bda4bd20a4a22ae20e Mon Sep 17 00:00:00 2001 From: Christian Weiske Date: Wed, 11 Mar 2015 06:25:54 +0100 Subject: [PATCH 66/76] Make MUST uppercase in 5.3 --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index 0306f9d..bb21681 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -128,7 +128,7 @@ The subscription MAY be denied by the hub at any point (even if it was previously accepted). The Subscriber SHOULD then consider that the subscription is not possible anymore.
    - In order to prevent an attacker from creating unwanted subscriptions on behalf of a subscriber (or unsubscribing desired ones), a hub must ensure that the subscriber did indeed send the subscription request. + In order to prevent an attacker from creating unwanted subscriptions on behalf of a subscriber (or unsubscribing desired ones), a hub MUST ensure that the subscriber did indeed send the subscription request. The hub verifies a subscription request by sending an HTTP GET request to the subscriber's callback URL as given in the subscription request. This request has the following query string arguments appended (format described in Section 17.13.4 of ): From 369f3adc7a590a0b8423ffd86fa37c9682c1ad39 Mon Sep 17 00:00:00 2001 From: Thomas Themel Date: Thu, 26 Mar 2015 17:43:42 +0100 Subject: [PATCH 67/76] Fix an ancient type in previous spec version. --- pubsubhubbub-core-0.3.html | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/pubsubhubbub-core-0.3.html b/pubsubhubbub-core-0.3.html index 3928375..8c6dabc 100644 --- a/pubsubhubbub-core-0.3.html +++ b/pubsubhubbub-core-0.3.html @@ -425,7 +425,7 @@

    Table of Contents

    Hubs MUST use the same URL for both the publishing and subscribing interfaces, which is why only a single atom:link - element is required to declare a hub. Publishers SHOULD use HTTPS (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] in their hubs' discovery URLs. However, + element is required to declare a hub. Publishers SHOULD use HTTPS (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616] in their hubs' discovery URLs. However, subscribers that do not support HTTPS (Rescorla, E., “HTTP Over TLS,” May 2000.) [RFC2818] MAY try to fallback to HTTP (Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and T. Berners-Lee, “Hypertext Transfer Protocol -- HTTP/1.1,” .) [RFC2616], which MAY work depending on the hub's policy. @@ -875,7 +875,7 @@

    Table of Contents

    This allows the hub to generate a single X-Hub-Signature header to sign the entire payload. Hubs MUST return an error response (4xx, 5xx) for subscription requests with overlapping callback URLs and different secret values. - +

    With an aggregated set of feeds, the hub SHOULD reproduce all of the elements from the source feed inside the @@ -1012,7 +1012,7 @@

    9. References

    FAQ and other documentation. - +


     TOC 
    From c1e71e6ced28aad58064b65c6173113ed9561ae6 Mon Sep 17 00:00:00 2001 From: Thomas Themel Date: Thu, 26 Mar 2015 17:53:44 +0100 Subject: [PATCH 68/76] Fix XML namespaces in examples. --- pubsubhubbub-core-0.3.html | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/pubsubhubbub-core-0.3.html b/pubsubhubbub-core-0.3.html index 8c6dabc..1041424 100644 --- a/pubsubhubbub-core-0.3.html +++ b/pubsubhubbub-core-0.3.html @@ -345,7 +345,7 @@

    Table of Contents

    to know whether or not they'd missed any recent items-- like TCP SACK) MAY be provided as context. Some examples of Atom feed entries follow. 

    <?xml version="1.0"?>
-<atom:feed>
+<feed xmlns="http://www.w3.org/2005/Atom">
   <!-- Normally here would be source, title, author, id, etc ... -->
 
   <link rel="hub" href="http://myhub.example.com/endpoint" />
@@ -392,7 +392,7 @@ 
    Table of Contents
    
     <updated>2008-07-10T12:28:13Z</updated>
   </entry>
 
-</atom:feed>
+</feed>

     TOC 
    @@ -410,7 +410,7 @@

    Table of Contents

    Example: 

    <?xml version="1.0"?>
-<atom:feed>
+<feed xmlns="http://www.w3.org/2005/Atom">
   <!-- Normally here would be source, title, author, id, etc ... -->
   <link rel="hub" href="https://myhub.example.com/endpoint" />
   <link rel="self" href="http://publisher.example.com/topic.xml" />
@@ -421,7 +421,7 @@ 
    Table of Contents
    
   <entry>
      ....
   </entry>
-</atom:feed>
+</feed>

    Hubs MUST use the same URL for both the publishing and subscribing interfaces, which is why only a single atom:link @@ -892,7 +892,7 @@

    Table of Contents

    Example aggregated feed: 

    <?xml version="1.0"?>
-<atom:feed>
+<feed xmlns="http://www.w3.org/2005/Atom">
   <title>Aggregated feed</title>
   <updated>2008-08-11T02:17:44Z</updated>
   <id>http://myhub.example.com/aggregated?1232427842-39823</id>
@@ -931,7 +931,7 @@ 
    Table of Contents
    
     </content>
   </entry>
 
-</atom:feed>
+<feed>

     TOC 
    From 26e048b62f16f64db31f7b9884a4615ba1a978fb Mon Sep 17 00:00:00 2001 From: Aaron Parecki Date: Thu, 2 Apr 2015 21:11:32 -0500 Subject: [PATCH 69/76] add more hubs and link to more docs --- README.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index f8e4816..549085b 100644 --- a/README.md +++ b/README.md @@ -11,8 +11,12 @@ The current version of the spec is 0.4. Please, [read it here](http://pubsubhubb Open hubs are provided by: * [Superfeedr](http://pubsubhubbub.superfeedr.com/) * [Google](http://pubsubhubbub.appspot.com/) +* Aaron Parecki: [p3k](https://switchboard.p3k.io/) +* Christian Weiske: [phubb](http://indiewebcamp.com/phubb) Several other publishing platforms, like Wordpress, include their own hubs. -If you're looking for a tutorial on how to get started with PubSubHubbub, [check this one](http://blog.superfeedr.com/howto-pubsubhubbub/) published by Superfeedr. +If you're looking for tutorials on how to get started with PubSubHubbub, check the links below: +* [How to PubSubHubbub](http://blog.superfeedr.com/howto-pubsubhubbub/) by Superfeedr +* [How to publish and consume PubSubHubbub](http://indiewebcamp.com/How_to_publish_and_consume_PubSubHubbub) on indiewebcamp.com From e6561585fe0b5721eb0e258f1cb7e57ce4d63996 Mon Sep 17 00:00:00 2001 From: Aaron Parecki Date: Tue, 19 May 2015 08:12:05 -0700 Subject: [PATCH 70/76] allow topic URL in places other than the Link header For #31 --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index bb21681..d918d6c 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -105,7 +105,7 @@ Hubs MUST ignore additional request parameters they do not understand. Hubs MUST allow subscribers to re-request subscriptions that are already activated. Each subsequent request to a hub to subscribe or unsubscribe MUST override the previous subscription state for a specific topic URL and callback URL combination once the action is verified. Any failures to confirm the subscription action MUST leave the subscription state unchanged. This is required so subscribers can renew their subscriptions before the lease seconds period is over without any interruption.
    - The topic and callback URLs MAY use HTTP or HTTPS schemes. The topic URL MUST be the one advertised by the publisher in a Self Link Header during the discovery phase. (See ). Hubs MAY refuse subscriptions if the topic URL does not correspond to the one advertised by the publisher. The topic URL can otherwise be free-form following the URI spec. Hubs MUST always decode non-reserved characters for these URL parameters; see section 2.4 on "When to Encode or Decode" in the URI spec. + The topic and callback URLs MAY use HTTP or HTTPS schemes. The topic URL MUST be the one advertised by the publisher during the discovery phase. (See ). Hubs MAY refuse subscriptions if the topic URL does not correspond to the one advertised by the publisher. The topic URL can otherwise be free-form following the URI spec. Hubs MUST always decode non-reserved characters for these URL parameters; see section 2.4 on "When to Encode or Decode" in the URI spec. The callback URL MAY contain arbitrary query string parameters (e.g., ?foo=bar&red=fish). Hubs MUST preserve the query string during subscription verification by appending new parameters to the end of the list using the & (ampersand) character to join. Existing parameters with names that overlap with those used by verification requests will not be overwritten. For event notification, the callback URL will be POSTed to including any query-string parameters in the URL portion of the request, not as POST body parameters.
    From 25ed1015b954ca2a7e24e8c8bbc1d350ffca84c0 Mon Sep 17 00:00:00 2001 From: Christian Weiske Date: Wed, 27 May 2015 16:04:22 +0200 Subject: [PATCH 71/76] link to the real phubb instance --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 549085b..1a5c410 100644 --- a/README.md +++ b/README.md @@ -12,7 +12,7 @@ Open hubs are provided by: * [Superfeedr](http://pubsubhubbub.superfeedr.com/) * [Google](http://pubsubhubbub.appspot.com/) * Aaron Parecki: [p3k](https://switchboard.p3k.io/) -* Christian Weiske: [phubb](http://indiewebcamp.com/phubb) +* Christian Weiske: [phubb](http://phubb.cweiske.de/) Several other publishing platforms, like Wordpress, include their own hubs. From d36024b330b45f521f08218e35f3adcb1bc37a34 Mon Sep 17 00:00:00 2001 From: Mike Krumlauf Date: Fri, 29 May 2015 10:51:41 -0400 Subject: [PATCH 72/76] Fix typo Line 5 - from "produces" to "producers" --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 1a5c410..abf967c 100644 --- a/README.md +++ b/README.md @@ -2,7 +2,7 @@ PubSubHubbub ============ **PubSubHubbub** is an open protocol for distributed publish/subscribe communication on the Internet. It generalizes the concept of webhooks -and allows data produces and data consumers to work in a decoupled way. +and allows data producers and data consumers to work in a decoupled way. PubSubHubbub provides a way to subscribe, unsubscribe and receive updates from a resource, whether it's an RSS or Atom feed or any web accessible document (JSON...). From cb2d5eb08783ebf98c080ed9345ed7096bd4f817 Mon Sep 17 00:00:00 2001 From: Aaron Parecki Date: Wed, 30 Sep 2015 09:34:40 -0700 Subject: [PATCH 73/76] remove reference to From header since it is unused in the spec and was mentioned only as "best practice" rather than SHOULD or MUST --- pubsubhubbub-core-0.4.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index d918d6c..cd29c98 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -101,7 +101,7 @@ OPTIONAL. A subscriber-provided secret string that will be used to compute an HMAC digest for authorized content distribution. If not supplied, the HMAC digest will not be present for content distribution requests. This parameter SHOULD only be specified when the request was made over HTTPS. This parameter MUST be less than 200 bytes in length. - Subscribers MAY also include additional HTTP request parameters, as well as HTTP Headers if they are required by the hub. In the context of social web applications, it is considered good practice to include a From HTTP header (as described in section 14.22 of Hypertext Transfer Protocol) to indicate on behalf of which user the subscription is being performed. + Subscribers MAY also include additional HTTP request parameters, as well as HTTP Headers if they are required by the hub. Hubs MUST ignore additional request parameters they do not understand. Hubs MUST allow subscribers to re-request subscriptions that are already activated. Each subsequent request to a hub to subscribe or unsubscribe MUST override the previous subscription state for a specific topic URL and callback URL combination once the action is verified. Any failures to confirm the subscription action MUST leave the subscription state unchanged. This is required so subscribers can renew their subscriptions before the lease seconds period is over without any interruption.
    From 6111df7757cec52c6780fabdd67d9220edbba7c1 Mon Sep 17 00:00:00 2001 From: klemens Date: Sat, 28 Jan 2017 19:26:57 +0100 Subject: [PATCH 74/76] spelling fixes --- pubsubhubbub-core-0.3.html | 2 +- pubsubhubbub-core-0.4.xml | 2 +- pubsubhubbub-core.xml | 4 ++-- 3 files changed, 4 insertions(+), 4 deletions(-) diff --git a/pubsubhubbub-core-0.3.html b/pubsubhubbub-core-0.3.html index 1041424..b26296b 100644 --- a/pubsubhubbub-core-0.3.html +++ b/pubsubhubbub-core-0.3.html @@ -154,7 +154,7 @@


    PubSubHubbub Core 0.3 -- Working Draft

    Abstract

    An open, simple, web-scale pubsub protocol, along with an open source - reference implentation targetting Google App Engine. Notably, however, + reference implentation targeting Google App Engine. Notably, however, nothing in the protocol is centralized, or Google- or App Engine-specific. Anybody can play.

    diff --git a/pubsubhubbub-core-0.4.xml b/pubsubhubbub-core-0.4.xml index cd29c98..590123a 100644 --- a/pubsubhubbub-core-0.4.xml +++ b/pubsubhubbub-core-0.4.xml @@ -1,6 +1,6 @@ -