Googles Leaked Content Warehouse API Documentation

API client metadata for GoogleApi.ContentWarehouse.V1.

API calls for all endpoints tagged Projects.

Handle Tesla connections for GoogleApi.ContentWarehouse.V1.

Attributes

• id (type:String.t, default:nil) -

• subtype (type:String.t, default:nil) - Optional client specific subtype of abuse that is too specific to belong in the above enumeration. For example, some client may want to differentiate nudity from graphic sex, but both are PORNOGRAPHY.

Attributes

• ageYears (type:integer(), default:nil) - This restriction applies if the user is between [min_age_years, age_years) years old.

• minAgeYears (type:integer(), default:nil) -

Attributes

• child (type:list(GoogleApi.ContentWarehouse.V1.Model.AbuseiamUserRestriction.t), default:nil) - This restriction applies if all of the children apply.

A client is be a Google product, or subproduct that provides content for AbuseIAm to classify.

Attributes

• type (type:String.t, default:nil) - A constant of type TRUE always applies, and of type FALSE never applies.

Pair of Verdicts used for ProjectR age/geo gating. See http://go/projectr for more information.

Backends return Evaluations to AbuseIAm. One of the things Evaluations are used for is to explain Verdicts.

A node representing a table of regions and restrictions that apply to those regions. This table understands region inclusion and knows to apply the most specific rule, for example, a rule for France would override a rule for the EU for a user in France.

Attributes

• location (type:String.t, default:nil) - The location where the restriction applies. Defaults to the "The world". See go/iii.

• restriction (type:GoogleApi.ContentWarehouse.V1.Model.AbuseiamUserRestriction.t, default:nil) - The UserRestriction that applies to this location. If not specified evaluates to true.

Information about various hashes that can be computed on a message ex: simhash, attachment hash, etc

Attributes

• name (type:String.t, default:nil) -

• nonUtf8Value (type:String.t, default:nil) -

• value (type:String.t, default:nil) -

Attributes

• child (type:list(GoogleApi.ContentWarehouse.V1.Model.AbuseiamUserRestriction.t), default:nil) - This restriction applies if the child does not apply. Only one is allowed. "repeated" is used to avoid breaking Sawzall (See b/6758277).

Attributes

• child (type:list(GoogleApi.ContentWarehouse.V1.Model.AbuseiamUserRestriction.t), default:nil) - This restriction applies if any of the children apply.

Attributes

• region (type:String.t, default:nil) - This is a CLDR Region Code: http://wiki/Main/IIIHowTo#using_region It is used to denote the region affected by a verdict.

A SpecialRestriction is a standardized UserRestriction which lives in a table maintained via CDD.

Attributes

• id (type:String.t, default:nil) -

• type (type:String.t, default:nil) -

A structure used to configure a notification to a user.

Describes restrictions on where the verdict applies. Please use {@code TakedownManager} to evaluate this proto.

Verdict against a target. AbuseIAm generates a verdict based on evaluations. AbuseIAm can send such verdicts to clients for enforcement.

Describes restrictions on where the verdict applies.

Describes a dimension of a context where a verdict applies.

The serialized form of a SORI id. NOTE that this proto is stored in V4/O4 index and that new fields should not be added without getting an agreement from the serving team as well.

Attributes

• anchor (type:list(GoogleApi.ContentWarehouse.V1.Model.AnchorsAnchor.t), default:nil) -

• homepageAnchorsDropped (type:String.t, default:nil) - The total # of local homepage anchors dropped in AnchorAccumulator.

• indexTier (type:integer(), default:nil) - The index tier from which the anchors were extracted. Note that this is only valid in the anchor record written by linkextractor. The value can be one of the enum values defined in segindexer/types.h.

• localAnchorsDropped (type:String.t, default:nil) - The total # of local non-homepage anchors dropped in AnchorAccumulator.

• nonlocalAnchorsDropped (type:String.t, default:nil) - The total # of non-local anchors dropped in AnchorAccumulator.

• redundantAnchorsDropped (type:String.t, default:nil) - The *_anchors_dropped fields below are not populated by Alexandria, which uses cdoc.anchor_stats instead. The total # of redundant anchors dropped in linkextractor.

• redundantanchorinfo (type:list(GoogleApi.ContentWarehouse.V1.Model.AnchorsRedundantAnchorInfo.t), default:nil) -

• supplementalAnchorsDropped (type:String.t, default:nil) - The total # of supplemental anchors dropped in AnchorAccumulator. ## DEPRECATED.

• targetDocid (type:String.t, default:nil) - may be implicit

• targetSite (type:String.t, default:nil) - HOST_LEVEL site chunking.

• targetUrl (type:String.t, default:nil) - This is produced during link extraction but not written out in the linklogs in order to save space.

Attributes

• creationDate (type:integer(), default:nil) - used for history - the first and last time we have seen this anchor. creation_date also used for Freshdocs Twitter indexing, a retweet is an anchor of the original tweet. This field records the time when a retweet is created.

• origText (type:String.t, default:nil) - Original text, including capitalization and punctuation. Runs of whitespace are collapsed into a single space.

• context2 (type:integer(), default:nil) - This is a hash of terms near the anchor. (This is a second-generation hash replacing the value stored in the 'context' field.)

• fontsize (type:integer(), default:nil) -

• experimental (type:boolean(), default:nil) - If true, the anchor is for experimental purposes and should not be used in serving.

• fragment (type:String.t, default:nil) - The URL fragment for this anchor (the foo in http://www.google.com#foo)

• sourceType (type:integer(), default:nil) - is to record the quality of the anchor's source page and is correlated with but not identical to the index tier of the source page. In the docjoins built by the indexing pipeline (Alexandria), - Anchors marked TYPE_HIGH_QUALITY are from base documents. - Anchors marked TYPE_MEDIUM_QUALITY are from documents of medium quality (roughly but not exactly supplemental tier documents). - Anchors marked TYPE_LOW_QUALITY are from documents of low quality (roughly but not exactly blackhole documents). Note that the source_type can also be used as an importance indicator of an anchor (a lower source_type value indicates a more important anchor), so it is important to enforce that TYPE_HIGH_QUALITY < TYPE_MEDIUM_QUALITY < TYPE_LOW_QUALITY To add a new source type in future, please maintain the proper relationship among the types as well. TYPE_FRESHDOCS, only available in freshdocs indexing, is a special case and is considered the same type as TYPE_HIGH_QUALITY for the purpose of anchor importance in duplicate anchor removal.

• pagerankWeight (type:number(), default:nil) - Weight to be stored in linkmaps for pageranker

• isLocal (type:boolean(), default:nil) - The bit ~roughly~ indicates whether an anchor's source and target pages are on the same domain. Note: this plays no role in determining whether an anchor is onsite, ondomain, or offdomain in mustang (i.e., the bit above).

• originalTargetDocid (type:String.t, default:nil) - The docid of the anchor's original target. This field is available if and only if the anchor is forwarded.

• fullLeftContext (type:list(String.t), default:nil) - The full context. These are not written out in the linklogs.

• expired (type:boolean(), default:nil) - true iff exp domain

• catfishTags (type:list(integer()), default:nil) - CATfish tags attached to a link. These are similar to link tags, except the values are created on the fly within Cookbook. See: http://sites/cookbook/exporting/indexing

• deletionDate (type:integer(), default:nil) -

• linkTags (type:list(integer()), default:nil) - Contains info on link type, source page, etc.

• forwardingTypes (type:integer(), default:nil) - How the anchor is forwarded to the canonical, available only for forwarded anchors (i.e., the field is set). The forwarding types are defined in URLForwardingUtil (segindexer/segment-indexer-util.h). Always use URLForwardingUtil to access this field and use URLForwardingUtil::GetAnchorForwardingReason to get the explanation how the anchor is forwarded to the canonical. NOTE: Use with caution as it is only set for docjoins generated using the urlmap from repository/updater.

• possiblyOldFirstseenDate (type:boolean(), default:nil) - DEPRECATED. It used to be set if firstseen_date is not set. It's to indicate that the anchor is possibly old, but we don't have enough information to tell until the linkage map is updated. TODO(hxu) rename it to possibly_old_firstseen_date_DEPRECATED after clean up other dependencies.

• locality (type:integer(), default:nil) - For ranking purposes, the quality of an anchor is measured by its "locality" and "bucket". See quality/anchors/definitions.h for more information.

• demotionreason (type:integer(), default:nil) - DEPRECATED

• parallelLinks (type:integer(), default:nil) - The number of additional links from the same source page to the same target domain. Not populated if is_local is true.

• text (type:String.t, default:nil) - Space-delimited anchor words. Text that needs segmentation (like CJK or Thai) is unsegmented, since we set FLAGS_segment_during_lexing to false in mr-linkextractor.cc .

• source (type:GoogleApi.ContentWarehouse.V1.Model.AnchorsAnchorSource.t, default:nil) -

• bucket (type:integer(), default:nil) -

• fullRightContext (type:list(String.t), default:nil) -

• targetUrlEncoding (type:integer(), default:nil) - A given target URL may be found in different encodings in different documents. We store the URL encoding with each source anchor so that we can count them later to find the encoding most likely to be expected by the Web site. Around 0.7% of target URLs are expected to require a non-default value here. The default value 0 is referenced in C++ as webutil::kDefaultUrlEncoding. See also webutil/urlencoding.

• compressedOriginalTargetUrl (type:String.t, default:nil) - The anchor's original target url, compressed. Available only in Alexandria docjoins when the anchor is forwarded.

• firstseenDate (type:integer(), default:nil) - # days past Dec 31, 1994, 23:00:00 UTC (Unix time @788914800) that this link was first seen. Should never occupy more than 15 bits. NOTE: this is NOT the same as creation_date; firstseen_date is filled during link extraction

• setiPagerankWeight (type:number(), default:nil) - TEMPORARY

• context (type:integer(), default:nil) -

• linkAdditionalInfo (type:GoogleApi.ContentWarehouse.V1.Model.Proto2BridgeMessageSet.t, default:nil) - Additional information related to the anchor, such as additional anchor text or scores.

• type (type:integer(), default:nil) - DEPRECATED: Now in link_tags

• firstseenNearCreation (type:boolean(), default:nil) - true if we think 'firstseen_date' is an accurate estimate of when the link was actually added to the source page. false if it may have existed for some time before we saw it.

• lastUpdateTimestamp (type:integer(), default:nil) - Used for history and freshness tracking - the timestamp this anchor is updated in indexing.

• offset (type:integer(), default:nil) - This is the offset for the first term in the anchor - it can be used as a unique ID for the anchor within the document and compared against all per-tag data. This is measured in bytes from the start of the document. We write this out to the linklogs to recover the original order of links after source/target forwarding. This is necessary for computing the global related data.

• weight (type:integer(), default:nil) - weights are 0-127

• deleted (type:boolean(), default:nil) -

• encodedNewsAnchorData (type:integer(), default:nil) - Encoded data containing information about newsiness of anchor. Populated only if anchor is classified as coming from a newsy, high quality site. Encoded data for anchor sources are being stored in googledata/quality/freshness/news_anchors/encoded_news_anchors_data.txt Scores are being computed with quality/freshness/news_anchors/ routines.

• compressedImageUrls (type:list(String.t), default:nil) - If the anchor contained images, these image urls are stored here in compressed form.

• timestamp (type:String.t, default:nil) - This field is DEPRECATED and no longer filled. For source page crawl timestamp, use Source.crawl_timestamp. Next tag id should be 62.

attributes of the source document for the link

NOTE: in docjoins, the following anchor sampling information is only ## available in the first record of a document (under the same docid). The total number of redundant anchors dropped per (domain, text) in linkextractor. If we receive a large number of anchors from a particular domain, then we'll throw out all but a sampling of them from that domain. The data is sorted by the (domain,text) pairs. This field is not populated by Alexandria, which uses cdoc.anchor_stats instead.

Represents a GSuite customer ID. Obfuscated with CustomerIdObfuscator.

Contains info about the entity that something is, or is owned by.

Intentionally empty. Used to disambiguate consumer and customer use cases in oneof below.

Attributes

• customerId (type:GoogleApi.ContentWarehouse.V1.Model.AppsDynamiteCustomerId.t, default:nil) -

Contains info on membership count for member types: HUMAN_USER, APP_USER & ROSTER_MEMBER different states: INVITED, JOINED

Attributes

• value (type:list(GoogleApi.ContentWarehouse.V1.Model.AppsDynamiteSharedSegmentedMembershipCount.t), default:nil) -

A DestinationStream is a /namespace/id[0]/id[1]/.../id[n] that represents a collection of Activities. Example destinations: -The Profile Stream on http://plus.google.com/+JohnDoe/posts -A Square Stream on http://plus.google.com/squares/123 -A "comment Stream" (Fountain) on http://www.youtube.com/watch?id=123 It's possible for a single Activity to show in each of these destinations - and it might behave/look slightly differently for each one. Destinations can have their own business logic associated with them at both write-time and read-time server-side (these are documented below). Each DestinationStream is indexed and can be retrieved using the GetDestinationStreamRequest. For the repeated ID space indexing happens at all levels, e.g. if you have: /square/123/abc /square/123/efd /square/456 You can fetch /square/123/abc directly or /square/123 (which includes all Activities in both /square/123/abc and /square/123/efd), or even /square which retrieves all Activities in the Square namespace (visible for that user). On the storage layer, we represent DestinationStream as Channel (http://cs/#google3/social/common/channel/channel.proto), since the storage does not have the concept of a Stream. Both terms are used interchangeably within the service layer, but client of Social Infrastructure should use the term DestinationStream. Next ID: 3

Stores the number of different kind of user engagement actions. Abuse Report is also consider an engagement. Currently we only have abuse report engagements but in future we might add other types of engagements as well.

Attributes

• contentType (type:String.t, default:nil) -

• metadata (type:GoogleApi.ContentWarehouse.V1.Model.AppsPeopleOzExternalMergedpeopleapiPersonFieldMetadata.t, default:nil) -

• safeHtmlValue (type:GoogleApi.ContentWarehouse.V1.Model.WebutilHtmlTypesSafeHtmlProto.t, default:nil) - Sanitized HTML value that is only populated when the SANITIZE_ABOUT_HTML extension is requested.

• value (type:String.t, default:nil) -

Extension data for use in AboutMe.

See NameDisplayOptions in //depot/google3/focus/backend/proto/backend.proto. See also go/nickname-mess.

Attributes

• diffData (type:GoogleApi.ContentWarehouse.V1.Model.AppsPeopleOzExternalMergedpeopleapiAboutMeExtendedDataPhotosCompareDataDiffData.t, default:nil) -

• highResUrl (type:String.t, default:nil) -

• inconsistentPhoto (type:boolean(), default:nil) - True if photo diff is greater than 0.01 on any color band, or if the user has a low res photo but no high res photo. This field is primarily for use in About Me and for other uses it's recommended to use the DiffData values directly instead. The cutoff is based on a heuristic determined in go/comparing-profile-photos

• lowResData (type:String.t, default:nil) - Only present if the photo diff is greater than 0.01 on any color band.

• lowResUrl (type:String.t, default:nil) -

• monogramUrl (type:String.t, default:nil) -

• privateLowResAcl (type:boolean(), default:nil) - True if the low-res photo has a private ACL set.

Attributes

• blueDiff (type:number(), default:nil) -

• greenDiff (type:number(), default:nil) -

• redDiff (type:number(), default:nil) -

See UserEditedLockedMask in //depot/google3/focus/backend/proto/backend.proto.

See ABUSE_NAME_LAST_MODIFIED in //depot/google3/focus/backend/proto/backend.proto which maps to //depot/google3/focus/proto/profileattribute.proto

Attributes

• email (type:String.t, default:nil) -

Additional information about a container. TO BE DELETED: replaced by DeviceContactInfo.

Attributes

• country (type:String.t, default:nil) -

• countryCode (type:String.t, default:nil) -

• encodedPlaceId (type:String.t, default:nil) - FeatureId associated with the address. The format is the same as that used for ids in PLACE containers in SourceIdentity.

• extendedAddress (type:String.t, default:nil) -

• formatted (type:String.t, default:nil) -

• formattedType (type:String.t, default:nil) - The type translated and formatted in the request locale. See go/people-api-howto/localization for details on how to usage.

• locality (type:String.t, default:nil) -

• metadata (type:GoogleApi.ContentWarehouse.V1.Model.AppsPeopleOzExternalMergedpeopleapiPersonFieldMetadata.t, default:nil) -

• poBox (type:String.t, default:nil) -

• pointSpec (type:GoogleApi.ContentWarehouse.V1.Model.AppsPeopleOzExternalMergedpeopleapiPointSpec.t, default:nil) -

• postalCode (type:String.t, default:nil) -

• region (type:String.t, default:nil) -

• streetAddress (type:String.t, default:nil) -

• type (type:String.t, default:nil) - The type of the address. The type can be free form or one of these predefined values: homework * other

Similar to social.graph.storage.Affinity, but pared down to what the clients of the People API are interested in.

Please read go/people-api-howto:age on how to get age data. Message for the Person.age_range_repeated field. Replaces the existing Person.age_range field.

Store all app unique info that are needed for app action fulfillment.

The best suggested name to use for the Person from the available source fields, which may include FileAs, Name, Org, Email, IM, Phone, ... Rough source container priority order is Contact, then Profile, then Place.

IMPORTANT NOTES: - Requesting person.birthday requires membership in the purpose limited data ACL group sgbe-ac-d-birthday-(read|mutate). Contact people-api-eng@ for assistance with initial setup. - The birthday field should not be used to calculate the requester's age! To determine the requester's age, use person.age_range_repeated. - For more details about age see go/peopleapi-howto/age Birthday value may not be present: - Consumer users generally required to have account birthday set (required at account creation), though some users created via legacy flows may not have birthday present. - Dasher users generally don't require birthday, but could optionally have it set by users. - Any other types of accounts (e.g. robot, service) do not have birthdays. - Account Birthday field may be present but without birthday value set for grace period birthday (provisional new birthday). For users that do have birthday data: - "Profile Birthday" (person.birthday.metadata.container is PROFILE) may not have a year set if user "hides" the year. - "Account Birthday" (see api-specific notes below) will only be returned for the requester's own profile. - People API (go/peopleapi): Account birthday is only supported in GetPeople for PeopleAPI. If account birthday is needed, use a request mask with: include_field { paths: "person.birthday" }include_container: ACCOUNT - People API++ (go/peopleapi++): Account birthday is supported for most apis in PeopleAPI++. If account birthday is needed, use a request mask with: include_field { paths: "person.account_birthday" }include_container: PROFILE (note: it will also need include_container: DOMAIN_PROFILE because they must be requested together: go/people-api-masks#profile-domain_profile) - See go/papi-vs-papi++#birthday for more details.

Whether this field is set or not determines whether an account is in the grace period. While in the grace period, the user is unable to change their birthday on their own, and will be age-disabled if they don't act in a limited amount of time. Applies only to ServiceData Birthday. Users enter the grace period if they choose a birthday below the Age of Consent (go/aoc). After the grace period ends, the account will be age disabled. See go/age-disable-grace-period-dd.

Information provided within MutateDataRequest when setting a user into AgeDisableGracePeriod manually. When the grace period expires, this info will be forwarded to Gaia when disabling the user. cs//symbol:InitiateAgeDisableGracePeriodArguments

Attributes

• metadata (type:GoogleApi.ContentWarehouse.V1.Model.AppsPeopleOzExternalMergedpeopleapiPersonFieldMetadata.t, default:nil) -

• value (type:String.t, default:nil) -

A url to the person's calendar. As of 03/2018 is not supported for user Profile.

Attributes

• callerIdSource (type:GoogleApi.ContentWarehouse.V1.Model.AppsPeopleOzExternalMergedpeopleapiCallerIdExtendedDataCallerIdSource.t, default:nil) - Indicates which data source was used to populate the caller ID result

Attributes

• sourceType (type:String.t, default:nil) -

Information related to domain administrator (or authority) certification of a users age.

Attributes

• channelId (type:String.t, default:nil) - Unique ID that corresponds to a Youtube channel.

• commentCount (type:String.t, default:nil) - Number of comments for a given Youtube channel.

• description (type:String.t, default:nil) - Description of the channel.

• playlistCount (type:String.t, default:nil) -

• profilePictureUrl (type:String.t, default:nil) - A FIFE URL pointing to the channel's profile image (go/avatar-fife-urls) with default fife url options. Also refer to go/people-api-concepts:photos for People API's FIFE best practices. The image could be up to a couple of days stale, though it is much fresher in practice. If a fresh image is required, contact the YouTubeAccountProfileService. The URL itself expires ~30 days after generation.

• profileUrl (type:String.t, default:nil) - URL of user's Youtube channel profile.

• subscriberCount (type:String.t, default:nil) - Number of subscribers for a given Youtube channel.

• title (type:String.t, default:nil) - Title of the YouTube channel

• usesYoutubeNames (type:boolean(), default:nil) - Whether or not the channel's profile has a title/avatar that is canonical in YouTube. Used to determine if the product profile card should be part of the core persona or have their own persona.

• videoCount (type:String.t, default:nil) - Number of videos uploaded in a given Youtube channel.