How to use Google Chrome (Google Chrome)? Everything point by point. How Google Search works

Eric Schmidt, Jonathan Rosenberg, Alan Eagle

How Google works

Eric Schmidt and Jonathan Rosenberg, with Alan Eagle

HOW GOOGLE WORKS

Copyright © 2014 by Google, Inc.

All illustrations with Nishant Choksi 2014

This edition published by arrangement with Grand Central Publishing, New York, New York, USA. All rights reserved

© Translation. Daria Barrett, 2015

© Design. Eksmo Publishing House LLC, 2015

* * *

To our favorite smart creatives - Wendy and Beryl

Preface

When I was younger and first started thinking about my future, I decided to become either a professor or a businessman. I believed that in this way I would in any case be more independent and gain the freedom to think, guided primarily by my principles and laws of physics, and not by the opinion of the majority, which I would have to put up with. We try to apply independent thinking to almost everything we do at Google, as Eric and Jonathan talk about in their book "How Google works". This principle is the driving force behind our greatest successes and some of our greatest failures.

Google truly is a principles-first company. One night I had a dream that was more like a dream, and I woke up thinking: “What if it was possible to download World Wide Web entirely and simply save the links?” I grabbed a pen and quickly wrote down the details to see if this was actually possible. At that moment, my “radar” didn’t even come close to picking up the idea of ​​creating search engine. And only later Sergei and I realized that link ranking web pages could produce much better search results. When we started building Gmail, it also seemed like a pipe dream. And when Andy Rubin created Android ten years ago, most people thought that combining mobile industry with open operating system- this is complete nonsense.

To my surprise, over the years I realized how difficult it is to make employees super-ambitious. It turns out that most people were not taught to think in terms of going to the Moon. They usually think things are impossible instead of using the laws of physics to figure out what is actually possible. That's why we've put so much energy into setting big goals and attracting Google people with independent thinking. Because if you have the right people and big enough dreams, you will usually succeed.

It is also true that many companies are comfortable going about their business as usual, making only a few changes over time. Thanks to this approach, all their gradual changes over time turn out to be useless. This is especially true for technology, because change implies revolution, not evolution. Therefore, you need to force yourself to bet big on the future. For the same reason, we invest in projects that may seem too hypothetical (for example, self-driving cars or Internet access using balloons). It’s hard to believe now, but when we started working on the maps Google Maps, people thought that our goal (to map the entire world with photographs of every street) would be impossible. So if the past is any indicator of our future, then in a few years, today's big bets won't seem so outlandish.

Here are just some of the principles that are important, in my opinion. You will read about the rest in this book. I hope you can use our ideas to create something incredible yourself.

Larry Page co-founder and CEO Google

Introduction: Lessons Learned from the Front Rows

Eric Schmidt was the CEO of the company Google already two years when, in July 2003, he received a letter about e-mail from one of the investors and board members of the company, Mike Moritz, a partner at Sequoia Capital. It contained advice:

I suggest you consider setting aside three hours in your schedule in mid-August when management will present our campaign against Finland to the board of directors. (I don't think we should wait for the September meeting. This is too important a topic and we all know that The best way to understand how short a year can be is to start competing with Finland.)

Uninitiated this letter can be confusing. Why would Google, a five-year-old Internet startup based in Mountain View, California, with just a few hundred employees, want to compete with Finland, a friendly and peace-loving country of five million people located five thousand miles away?

Eric received this “Finnish” message just as he was finally starting to get used to Google. Prior to that, he worked at Novell as CEO, as well as at Sun Microsystems and Bell Labs. He grew up in northern Virginia, graduated from Princeton with a degree in electrical engineering, and received a master's degree and doctorate in computer science from the University of Berkeley (California). And he was no stranger to working with engineers and computer scientists. Moreover, Eric myself was one of them. However, when he arrived at Google, he found himself in a place that was very different from any other company he had ever worked for.

His arrival at Google from the very first days became a revelation for him, which can be characterized by the phrase: “I have a feeling that we are no longer in Kansas.” When Eric entered the office assigned to him, he seemed rather modest by the standards of such an important person as a CEO. In addition, several programmers have already been housed there. Instead of kicking them out, he settled in the next room, which looked more like a closet with a window than a real office.

A few weeks later the situation worsened. One morning, Eric was walking through the lobby toward his office when he noticed that his assistant, Pam Shore, was worried about something. The reason soon became clear: a new neighbor appeared in his office. It turned out to be one of the engineers specializing in search engines, Amit Patel. He explained to Eric that his There are already five employees working in the office and another one should soon join them. Then Amit decided to saw one of the tables in half to create an additional workplace, but nothing came of it. Compared to what he has now, Eric's office seemed quite spacious to this engineer, so he moved. (The team that organized the company's workspace refused to move Amit's things into Eric's room, so he did everything himself.) As a result, Amit and Eric worked in the same office side by side for several months. It was clear that in this company the importance of employees was not measured in square footage.

We released new book"Content marketing in in social networks: How to get into your subscribers’ heads and make them fall in love with your brand.”

Subscribe

Google is a search engine with additional tools and services.

We can say that Google.com is Sherlock Holmes with his card index, in which data on all the figures of the criminal world is laid out by first and last name, and he easily knows where and how to find any information. In addition, the detective will play the violin for you or entertain you with an interesting conversation. Naturally, the search engine finds not only information about criminals. Everything and about everything is available to him exclusively.

When did Google appear and who founded it?

The history of Google begins in 1998, when the search engine began to be used at Stanford University, where its founders, Larry Page (USA) and Sergey Brin (emigrant, born in the USSR), studied.

Both students were working on solving a search problem in large storage facilities data. At that time, search engines were already working, but the results of their work were unsatisfactory. The search was carried out using keywords, and spam was included in the results. New system took into account backlinks. If there were a lot of them on the resource, this meant that the portal was relevant to the request and authoritative.

As an example, the developers took references in scientific circles. The more scientists refer to the person in question, the higher their status, the more authoritative the person himself becomes. This is how PR (PageRank) appeared - one of the indicators of ranking and weight of the page and the site as a whole, which raised the quality of search and generally made a fundamental turn in its algorithm.

Mathematicians asked the first users of Stanford to express their impressions and comments, according to which they modified the search engine.

What does the name mean

The initial word was the concept of Googol - 1 and 100 zeros after it. Initially new search engine it was supposed to be called GooglePlex (10 to the power of googol), but the creators found it unmemorable and awkward to write. Therefore, we settled on the shortened version.

In 1998, the developers registered the company Google-Inc., which received a significant amount for development from one sponsor. With this money, they purchased servers that began to process the growing number of requests to Google.com.

How Google works and how it works

Google uses two important principles: analyze document text and count incoming links.

Based on the text, link weight and all keys, the search engine determines the position of the resource in the search results. The search is carried out using a previously indexed database of reverse indexes. It also contains saved copies of pages, on the basis of which snippets are generated.

The PS will add the site to its index if the webmaster sends a link to it to the addurilka, or finds your web project via an incoming link from another resource. Backlinks collected when each page is indexed.

Related Google services

• AdSense, AdWords – contextual advertising systems.
• YouTube is the most popular video hosting site.
• Chrome is a popular web browser.
• Analytics – a counter for analyzing web resource traffic.
• Google+ is a social network.
• Play – applications for mobile gadgets.
• Disk – data storage in the cloud.
• Mail – exchange of electronic letters.
• Photo – storage of photo albums, exchange of photos.
• Docs – working with documents, text editors, viewing and editing documents from anywhere in the world.
• Maps is a cartography system around the world with point objects.
• Calendar – event planner.
• Hangouts – online chat.
• Talk – messenger, messaging.

This is not a complete list. There is also a Translator, News, Notes, Website Hosting, Virtual printer, Questions and Answers and much more.

Features of promotion on Google

Promotion in this search engine is different from Yandex. In general, both PSs have their own characteristics and their sites are ranked differently.

• Google works a little faster (indexing, issuing, robot crawling).
• Google takes into account the anchors of all links from the same text leading to the receiving page.
• Structured unique texts necessary for any search engine.
• IN Google regions are countries, and in Yandex - cities and regions.
• Google highlights the weight of each page, while the Russian PS gives importance to the weight of the site as a whole.
• Google prefers exact match key query in the incoming link.
• Google stores all pages in its database. And Yandex filters out duplicate content and other low-quality documents.
• The Google database consists of a main and additional index. Documents included in supplemental are almost not included in the search.

Reasons for getting into supplemental

• Non-unique content.
• A small amount of text on the page.
• Meta tags are not specified, or they are not unique, or they consist of only one word.

Google's share in Russia is constantly growing. IN last years an upward trend has emerged due to the release of mobile gadgets with a built-in OS, which by default links the user’s Google account for correct functioning mobile device. Therefore, every optimizer should know about this system and the features of promotion in it.

Have you ever wondered how it works Google technology? Of course, the SERP process involves a complex algorithm based on many variables. But still, you can in simple words explain the principle of operation of the world's most popular search engine?

To understand the jungle of the most complex algorithm search engine, take a look at this extremely useful infographic from quicksprout.

Google's ubiquitous search spiders crawl onto certain web pages and then follow links from those pages. This network crawling approach allows Google to index more than 100 million gigabytes of information.

In order for users to receive top scores search results, Google is constantly creating and improving programs. Here short list main areas of ongoing work:

• spellchecking;
• autocomplete;
• search by synonyms;
• general understanding of queries;
• live Google search;
• search patterns.

• How many times does a key expression appear on a page?
• entry keyword in Title or URL?
• does the page contain synonyms for the keyword expression?
• what Google PageRank pages?

All this happens in ⅛ seconds.

So-called Knowledge Network(knowledge graph) - a technology that produces results based on a global database of real people, places and connections between them. For example: in addition to dry facts about the biography of Leo Tolstoy, you will get the maximum interesting content(text/photo/video) associated with this figure.

Snippets also add convenience to search results - small pieces of information that allow you to quickly and without having to follow a link to understand whether the page matches your request.

Others Google tools, making the search easier:

No comments here. Just click on the microphone icon and tell the search engine what you want to find. But be careful - she may answer. :)

2. Images

Shows thumbnail images based on search results.

Google search allows you to ask specific questions and get quick answers.

Google also owns the second most popular search engine in the world, which you all know very well:

Conclusion

What made Google such a successful search engine? Despite the many the most complex processes, occurring unnoticed by the user, Google is a simple and convenient search engine from a usability point of view. Whatever question you ask, it will provide relevant search results in 1/8 of a second.

In an era when everything changes faster than you can notice it, the best way out– attract smart people, creative people and create an environment for them to come up with new ideas and develop. How Google Works will show you how to achieve this. Page by page, Chairman Eric Schmidt and Vice President Jonathan Rosenberg reveal how they built a great company. You'll learn how Google develops corporate culture, attracts top talent, innovates, solves impossible problems, and all with rich stories from Google life, which are published for the first time.

When I was younger and first started thinking about my future, I decided to become either a professor or a businessman. I believed that in this way I would in any case be more independent and gain the freedom to think, guided primarily by my principles and laws of physics, and not by the opinion of the majority, which I would have to put up with. We try to apply independent thinking to almost everything we do at Google, as Eric and Jonathan talk about in their book How Google Works. This principle is the driving force behind our greatest successes and some of our greatest failures.

Google truly is a principles-first company. One night I had a dream that was more like a dream, and I woke up thinking, “What if you could download the entire World Wide Web and just save the links?” I grabbed a pen and quickly wrote down the details to see if this was actually possible. At that moment, my “radar” was not even close to picking up the idea of ​​​​creating a search engine. It was only later that Sergey and I realized that link ranking of web pages could give much better search results. When we started building Gmail, it also seemed like a pipe dream. And when Andy Rubin created Android ten years ago, most people thought that combining the mobile industry with an open operating system was complete nonsense.

To my surprise, over the years I realized how difficult it is to make employees super-ambitious. It turns out that most people were not taught to think in terms of going to the Moon. They usually think things are impossible instead of using the laws of physics to figure out what is actually possible. That's why we've invested so much energy into setting big goals and bringing independent thinkers to Google. Because if you have the right people and big enough dreams, you will usually succeed.

It is also true that many companies are comfortable going about their business as usual, making only a few changes over time. Thanks to this approach, all their gradual changes over time turn out to be useless. This is especially true for technology, because change implies revolution, not evolution. Therefore, you need to force yourself to bet big on the future. For the same reason, we invest in projects that may seem too hypothetical (for example, self-driving cars or Internet access using balloons). It's hard to believe now, but when we started working on Google Maps, people thought that our goal (to map the entire world with photos of every street) would be impossible. So if the past is any indicator of our future, then in a few years, today's big bets won't seem so outlandish.

How Google discovers web pages, crawls them, and returns results.

This article provides two explanations of how it works Google Search a: short and detailed.

Google gets information from different sources. Here are examples of some of them:

• web pages;
• content added by users, such as what they post to Google My Business and Google Google Maps";
• scanned books;
• open databases on the Internet;
• many other sources.

This article will only focus on content posted on web pages.

Brief explanation

Generating search results for web pages takes place in three stages, which are described below.

Scanning

First you need to determine what pages are on the Internet. Since there is no official registry of them, Google robot has to constantly search for new pages and add them to the list of already known ones. This process is called scanning.

Information about existing pages comes to us in several ways. In some cases Google robot Automatically detects pages during the scanning process. He can also go to them using links posted on other pages. In addition, the site owner can himself send Google file Sitemap with a list of pages to scan. Finally, if you created your site using third party service, such as Wix or Blogger, the hosting provider can tell Google to crawl pages you've added or edited.

How to improve scanning efficiency

• You can request crawling of individual URLs if changes were made only to the relevant pages.
• On pages that are already known to Google, link to your new pages when you publish them. note that our robot will not click on links that do not comply with the Google Webmaster Guidelines, such as those included in ads and comments, or posted for a fee.
• If you only need to scan one page, select Home for this. This is considered the most important page on your site. If you need full scan site, make sure that it implements convenient navigation with links to all key sections and pages of the resource. This will make it easier for users and Google robots to navigate your site.

We do not provide more frequent crawling or higher site rankings for a fee. Those who say otherwise are misleading you.

Indexing

After finding a page, you need to determine what topic its content is dedicated to. This process is called indexing. It lies in the fact that Google analysis Organizes the page content and organizes the images and embedded videos found on it. The received information is stored in Google index – huge database data located on many computers.

How to Improve Indexing Efficiency

• Create short and informative page titles.
• Use appropriate topic headings on your pages.
• There should be a sufficient amount of text on your pages. Google can recognize the content of some pictures and videos, but not as effectively as in the case of text. Whenever possible, annotate your videos and images using various attributes such as alt.

Delivery of results and ranking

When a user enters a query, Google searches its index for the most relevant results based on numerous factors. Such factors include location, language, user device type ( regular computer or telephone), etc. For example, results for the query "bicycle repair" will differ depending on whether you are in Paris or Hong Kong. Ranking is carried out according to specified algorithms, and Google does not increase the ranking of pages for a fee.

How to Improve Your Ranking Effectiveness

• Provide fast loading your page and optimize it for mobile devices.
• Post on the page useful content and update it promptly.
• Follow the guidelines provided in the Google Webmaster Guidelines to ensure a good browsing experience on your site.
• Study Introduction to Search Engine Optimization.
• Please review our guidelines for assessing the quality of search results.

Detailed explanation

Want to know more? We have provided for this.

Version for the curious

Scanning

Crawl is the process by which Googlebot discovers new and updated pages to add to Google index.

We use huge network computers to crawl the content of billions of web pages. The program that does the crawling is called Googlebot (or spider). This robot operates completely automatically: it independently determines which sites to crawl, how often it needs to be done, and also how many pages to select from each of them.

Google's crawling process starts with a list of web page URLs generated from previous crawling sessions. It is supplemented by data from Sitemap files provided by webmasters. By crawling each of these sites, Googlebot finds links on each page and adds them to the list of pages to crawl. All new and changed sites, as well as broken links, are flagged, and subsequently the corresponding data appears in the Google index.

How does Google find pages?

Googlebot finds pages in a variety of ways. Among other things, these include the following:

• following links from other sites;
• processing data in Sitemap files.

How does Google determine which pages not to crawl?

• If access to a page is blocked in the robots.txt file, it will not be crawled, but may still be indexed if another site has a link to it. Please note that Google can determine the topic of the page based on the content of the link and index it without analyzing the materials published on it.
• Googlebot can't crawl pages that are not accessible to anonymous users, that is, pages that require you to log in or sign in to view.
• Less frequently scanned are pages that are considered to be exact copies of pages that have already been scanned.

How to improve scanning efficiency

Follow the steps below to make it easier for Google to find you. required pages on your website.

• Use simple, readable and structured URL paths, as well as thoughtful direct internal links.
• If your site uses URL parameters, such as to indicate the user's country in an international online store, tell Google important details about them by using the URL Parameters tool.
• Use the instructions in your robots.txt file to reduce server load by specifying which pages can be added to Google's index and which ones should be crawled first. This file should not be viewed solely as a way to block access to content and prevent it from being indexed.
• Use the hreflang attribute to indicate page versions in different languages.
• Specify canonical and alternate pages.
• Use the indexing report.

Indexing

Googlebot analyzes each page it crawls to create a comprehensive index of all the words it finds, as well as where on the page they are found. Additionally, we take into account data from core tags and attributes, such as tags