Recover ssd disk data. Is it possible to recover an SSD? Repair and data recovery SSD OCZ
SSD Recovery | When a good memory gets into trouble
This time we contacted the Flashback Data laboratory, whose employees work on all types of data storage devices, but have special experience in working with flash memory. Representatives from Flashback Data agreed to show us what efforts a top-notch laboratory would take to save our precious flash memory.
SSD Recovery | Reading range
In its early days, Flashback primarily focused on replacing faulty chips, but over time this became increasingly difficult to do as manufacturers began using different components at different stages of production in the same model. Some devices now have encryption, which makes data recovery even more difficult. In this case, Flashback needed to be able to read memory directly, which in turn meant having an incredible number of ways to read chips from such a wide variety of flash memory available.
Note that when Flashback refers to "encryption", this state is typically unknown to the user. For example, around 2006, SanDisk began encrypting data on all of its drives, as Flashback co-founder and vice president Russell Chozick told us. As is the case with automatic encryption hard drives, the controller encrypts all data stored in flash memory. Since there is no password to lock the encryption, the data is decrypted and retrieved from the media. So in case of damage printed circuit board Flashback employees are trying to move the controller and memory chips into the new device. “If the controller burns out, then it is almost impossible to get the data back, since it contains information about how exactly the data needs to be decrypted. If you cannot work with the controller, you are faced with a big problem.”
SSD Recovery | Types of Flash Memory
These dark gray TSOP48 chips have been typical components of USB flash drives and SSD/SD/CF memory cards for many years, but in Lately they paved the way for other chips. The lowest sample in the picture shows back TLGA chip and you may notice that there are no pins on the side and the modules are located on the back side. Such chips are common for all types of flash memory and work in e.g. the latest smartphones iPhone.
During the rebuild process, Flashback employees insert TSOP48 chips into the readers, but the TLGAs must also be soldered. Obviously, the processes of analyzing and restoring information are much more complicated. So, with the introduction of more compact flash memory into smartphones, the old “monolithic” formats seem simpler in comparison.
LaCie SD cards and USB devices also have monolithic chips. While most memory cards have separate controller and memory chips, a monolithic chip combines both components into one tiny module. Obviously, malfunctions of such devices can occur for any of a variety of reasons. If the controller stops working, technicians can still access the data through other means instead of using pins to connect to a card reader, smartphone or camera. In the photo, you can see how the device's case has been partially removed, as technicians need to remove some of the soldered black coating in order to find certain points to connect to logic analyzer. Once all the points have been identified, the card will be connected as shown in the following pictures.
To remove some of the coating, Flashback employees use surprisingly simple tools: sanding paste and a buffing wheel. Chemicals can be used to achieve this goal, but we were told that it is better to use a slow and thorough polishing process. Very thin contacts can easily be damaged during the grinding process. We initially asked to connect a LaCie drive, but then abandoned the idea after learning that such a job could take a technician all day.
SSD Recovery | Common flash drive errors
We've seen photos of damaged hard drives, most of which were damaged due to the head colliding with tracks in the magnetic media. Almost all SSD and flash memory damage that Flashback detects is invisible. In rare cases, you may see a burn mark on the circuit board, but in general, broken controllers and burnt fuses leave no visible marks. As a result, specialists have to work for a long time testing each resistor. In comparison, disconnecting the connector, as shown in the photo, is a piece of cake for repair specialists.
SSD Recovery | What about wear and tear?
We have previously written about the constant race between two processes - improving reading algorithms as capacity increases and reducing lithography, which is reminiscent of a tug of war. In particular, we are concerned that flash and SSD drives that have been in use for several years may show signs of wear and tear.
Fortunately, we are told that most of the SSD drives that arrive at the Flashback laboratory are not even a year old, so the NAND memory does not wear out. In fact, cases of actual wear and tear are extremely rare. Although with USB flash drives (especially older models with less advanced alignment algorithms), wear is a little more common. Reading from the chips works fine, but when checking the information, a lot of ECC errors occur, and no data can be retrieved. The presence of four red dots (further in the pictures) indicates problems with ECC. On the contrary, major wear problems will be marked with four green dots.
There were also cases when specialists carried out an analysis, took out the chip, cleaned the lamella and put everything back in place, exacerbating the problem with reading the data, which now required more time. So wear and tear can indeed be regarded as a real danger, but there is no talk of any crisis here, although many might think about it.
SSD Recovery | Heat it up
Chips must be removed from the circuit board using a special soldering jig, and one of the main tools for this step is hot air. The picture shows how specialists remove the TLGA chip from a USB device. They control the temperature and air pressure, heating the device enough to melt the solder points. Such soldering stations also contain soldering irons, welding flux, ohmmeters and other diagnostic devices. Some of these stations occupy the Flashback main laboratory, which is approximately 465 square meters.
|
|||
|
| |||
Back in the days when mechanical hard drives with spinning platters were the standard, you could simply donate your old one HDD friend, to hear “Thank you”, and that was the end of the matter. With modern solid-state drives, things are not so simple.
In many cases used solid state drives no longer as fast as the new ones, although still faster than the most modern hard drives. The biggest problem when selling SSDs after long period usage comes from an inconvenient characteristic of NAND flash memory: previously written cells must be erased before new data can be written to them. If an SSD is forced to reuse cells to store data instead of using new ones, performance drops sharply.
To avoid this problem with NAND flash memory, modern SSD controllers use a number of techniques, including creating additional volumes that users cannot use - a technique known as over-provisioning. There is also a command called TRIM, which tells the SSD when blocks of memory are no longer needed and can be merged and erased.
Sounds good, doesn't it? But there is one problem.
Not all garbage collection (as erasing used cells and merging data in NAND memory is called) is created equal. The build can be inconsistent, and some older operating systems - notably Windows XP - don't even support TRIM command. Thus, the most frequently used NAND cells may remain on the SSD longer than you suspect.
In Windows 7 and 8, users don't have to worry about all this. The performance of modern SSDs should not noticeably deteriorate for many years, perhaps longer. But there are several scenarios where these idle cells can hit SSD performance, such as long-term use in an environment without TRIM support (for example, in XP), after the disk is almost full and large amounts of data have been deleted, or simply by changing partitions and formatting.
Yes, simply deleting files, changing partitions and formatting the drive does not work the same as on an HDD. These operations occur at a higher level than those where garbage collection occurs. In fact, due to the complete lack of utilities that carry out complete assembly garbage, there is only one way to return an actively used SSD to a pristine state so that it becomes as good as new - the ATA secure erase command.
Secure erase
Feature built into every based ATA interface drive (SSD and HDD) since 2001, erases everything on the drive and marks the cells as empty, restoring any modern SSD to factory performance.
Once upon a time, it was possible to trigger secure erase only through utilities command line, such as HDparam in Linux or HDDerase in DOS, developed at the University of California at San Diego. But now many manufacturers of solid state drives and hard drives provide free utilities, such as OCZ's ToolBox, Samsung's Magician or Seagate SeaTools, providing the ability to securely erase.
Although the command itself is standard, many utilities only work with drives from their own company. If the manufacturer does not provide a secure erase command, you can use the DriveErase utility included with Parted Magic.
Additionally, secure erase is not routine for most users. technical maintenance. If you are using Windows 7 or 8, you do not need to apply it unless you need to clean up the disk. If you're using XP, only perform secure erase when you really notice a drop in performance. Evidence of this is short-term hangs of the interface or freezes when saving files.
Here's how to recover your SSD step by step.
If you have data on your drive that you want to save, back up to another storage device. If we are talking only about files, you can simply drag them onto a flash drive or external hard disk, or use a backup program.
If you have a working operating system that you would like to keep, you will need to use a disk imaging program such as Acronis True Image or R-Drive Image, which copies everything. Don't use the Windows program System Recovery, if you are restoring data on a different disk. It will not recover smaller drives, and sometimes struggles even with similarly sized drives that have plenty of free space.
Before you begin, disable all other drives and boot from your flash drive to perform the erase procedure to avoid accidentally overwriting the wrong drive. Parted Magic is excellent choice, since the program works as a bootable flash drive. If disconnecting your other drives seems challenging task, make sure you choose correct disk, which needs to be erased. Secure erase is irreversible.
Now run the secure erase feature. The exact method depends on the program. A guide to erasing using Parted Magic is easy to find online. Some SSDs use an advanced version of secure erase by default, which even removes service data.
The secure erase process will take only a few minutes on a modern SSD. On hard drives it may take several hours.
Once the process is complete, partition and format the drive if you intend to use it again. Parted Magic provides a convenient full-fledged editor to accomplish this task, but you can use Windows utility Drive Management (Control Panel > System and Security > Administration > Create and format hard sections disk) to solve the same problem. Most often, users create a single partition and format it in NTFS.
You can then return the copied data back to blank disk and enjoy high speed his works.
SSD Recovery | When good memory gets into unpleasant situations
This time we contacted the Flashback Data laboratory, whose employees work on all types of data storage devices, but have special experience in working with flash memory. Representatives from Flashback Data agreed to show us what efforts a top-notch laboratory would take to save our precious flash memory.
SSD Recovery | Reading range
In its early days, Flashback primarily focused on replacing faulty chips, but over time this became increasingly difficult to do as manufacturers began using different components at different stages of production in the same model. Some devices now have encryption, which makes data recovery even more difficult. In this case, Flashback needed to be able to read memory directly, which in turn meant having an incredible number of ways to read chips from such a wide variety of flash memory available.
Note that when Flashback refers to "encryption", this state is typically unknown to the user. For example, around 2006, SanDisk began encrypting data on all of its drives, as Flashback co-founder and vice president Russell Chozick told us. As with automatic hard drive encryption, the controller encrypts all data stored in flash memory. Since there is no password to lock the encryption, the data is decrypted and retrieved from the media. So if the circuit board is damaged, Flashback employees try to move the controller and memory chips to a new device. “If the controller burns out, then it is almost impossible to get the data back, since it contains information about how exactly the data needs to be decrypted. If you cannot work with the controller, you are faced with a big problem.”
SSD Recovery | Types of Flash Memory
These dark gray TSOP48 chips have been typical components of USB flash drives and SSD/SD/CF memory cards for many years, but recently they have opened the way for other chips as well. The bottommost sample in the picture shows the back of the TLGA chip and you can see that there are no pins on the side and the modules are located on the back side. Such chips are common in all types of flash memory and work, for example, in the latest iPhone smartphones.
During the rebuild process, Flashback employees insert TSOP48 chips into the readers, but the TLGAs must also be soldered. Obviously, the processes of analyzing and restoring information are much more complicated. So, with the introduction of more compact flash memory into smartphones, the old “monolithic” formats seem simpler in comparison.
LaCie SD cards and USB devices also have monolithic chips. While most memory cards have separate controller and memory chips, a monolithic chip combines both components into one tiny module. Obviously, malfunctions of such devices can occur for any of a variety of reasons. If the controller stops working, technicians can still access the data through other means instead of using pins to connect to a card reader, smartphone or camera. In the photo, you can see how the device's casing has been partially removed, as technicians need to remove some of the soldered black coating in order to find certain points for connection to the logic analyzer. Once all the points have been identified, the card will be connected as shown in the following pictures.
To remove some of the coating, Flashback employees use surprisingly simple tools: sanding paste and a buffing wheel. Chemicals can be used to achieve this goal, but we were told that it is better to use a slow and thorough polishing process. Very thin contacts can easily be damaged during the grinding process. We initially asked to connect a LaCie drive, but then abandoned the idea after learning that such a job could take a technician all day.
SSD Recovery | Common mistakes flash drives
We've seen photos of damaged hard drives, most of which were damaged due to the head colliding with tracks in the magnetic media. Almost all SSD and flash memory damage that Flashback detects is invisible. In rare cases, you may see a burn mark on the circuit board, but in general, broken controllers and burnt fuses leave no visible marks. As a result, specialists have to work for a long time testing each resistor. In comparison, disconnecting the connector, as shown in the photo, is a piece of cake for repair specialists.
SSD Recovery | What about wear and tear?
We have previously written about the constant race between two processes - improving reading algorithms as capacity increases and reducing lithography, which is reminiscent of a tug of war. In particular, we are concerned that flash and SSD drives that have been in use for several years may show signs of wear and tear.
Fortunately, we are told that most of the SSD drives that arrive at the Flashback laboratory are not even a year old, so the NAND memory does not wear out. In fact, cases of actual wear and tear are extremely rare. Although with USB flash drives (especially older models with less advanced alignment algorithms), wear is a little more common. Reading from the chips works fine, but when checking the information, a lot of ECC errors occur, and no data can be retrieved. The presence of four red dots (further in the pictures) indicates problems with ECC. On the contrary, major wear problems will be marked with four green dots.
There were also cases when specialists carried out an analysis, took out the chip, cleaned the lamella and put everything back in place, exacerbating the problem with reading the data, which now required more time. So wear and tear can indeed be regarded as a real danger, but there is no talk of any crisis here, although many might think about it.
SSD Recovery | Heat it up
Chips must be removed from the circuit board using a special soldering jig, and one of the main tools for this step is hot air. The picture shows how specialists remove the TLGA chip from a USB device. They control the temperature and air pressure, heating the device enough to melt the solder points. Such soldering stations also contain soldering irons, welding flux, ohmmeters and other diagnostic devices. Some of these stations occupy Flashback's main laboratory, which measures approximately 465 square meters.
SSD Recovery | Deleting memory
This SSD's controller is burned out, so Flashback's technicians carefully remove the memory chips, each of which is hand-numbered for tracking and easy data collection.
“Sometimes we never find out which components have failed,” says the company’s vice president. “We just know that this type of drive has a firmware glitch, or this error is most typical for it, so for us to work we need to remove the chips. Our clients are constantly in a hurry, so in many cases it is not possible to determine the exact reason why it burned out, but we know that the reading process will not work through the controller here, but it is not encrypted, so we have to. disconnect the chips, read them, and then restore them.
SSD Recovery | Disconnecting chips
Flash drives and SSDs aren't the only devices that experience heat. There is a constant flow through the Flashback service cell phones, such as this HTC Evo, which was drowned in a swimming pool. Services for recovering information from flash memory cost hundreds and thousands of dollars, so it becomes obvious that this phone was not given away to restore children's cartoons. Some of these phones are said to contain recent photographs of deceased friends or loved ones. Devices related to criminal investigations are regularly received, and if a criminal can destroy evidence, roughly speaking, under his feet, then it is possible to get it from an intact flash memory valuable information to conduct an investigation.
Now HTC smartphone Evo is two years old. New devices, such as the Samsung Galaxy and some others from HTC, often support eMMC technology, which contains a controller built into the memory module, just like an SD memory card. In this case, the recovery process can become even simpler.
SSD Recovery | Hard drive vs flash memory
In the so-called service area hard drive contains information that allows him to “communicate” with himself. To transfer data into read/write processes, it is necessary to provide information about where the bad sectors are located, how many magnetic heads there are, which of them are enabled and which are disabled, and so on. Such information is located on the platters in a special area, which is separated from the disk space reserved for recording user data.
In the case of flash memory, manufacturers also leave space for such a zone, which contains all the information about error correction codes, the presence of errors in sectors, the location of these sectors, and so on.
While a hard drive consists primarily of 512-byte sectors, flash memory typically uses 528-byte sectors, with 512 bytes dedicated to memory and another 16 to the aforementioned service area. In SSD drives, the sector size of 512 bytes is converted to a user-accessible sector size. But when Flashback reads the raw data, experts get information from both areas. The data is mixed, dumped into one pile and at the same time alternated. When specialists need to display available information, all its elements removed from the service area must be deleted.
SSD Recovery | Closer inspection
Sometimes specialists need to carry out a very thorough visual inspection chips and their fragile insides. The best tool Vision Engineering's Mantis microscope is considered for this type of work, and although it costs about $2,000, it helps restorers examine the design in 3D (using two light paths passing through one lens) at twenty-fold magnification. More natural and comfortable work with Mantis helps to detect problems that might not be noticeable using conventional microscopes. It also becomes an assistant during soldering work, during disassembly and repair.
SSD Recovery | Scanning stations
Once the chips are connected in such a way that they can be read external devices, Flashback employees place them in their own assembled configurations to read data. They are quite simple, although they have special systems, which allow you to view different sectors, control operating time, and so on. If reading is slower than usual, it is possible to move to other uncorrupted sectors to get the available information as quickly as possible.
“We can go forward and backward,” says the company's vice president. “We can have the device scan the MFT file table and display only the allocated data instead of getting free space, so the job can be done very quickly. Sometimes you have to fight with device that continues to fail even during the recovery process, sometimes there are clients who need to pull one or two as soon as possible important file in a short time".
SSD Recovery | Mount selection
To connect chips to reading systems, Flashback uses a surprising variety of special mounts. In the picture you can see the type of adapter that was used to work with TSOP48 chips and a TLGA reader. Inside these adapters, each pin of the connector touches a pin on the memory chip. The adapter is screwed into the board for subsequent connection to the TSOP connector. At the bottom there is a USB interface for communication with scanning systems.
SSD Recovery | Data mix
Remember that memory chip that was removed from HTC phone? We may see it again, now with readout wires. The circuit boards were custom made to connect to a USB device. Holes in each corner help secure the chip to the board. Together with the TSOP adapter shown above, each of its pins touches one pin on the memory chip. But in such a mix, all the lamellas of the chips are open, so specialists can do desoldering instead of connecting to the connector. Since there are many monolithic chips and connectors, the Flashback needs to connect to specific points and solder them to the chip.
This is an eight-bit chip, as evidenced by the eight wires that are connected to the circuit board. In a 16-bit chip there would be twice as many of them.
SSD Recovery | Reading process for several hours
When connecting monolithic chips, a similar approach is used. Different devices different wires are needed, but the approach remains the same - each connection performs its own function. For example, in the right top corner 3.3 V power is supplied through the contact. Looking at this process, you begin to realize how time-consuming it takes to simply extract data from the chips.
SSD Recovery | Welcome to the world of chaos
Let's see what data recovery specialists work with. Here you can see the contents of the raw raw data from the SSD's Master Boot Record. Data is mixed using algorithms used by controllers to optimize read and write speeds, level out wear, and so on.
“When we read the chips, we received a whole bunch of raw data,” says the company’s vice president. “For example, here the memory chip has a 528-byte sector, where 512 bytes are used for data, and another 16 are used for storing information about this data and error correction . We call this area the service area. When you first view this data set in hexadecimal system"We have to find the data structures we know in order to figure out their location."
SSD Recovery | FAT under a microscope
Shown here is the FAT16 file system and boot sector
"Home boot record(MBR) is usually marked in sector 0, says Chozik. “Now it’s not there, but we can find it and determine the known data structure.” We know where it is located, how far it is from the boot sector, and so on. This can be seen in the following picture. This process is similar to collecting evidence. We find MBR, boot sector and FAT. Now we see structures that are familiar to us, and we must think about how to move them back together.
Chozik notes that sometimes experts fail to find any of these structures, usually because of the algorithm included with the device. Some algorithms invert all data bits. If such an approach is discovered, then specialists know how to carry out the reverse process. Some algorithms will touch each byte instead of an entire sector, so each byte will be located on a different memory chip. This requires a byte-by-byte rejoin rather than a whole sector rejoin. Some algorithms will use ciphers that further complicate the process. For a process performed by a computer, recovery is quite often done manually.
SSD Recovery | Joint return
Let's take a closer look at the data in the sector where information is scattered across several memory chips. You can see what the first part of each sector looks like.
In the hexadecimal number system, the designations are arranged in the following order: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, A, B, C, D, E, F, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 1A, 1B, 1C and so on. On chip #1 you can see that the order is broken twice - first between the values 09 and 0E, and then between 11 and 16. What happens to the corresponding data? The answer is on chip #2.
SSD Recovery | In order
Specialists need to reunite these separated 2112 bytes (4 sectors of 528 bytes), and when this happens, the result will look the same as in the picture below.
Now imagine that there are 64 memory dumps that need to be merged. Why 64? Because a separate chip can have more than one dump, but, for example, four at once. So take 16 chips (for example, on an SSD drive), multiply their number by four - you will get the total number of dumps (exactly 64).
SSD Recovery | Before and after
It may be hard to imagine what all this byte-level fluctuation actually looks like at the macro level. An empty cell in a table (or a damaged file) cannot fully reflect the entire situation.
This picture from Flashback illustrates this. In some examples, the header and some of the data are intact, so they may appear close together but be jumbled, resulting in image artifacts.
Taking a corrupted JPEG file, technicians use ECC correction and block movement to reorder the data and remove bit errors that were processed by the controller. They are also re-sequenced and clear the service area of collected data to ensure a clean, uninterrupted flow of data.
SSD Recovery | Final result
After several hours of repairs and various manipulations, even using algorithms that help automate data collection, Flashback employees provide the data in the form of files and folders. Everything is in order. The pressing question remains whether the data has been fully recovered and whether it corresponds to its original form.
This can be partially checked using file headers. SD memory cards and similar storage devices typically contain a ton of images that are easy to visually check for errors. ECC errors in separate files It is quite easy to detect - with other file types it can be more difficult. Utilities are able to tell specialists using the header that the file has been disinfected, but they may not note bad sector, which is clearly visible to the observer.
“For most clients, we focus on practicality,” notes the company's vice president. “We ask what they need to get and test the files if they ask for it. If it turns out that we cannot restore the directory structure, we we have to do this using the file header. This is like a “raw” recovery, where we do not get file names. We will pull out the data, and we will get even more than people expect, since we can also restore it. deleted information. Sometimes we see that the FAT table is completely damaged, and then we have to proceed with this type of recovery."
SSD Recovery | What's more important?
In one of the articles about data recovery, one of the readers noted in the comments that essentially anyone could get into this business and that Flashback takes place on a different level compared to more well-known services. Proof of this fact can be found in the results and client list, which includes a wide range of commercial and government organizations.
According to Chozik, Flashback's leading experts have more than 15 years of experience in the data recovery industry. The company has invested hundreds and thousands of dollars in equipment and parts to carry out these processes.
“It’s very difficult to learn this business on your own,” he says. “It took years for the R&D department to reach the heights that we have achieved. Our company is not as small as it seems: we are almost 465 square meters in size, and us installed high level security. There is also four-level biometric control with round-the-clock surveillance. The laboratory uses a grounded floor with copper wires to combat static, so there is no risk of electrical damage. We have a special area protected by bars to store data that is used as evidence in investigations. Also, special clean workstations with laminar air flow (Class 10 and Class 100 levels) are designed for hard drives. The forensic laboratory is the only private ASCLD laboratory with international accreditation (ISO 17025)."
SSD Recovery | Not so small
The Flashback data recovery lab consists of three rooms. The first large space is filled with computers, soldering stations, devices for recovery, visualization and firmware. There are also servers for storing data and similar tasks. There are thousands of hard drives in another room, different versions firmware and a lot of different devices in case you need a printed circuit board, internal read/write heads or anything else. It is worth noting that it is really clean here and there is forced air circulation for working with hard drives.
Another level of security is maintained in the so-called forensic area, which has already been discussed, and the cage in which the relevant drives are stored is fixed to the floor and equipped with motion sensors.
But this is not the most important thing in the article: it introduces you to the processes that occur behind the scenes large companies involved in information recovery. Restoring is not just a plug-and-copy process, the amount of work seems simply prohibitive. Of course, we all hope to never become clients of such services, but if we suddenly have to use the services, then this is the data recovery process that your devices will be forced to go through.
We perform data recovery from SSDs of all brands: Kingston, OCZ, Transcend, Intel, Corsair, Silicon Power, Patriot, A-Data, Crucial, Western Digital, Samsung, Apacer, etc.
SSD (Solid State Drive) – are high-speed NAND-based storage devices Flash memory. They have volumes and speeds similar in value to HDDs, but do not have mechanical parts, which allows them to easily withstand various external physical influences, such as vibrations, shocks, falls, etc.
The structure of an SSD drive is almost identical to conventional flash drives.. It has several NAND Flash chips and a management controller. The differences are that SSDs use more fast type memory and controllers that can work with multiple memory chips in parallel.
Prices for data recovery services from SSD drives
How we recover data from SSD
Data recovery from SSD drives consists of several stages:
The main malfunctions that occur with SSD drives: - physical damage SSD drives. This type includes damage to interface connectors, damage to controller and memory chips, radio elements SSD boards disk and the printed circuit board as a whole due to mechanical or electrical influences.
- logical damage file system SSD drive, erroneous deletion information, formatting. When working with SSD drives, software glitches may occur, resulting in user data being inaccessible or damaged.
- damage in the service information area of the SSD disk, used by the controller in the operation of the translation mechanism. An SSD drive contains areas that are used by the drive for official purposes. They are not involved in storing user data, but damage to the information in them leads to a complete loss of the drive’s functionality.
You can learn more about the equipment we use for data recovery from SSD drives by clicking on
