Here are some web trends for 2020:
Responsive web design in 2020 should be a given because every serious project that you create should look good and be completely usable on all devices. But there’s no need to over-complicate things.
Web Development in 2020: What Coding Tools You Should Learn article gives an overview of recommendations what you learn to become a web developer in 2020.
You might have seen Web 3.0 on some slides. What is the definition of web 3 we are talking about here?
There seems to be many different to choose from… Some claim that you need to blockchain the cloud IOT otherwise you’ll just get a stack overflow in the mainframe but I don’t agree on that.
Information on the web address bar will be reduced on some web browsers. With the release of Chrome 79, Google completes its goal of erasing www from the browser by no longer allowing Chrome users to automatically show the www trivial subdomain in the address bar.
You still should target to build quality web site and avoid the signs of a low-quality web site. Get good inspiration for your web site design.
Still a clear and logical structure is the first thing that needs to be turned over in mind before the work on the website gears up. The website structure for search robots is its internal links. The more links go to a page, the higher its priority within the website, and the more times the search engine crawls it.
You should upgrade your web site, but you need to do it sensibly and well. Remember that a site upgrade can ruin your search engine visibility if you do it badly. The biggest risk to your site getting free search engine visibility is site redesign. Bad technology selection can ruin the visibility of a new site months before launch. Many new sites built on JavaScript application frameworks do not benefit in any way from the new technologies. Before you go into this bandwagon, you should think critically about whether your site will benefit from the dynamic capabilities of these technologies more than they can damage your search engine visibility. Well built redirects can help you keep the most outbound links after site changes.
If you go to the JavaScript framework route on your web site, keep in mind that there are many to choose, and you need to choose carefully to find one that fits for your needs and is actively developed also in the future.
JavaScript survey: Devs love a bit of React, but Angular and Cordova declining. And you’re not alone… a chunk of pros also feel JS is ‘overly complex’
Keep in mind the recent changes on the video players and Google analytics. And for animated content keep in mind that GIF animations exists still as a potential tool to use.
Keep in mind the the security. There is a skill gap in security for many. I’m not going to say anything that anyone who runs a public-facing web server doesn’t already know: the majority of these automated blind requests are for WordPress directories and files. PHP exploits are a distant second. And there are many other things that are automatically attacked. Test your site with security scanners.
APIs now account for 40% of the attack surface for all web-enabled apps. OWASP has identified 10 areas where enterprises can lower that risk. There are many vulnerability scanning tools available. Check also How to prepare and use Docker for web pentest . Mozilla has a nice on-line tool for web site security scanning.
The slow death of Flash continues. If you still use Flash, say goodbye to it. Google says goodbye to Flash, will stop indexing Flash content in search.
Use HTTPS on your site because without it your site rating will drop on search engines visibility. It is nowadays easy to get HTTPS certificates.
Write good content and avoid publishing fake news on your site. Finland is winning the war on fake news. What it’s learned may be crucial to Western democracy,
Think to who you are aiming to your business web site to. Analyze who is your “true visitor” or “power user”. A true visitor is a visitor to a website who shows a genuine interest in the content of the site. True visitors are the people who should get more of your site and have the potential to increase the sales and impact of your business. The content that your business offers is intended to attract visitors who are interested in it. When they show their interest, they are also very likely to be the target group of the company.
Should you think of your content management system (CMS) choice? Flexibility, efficiency, better content creation: these are just some of the promised benefits of a new CMS. Here is How to convince your developers to change CMS.
Here are some fun for the end:
Did you know that if a spider creates a web at a place?
The place is called a website
Confession: How JavaScript was made.
2,321 Comments
Tomi Engdahl says:
Joshua Benton / Nieman Lab:
A historical look at Pulitzer winners shows the decline of local and regional newspapers and the growth in online news outlets, especially at the local level
This year’s Pulitzer Prizes were a coming-out party for online media — and a marker of local newspapers’ decline
For the first time ever, more online news sites produced Pulitzer finalists than newspapers did.
https://www.niemanlab.org/2024/05/this-years-pulitzer-prizes-were-a-coming-out-party-for-online-media-and-a-marker-of-local-newspapers-decline/
Tomi Engdahl says:
https://hackaday.com/2024/05/07/imperva-report-claims-that-50-of-the-world-wide-web-is-now-bots/
Tomi Engdahl says:
Your Open-Source Client Options In The Non-Mastodon Fediverse
https://hackaday.com/2024/05/08/your-open-source-client-options-in-the-non-mastodon-fediverse/
Tomi Engdahl says:
Free wine hidden in small print claimed after three months
https://www.bbc.com/news/articles/c84z2jqpvpko
Tomi Engdahl says:
https://www.w3.org/International/questions/qa-headers-charset.en
Tomi Engdahl says:
https://hackertarget.com/http-header-check/
https://dnschecker.org/server-headers-check.php
Tomi Engdahl says:
https://securityheaders.com/
https://tools.keycdn.com/curl
Tomi Engdahl says:
https://apidog.com/blog/http-header-format/
https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers
Tomi Engdahl says:
https://hackaday.com/2024/05/11/the-minimalistic-dillo-web-browser-is-back/
Tomi Engdahl says:
Exclusive: TechCrunch has learned that Meta is shuttering Workplace, a version of Facebook that had been built to enable communication among business teams and wider organizations.
Read more: https://tcrn.ch/44IFc6b
Tomi Engdahl says:
https://www.facebook.com/share/hgGQ83q3J76ddwbo/
Tomi Engdahl says:
Javier Espinoza / Financial Times:
The EU opens a formal DSA investigation into Meta, to assess if Facebook, Instagram, and its other apps were reinforcing “rabbit hole” effects and other issues
EU launches probe into Meta over social media addiction in children
https://www.ft.com/content/3978c96a-21b4-469f-bca9-1b1055bb3a6f
Tomi Engdahl says:
Mia Sato / The Verge:
Memo: Gannett is adding AI-generated summaries to the top of some stories, with a disclaimer at the bottom; some USA Today stories already show the summaries
Mia Sato / The Verge:
Memo: Gannett is adding AI-generated summaries to the top of some stories, with a disclaimer at the bottom; some USA Today stories already show the summaries — Gannett, the media company that owns hundreds of newspapers in the US, is launching a new program that adds AI-generated bullet points …
Newspaper conglomerate Gannett is adding AI-generated summaries to the top of its articles
https://www.theverge.com/2024/5/16/24158531/gannett-ai-generated-overviews-usa-today-memo
Journalists participating in the pilot program will use AI to produce bulleted ‘key points’ of their story.
Tomi Engdahl says:
https://www.creativebloq.com/features/lottie-animation-tools
Tomi Engdahl says:
https://www.hopkins.fi/kokemuksia/viherpeukalot/
Tomi Engdahl says:
https://www.hopkins.fi/kokemuksia/kotipizza-markkinoinnin-automaatio/
Tomi Engdahl says:
Pew Research Center:
About 38% of webpages that existed in 2013 are unavailable now and 8% of pages from 2023 are unavailable; 23% of news pages have at least one broken link — 38% of webpages that existed in 2013 are no longer accessible a decade later — Table of Contents Table of Contents
When Online Content Disappears
38% of webpages that existed in 2013 are no longer accessible a decade later
https://www.pewresearch.org/data-labs/2024/05/17/when-online-content-disappears/
Tomi Engdahl says:
https://www.fraktio.fi/blogi/n%C3%A4in-luot-strategian-verkkopalvelun-modernisointiin
Tomi Engdahl says:
https://www.karhuhelsinki.fi/blogi/google-ai-overview-tekoaly-tuottaa-hakutuloksia/
Tomi Engdahl says:
https://thefcompany.com/fi/blog/ajatusjohtajuus-b2b-markkinoinnissa-mita-miten-ja-miksi
Tomi Engdahl says:
https://swankyagency.com/shopify-markets-vs-expansion-stores/
Tomi Engdahl says:
https://www.artio.fi/materiaalipankki/#seo
Tomi Engdahl says:
The internet is disappearing, a new study has suggested, as nearly 40% of web pages and online content has been lost over the past decade…
https://www.independent.co.uk/tech/internet-disappearing-dead-links-online-content-b2548202.html
Telkom University says:
hello
Tomi Engdahl says:
Lakiuudistuksen laiminlyönti hintojen ilmoittamisesta verkkokaupoissa voi tuoda sakkoja – entä ne mahdollisuudet?
Vältä sakot ja hinnoittele aletuotteesi selkeästi – lue blogista, miten martech-kumppani voi tukea tässä!
https://www.kuuki.fi/blogi/lakiuudistuksen-laiminlyonti-hintojen-ilmoittamisesta-verkkokaupoissa-voi-tuoda-sakkoja-enta-ne-mahdollisuudet/
Tomi Engdahl says:
Leaked Documents Reveal How Google Search Gatekeeps the Internet
SEO experts say a massive leak of 14,000 ranking features exposes the blueprint for how Google secretly curates the Internet.
https://gizmodo.com/google-search-seo-leak-reveal-gatekeeps-internet-1851508410
Tomi Engdahl says:
The internet is disappearing, with a quarter of all webpages from 2013 to 2023 going the way of the dodo
News
By Andy Edser published 23 May 2024
The internet never forgets. Except, y’know, when it does.
https://www.pcgamer.com/hardware/the-internet-is-disappearing-with-a-quarter-of-all-webpages-from-2013-to-2023-going-the-way-of-the-dodo/
Tomi Engdahl says:
https://www.bbc.com/future/article/20240524-how-googles-new-algorithm-will-shape-your-internet
Tomi Engdahl says:
https://tinypng.com/?fbclid=IwZXh0bgNhZW0CMTEAAR2pfhQ85U20KAfj8KKIavT5Sj1_-UxDvOCh0SLCEuO4HNRESIg7z0aDNmI_aem_ZmFrZWR1bW15MTZieXRlcw
Tomi Engdahl says:
https://www.fraktio.fi/blogi/php-palvelun-modernisointi-monoliitista-mikropalveluihin
Tomi Engdahl says:
Rob Schneider Says Cancel Culture Is ‘Over,’ But the ‘Grown Ups’ Franchise Isn’t
–> https://bit.ly/3Xq5eJA
Tomi Engdahl says:
Halpajätit Temu ja Shein murskaavat hinnoillaan – Suomalaisilla verkkokaupoilla on kuitenkin valtteja
https://www.kauppalehti.fi/uutiset/halpajatit-temu-ja-shein-murskaavat-hinnoillaan-suomalaisilla-verkkokaupoilla-on-kuitenkin-valtteja/94b327fa-4236-4ef4-9070-7a269bdffc2d
Temun ja Sheinin hinnat maistuvat sekä kuluttajille ja sijoittajille. Suomalaisen verkkokaupan pitäisi keksiä jostain uusi kilpailuetu.
Tomi Engdahl says:
https://www.hurja.fi/blogi/digipalvelulaki-tuo-verkkokaupat-saavuttavuusvaatimusten-piiriin/
Tomi Engdahl says:
https://www.kuuki.fi/blogi/nelja-syyta-miksi-suosia-headless-verkkosivustoja-kaikille-paattomyys-ei-kuitenkaan-sovi/?utm_source=facebook&utm_medium=paid&utm_campaign=Kuuki%20-%20Br%C3%A4ndi%20-%20Liikenne%20-%202024&hsa_acc=50278753&hsa_cam=6547863752176&hsa_grp=6547863757976&hsa_ad=6550841998376&hsa_src=fb&hsa_net=facebook&hsa_ver=3&fbclid=IwAR20WUwGgb112zB-ClGarnd_DpZMbfntTVGzCtlENk99qGFvjDbjjJ0FHac_aem_AZEW1FJhoadvv1qgISVH8UjdjuE0zkiTDseseLcNgqDuKqPeGxKCQVKniz9A5aX72-pvUWS-5hXbzH7YfhiP0RIx
Tomi Engdahl says:
https://www.madeofsundays.com/fi/pages/meista
Tomi Engdahl says:
Is Google Consent Mode active on your site? Check now
https://cookieinformation.com/cmv2-scan/?utm_medium=paid+social&utm_source=facebook&utm_campaign=GRP_01_EN+-+Social+-+Funnel+-+CMv2+Check+Tool+-+All+Markets&hsa_acc=5198699070178710&hsa_cam=120212286128160242&hsa_grp=120212286128180242&hsa_ad=120212286304780242&hsa_src=fb&hsa_net=facebook&hsa_ver=3&fbclid=IwAR0k6FwtaWzRk7_AcYrQquZjAjPF6b6ZYpTmIaKAENqdm_UgLC9DQTh4QWo_aem_RPJKB-84i_okL2O3eSzUiQ&utm_id=120212286128160242&utm_content=120212286304780242&utm_term=120212286128180242
Tomi Engdahl says:
No more cookies? Google ending third-party cookies in Chrome
Google started to phase out third-party cookies for all Chrome users in 2024, but advertisers and publishers will still need to obtain consent to process user data. Learn how to prepare for the end of third-party cookies in Chrome, what technologies will replace them, and why consent remains pivotal.
https://www.cookiebot.com/en/google-third-party-cookies/
Tomi Engdahl says:
Kevin Nguyen / The Verge:
Interviews with several journalists who helped saturate the web with Game of Thrones coverage, leveraging fans’ obsessions for traffic via SEO and social media
Winter of Content
For a crucial decade in print media’s transition to the internet, HBO’s fantasy series Game of Thrones was a boon in traffic… for everyone. But what happened when every publication started chasing the same thing?
https://www.theverge.com/24181763/game-of-thrones-journalism-media-recaps
telkom university says:
thank for information
URL
URL
URL
Tomi Engdahl says:
https://www.xetnet.fi/webhotelli/
Tomi Engdahl says:
https://cookieinformation.com/cmv2-scan/?utm_medium=paid+social&utm_source=facebook&utm_campaign=GRP_01_EN+-+Social+-+Funnel+-+CMv2+Check+Tool+-+All+Markets&hsa_acc=5198699070178710&hsa_cam=120212286128160242&hsa_grp=120212286128180242&hsa_ad=120212286304780242&hsa_src=fb&hsa_net=facebook&hsa_ver=3&fbclid=IwZXh0bgNhZW0BMAABHcAw7Zta7xHbSPENzFBuqJ2ZrhtII1D5sa80X-Qh7QsJt2nSV_WmkKNI0w_aem_RiBSoWbQ8BNGl8oEko-ZmQ&utm_id=120212286128160242&utm_content=120212286304780242&utm_term=120212286128180242
Tomi Engdahl says:
https://www.karhuhelsinki.fi/blogi/karhu-helsinki-esittaytyi-huomenta-suomessa-koiraystavallisena-tyopaikkana-blogin-hakukoneoptimointi-tuotti-mittavan-medianakyvyyden/
Tomi Engdahl says:
https://www.hopkins.fi/analytiikka/seurantastrategia/
Tomi Engdahl says:
Digipalvelulaki tuo verkkokaupat saavuttavuusvaatimusten piiriin
https://www.hurja.fi/blogi/digipalvelulaki-tuo-verkkokaupat-saavuttavuusvaatimusten-piiriin/
Digipalvelulaki päivittyy ja uudet muutokset tuovat saavutettavuusvaatimusten piiriin kuluttajille tarjotut verkkokaupat, sähkökirjat, osan henkilöliikenteen ja pankkien palveluista sekä audiovisuaaliseen sisältöön pääsyn tarjoavat palvelut ja viestintäpalvelut. Digipalvelulain muutokset tulevat EU:n esteettömyysdirektiivistä. Palveluiden on täytettävä saavutettavuusvaatimukset 28.6.2025 mennessä, jolloin siirtymäaika päättyy.
Tomi Engdahl says:
Saavutettava verkkosivusto ei käännytä asiakkaita ovelta
28.1.2022
Blogi
Vaikka laki ei vielä vaadi yritysten verkkosivuilta saavutettavuutta, harvalla on varaa olla ilmankaan: huono saavutettavuus syrjii osaa asiakkaista ja johtaa jopa menetettyihin kauppoihin. Saavutettavuus on tasa-arvoa, hyvää asiakaspalvelua ja parempaa liiketoimintaa. Lisäksi se tuo vanavedessään muita
https://www.morgan.fi/blogi/saavutettava-verkkosivusto-ei-kaannyta-asiakkaita-ovelta/
Tomi Engdahl says:
New Chrome Security Rules—Google Gives Websites Until 11/1 To Comply
https://www.forbes.com/sites/daveywinder/2024/06/30/new-chrome-security-rules-google-gives-web-users-until-111-to-comply/
An announcement from the Google Chrome Security Team has dropped what can only be described as a security and privacy bombshell for the 3.45 billion users of the Chrome browser. From November 1, the world’s most-used web browser will no longer trust digital certificates issued by Entrust, one of the world’s most-used certificate authorities. How widespread are Entrust digital security certificates? Customers include Chase Bank, Dell, Ernst & Young, Mastercard, and Merrill Lynch, not to mention governments worldwide.
Tomi Engdahl says:
Rand Fishkin / SparkToro:
Datos: 58.5% of Google searches in the US and 59.7% in the EU result in no clicks; for 1,000 searches, 360 clicks go to the open web in the US and 374 in the EU
2024 Zero-Click Search Study: For every 1,000 EU Google Searches, only 374 clicks go to the Open Web. In the US, it’s 360.
https://sparktoro.com/blog/2024-zero-click-search-study-for-every-1000-us-google-searches-only-374-clicks-go-to-the-open-web-in-the-eu-its-360/
What happens after Americans and Europeans search Google?
The power of an active, multi-million user clickstream panel is its ability to comprehensively see all behavior, rather than just selected subsets. In the case of Google searches, for example, other studies have purported to analyze zero-click searches or the results of self-preferencing by looking at the click-through-rates of millions of keywords. That doesn’t work.
Any study that selects and analyzes keywords fails to account for real searcher behavior. Real searchers query the same keyword multiple times. Sometimes they click, sometimes not. Real searchers query keywords that will never show up in SEO tool datasets, ad impression data, or Google Search Console. Their search behavior is diverse, unexpected, and messy… i.e. they’re human.
Zero-click searches are defined as those that end without clicking on any of the results presented. It includes searches that end with the searcher satisfied, frustrated, or changing their search to perform a new one. In the United States, just under 60% of mobile web and desktop searches in Datos’ panel ended this way.
We’re almost certainly under-counting the “zero-click search” problem because this data does not account for use of voice-answered searches through Google Assistant, or searches done in the Google mobile search app (which, while similar to in-browser results, features even more rich answer results).
Equally concerning, especially for those worried about Google’s monopoly power to self-preference their own properties in the results, is that almost 30% of all clicks go to platforms Google owns. YouTube, Google Images, Google Maps, Google Flights, Google Hotels, the Google App Store, and dozens more means that Google gets even more monetization and sector-dominating power from their search engine.
Most interesting to web publishers, entrepreneurs, creators, and (hopefully) regulators is the final number: for every 1,000 searches on Google in the United States, 360 clicks make it to a non-Google-owned, non-Google-ad-paying property. Nearly 2/3rds of all searches stay inside the Google ecosystem after making a query.
For marketers, this underscores the importance of zero-click content: getting value from searches that don’t result in a click. For those concerned about Google’s monopoly power, it suggests that efforts thus far haven’t done much to curb the search giant’s power.
Tomi Engdahl says:
Zero-Click Content: The Counterintuitive Way to Succeed in a Platform-Native World
https://sparktoro.com/blog/zero-click-content-the-counterintuitive-way-to-succeed-in-a-platform-native-world/
It could be a chicken or egg situation: Maybe the platforms have made us lazy, or we’ve trained their algorithms to reward platform-native content — as in, content that keeps people on the platforms’ sites instead of sending them to yours. Zero-Click Content.
No matter what you call it, one thing is certain: it’s harder than ever to get audiences to click that call-to-action.
In 2020, more than two-thirds of Google searches ended without a click. Why? Google is continually updating the Search Engine Results Page (SERP) so that users don’t even need to click on a result in order to satisfy their query. Converting ounces to cups? There’s a calculator directly on the SERP. Curious about Paul Rudd’s height? The snippet says he’s 5’10”. Want an overview of market research? Googling “what is market research” yields a knowledge graph with a definition, suggested market research firms, and relevant books — all without having to click through to a website.
It’s not just Google. It’s social media channels, too. Instagram still doesn’t allow you to place links in posts’ captions. Facebook, Twitter, Reddit, Pinterest, and Quora favor in-platform content like linkless posts, threads, images, and videos. TikTok and Snapchat are linkless. YouTube cuts off video descriptions that include links. And any LinkedIn creator can tell you Zero-Click content always performs better, and that links belong in the comments instead of the posts.
So… what are we supposed to do when the platforms reward Zero-Click behavior?
Make Zero-Click content.
Zero-Click content is content that offers valuable, standalone insights (or simply engaging material), with no need to click. Clicking might be additive, but it’s not required.
This is content that’s native to any platform — a Twitter thread, a LinkedIn post, a 60-second TikTok that immediately jumps into the “how to” demonstration. It’s easily consumed by anyone scrolling their feed, yet still provides value to the creator.
But how can we get value if we can’t get trackable visits? Just like our marketing forebears did: through hard-to-measure brand lift.
For marketers, writers or creators, it means optimizing impressions without the goal of earning that click. It’s taking a leap of faith. Giving the juiciest information upfront, earning engagement so the algorithm rewards your post, and building enough goodwill that your audience remembers you next time, seeks you out later, follows you on the platform, or even clicks on your profile to go find your call-to-action.
For the audience, Zero-Click content means less time wasted. You’re busy. You want the dopamine hit now, and then you’ll decide if it’s worthy of committing to reading a 2,000-word blog post, watching a 26-minute YouTube video, or listening to a 50-minute podcast. So if a creator is generous enough to give you the punchline or the three most salient takeaways, you know the long-form version of whatever it is they’re promoting is going to be worth it.
Goodbye, Clickbait. Hello, Zero-Click Content.
Of course, it wasn’t always this way.
Five years ago, a successful webinar promotion email might have said: “There are four major flaws with buyer personas. Think outside the box. Join our webinar where we’ll walk you through the proven tactics for developing buyer personas that actually move the needle on your business.”
But today? Pbfffftt.
My whole presentation — heck, even the blog post version — built up to that fake template as the punchline to hammer home the pointlessness of traditional buyer personas. And with 906 webinar registrants, the Zero-Click gamble was worth it.
Reverse-engineering my tactic, you could say I took a cue from the radio and streaming video worlds. Howard Stern has been doing this on his YouTube channel for years — giving away the juiciest clips of his celebrity interviews when we all know we need to buy a Sirius subscription to listen to the entire show. Twitch streamers like Ninja, Nickmercs, Pokimane, and many more all do this too. They stream for hours on Twitch, then share the best highlights on YouTube.
Does this mean you need to give away all the spoilers of your long-form content? No. But in a time when content saturation is higher than ever before, you need to be value-driven. You need to continually win over your audience’s attention. Even if they staunchly refuse to click.
But giving away the punchline isn’t the only way to create Zero-Click content. Here are three other frameworks:
Give one complete, compelling idea in 200 words, 2 minutes, or less.
You need a defensible, short-form piece to use in your promotional channels. Think:
A 150-word email
A 10-tweet Twitter thread
A 200-word LinkedIn post
A 2-minute YouTube video
Your short-form piece needs a thesis statement, and a beginning, middle and end. It features a standalone idea within your broader piece.
Summarize the heart of your idea in bullet points.
One way to look at this is sharing an outline of your longer content — be it a blog post, video, podcast episode, or webinar.
Tap into emotion and lead with the rant that sparked your bigger idea.
Rand has a bone to pick with marketing attribution, so he wrote about it… a few times — proving you can use Zero-Click content to gauge what’s worth making click-worthy content about.
Productivity coach Khe Hy so deeply hates emails-disguised-as-tasks that he wrote an essay about it
If you lead with the rant, you’re shining a light on the pain points that your audience feels too. They won’t need to click on your post to feel seen or understood. But they’ll want to click on it because they’ll want to see how you solve their problem.
Zero-Click content is uncomfortable but it’s worth it.
Freely giving away value with no hope of tracking the ROI goes against everything we were taught as marketers. But have a little faith. Dare to be even more generous with your work than you already are. Give your audience your best and succinct information to help save them time and energy. Believe that the progress you can’t measure — people you’ve helped, perspectives you’ve changed, becoming top of mind — is being made.
That’s the funny, counterintuitive nature of Zero-Click content. When you create content so valuable that it doesn’t need to be consumed off-platform, it becomes even more likely that your audience will like you, remember you, and trust you enough to eventually smash that CTA.
Tomi Engdahl says:
You Don’t Need a Buyer Persona. You Need Multiple Audience Personas.
https://sparktoro.com/blog/you-dont-need-a-buyer-persona-you-need-multiple-audience-personas/
Tomi Engdahl says:
https://hackaday.com/2024/07/04/cloudflare-adds-block-for-ai-scrapers-and-similar-bots/