관리자 > 설정 > 시스템 설정 > 보안 설정 > 로봇 user-agent 설정

출처 : https://lelien.tistory.com/77

ia_archiver
aolbuild
teoma
Baiduspider
Baidu Favorites
Baidu Union
Business Search (Advertisements)
Desktop
Image Search
Mobile
News Search
Video Search
AdIdxBot
Bingbot
BingPreview
MSNBot
MSNBot-Media
Daumoa
DuckDuckBot
AdsBot-Google
AdsBot-Google-Mobile-Apps
Googlebot
Googlebot-Image
Googlebot-News
Googlebot-Video
Mediapartners-Google
msnbot
Yeti
teoma
Slurp
YaDirectFetcher
Yandex
YandexAntivirus
YandexBlogs
YandexBot
YandexCalendar
YandexDirect
YandexDirectDyn
YandexFavicons
YandexImageResizer
YandexImages
YandexMedia
YandexMetrika
YandexMobileBot
YandexNews
YandexPagechecker
YandexScreenshotBot
YandexSitelinks
YandexVertis
YandexWebmaster
Googlebot-Image/1.0
Googlebot-Video/1.0
SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
(compatible; Mediapartners-Google/2.1; +http://www.google.com/bot.html)
Mediapartners-Google
AdsBot-Google (+http://www.google.com/adsbot.html)
AdsBot-Google-Mobile-Apps