Skip to content
Private browser tool
Robots.txt Generator
Prepare robots.txt rules and review the sitemap address before publishing. Runs locally in your browser.
Always Free
Local processing
No account needed
{{ activeTool.name }}
Upload PDF Document
Drag and drop or browse multiple PDF files to combine
Drag and drop or browse a PDF file to edit pages
Selected PDFs to Merge
{{ file.name }}
{{ formatBytes(file.size) }}
Document Pages Grid
{{ page.label }}
Enter Page Ranges to Split (e.g. 1-2, 4)
Compiling document streams...
{{ pdfProgress }}%
From (Company)
To (Client)
Document ID #
Date
Line Items Billing Grid
Tax Rate (%)
Flat Discount Amount ($)
Base Amount ($)
GST rate (%)
Tax Calculation
Base Amount ($)
VAT rate (%)
Tax Calculation
Cost of Item ($)
Selling Price ($)
Original Price ($)
Discount Percentage (%)
Percentage mode
X value
Y value
Total Fixed Costs ($)
Variable Cost per Unit ($)
Selling Price per Unit ($)
Total Campaign Cost ($)
Total Impressions
Total Campaign Cost ($)
Total Clicks
Total Clicks
Total Impressions
Ad Campaign Revenue ($)
Cost of Advertising ($)
Words: {{ seoStats.words }}
Chars: {{ seoStats.chars }}
Reading: {{ seoStats.readingTime }}m
Paragraphs: {{ seoStats.paragraphs }}
|
|
Number of Paragraphs
Number of Words
Number of Names
Page URL
Page Title (Meta Title)
Preview guidance: {{ seoTitle.length }} characters
Page Description (Meta Description)
Preview guidance: {{ seoDesc.length }} characters
Search engines truncate snippets to fit the result layout; these counts are preview guidance, not enforced Google limits.
Language or locale code
Open Graph Image URL
Sitemap XML Address
Crawl Delay (Seconds)
Old Path (Source)
New Path (Destination)
Redirect Type Code
Entity/Site URL
Site Title
Banner/Image Address
Website Address
Campaign Source
Campaign Medium
Campaign Name
Telephone Number (Include Country Code, e.g. 15417543010)
Pre-filled Chat Message
Recipient Email Address
CC Address
BCC Address
Email Subject Header
Email Body Message
Link URL or raw text
Draft text message content
Characters:
{{ seoStats.chars }}
✓ Subject length is perfect for desktop & mobile
⚠ Length exceeds 60 character desktop boundary limit
✓ Tweet fits in standard 280 character limit
⚠ Exceeds 280 character limit ({{ seoStats.chars - 280 }} chars too long)
Hashtags:
{{ seoCaptionStats.hashtags }} / 30
✓ Fits Instagram limits
⚠ Exceeds Instagram constraints
✓ Fits LinkedIn's 3,000-character post limit
⚠ Exceeds the LinkedIn post limit by {{ seoStats.chars - 3000 }} characters
Hashtags found:
{{ seoCaptionStats.hashtags }}
Conversion Target Category
Suggested CTA options (Click to copy)
Color 1
Color 2
Angle ({{ gradientAngle }}°)
Type
Offset X ({{ shadowX }}px)
Offset Y ({{ shadowY }}px)
Blur ({{ shadowBlur }}px)
Spread ({{ shadowSpread }}px)
Shadow Color
All Corners ({{ borderRadiusAll }}px)
Top Left ({{ borderRadiusTopLeft }}px)
Top Right ({{ borderRadiusTopRight }}px)
Bottom Left ({{ borderRadiusBottomLeft }}px)
Bottom Right ({{ borderRadiusBottomRight }}px)
Select color using standard browser picker
Hex:
{{ pickerColorHex.toUpperCase() }}
Paste a HEX, RGB, or HSL color
Enter a valid HEX, RGB, or HSL value.
Password Length
{{ passLength }}
{{ generatedPassword }}
Enter Password to Analyze
Complexity Grade:
{{ passwordStrengthOutput.label }}
Entropy:
{{ passwordStrengthOutput.entropy }} Bits
Estimated Crack Time:
{{ passwordStrengthOutput.crackTime }}
Enter Input String
MD5 checksum:
{{ hashedMd5 }}
SHA-1 hash:
{{ hashedSha1 }}
SHA-256 hash:
{{ hashedSha256 }}
SHA-512 hash:
{{ hashedSha512 }}
Quantity
Generated UUID v4 Keys
Min Value
Max Value
Quantity
Generated Values
{{ num }}
Number of Dice
Dice type
{{ val }}
Number of Coins
{{ val }}
Document Visual Live Sheet Preview
{{ activeTool.name.split(' ')[0] }}
Document ID: {{ invoiceNumber }}
{{ invoiceCompany }}
Date: {{ invoiceDate }}
Billed To
{{ invoiceClient }}
| Description | Qty | Price | Subtotal |
|---|---|---|---|
| {{ item.desc }} | {{ item.qty }} | ${{ item.price }} | ${{ item.price * item.qty }} |
Subtotal:
${{ invoiceSubtotal }}
Discount:
-${{ invoiceDiscount }}
Tax ({{ invoiceTaxRate }}%):
+${{ invoiceTaxAmount.toFixed(2) }}
Grand Total:
${{ invoiceTotal.toFixed(2) }}
Tax allocation breakdown
Base Amount:
${{ activeTool.type === 'fin-gst' ? gstOutput.base : vatOutput.base }}
Tax Amount:
+${{ activeTool.type === 'fin-gst' ? gstOutput.tax : vatOutput.tax }}
Gross Total:
${{ activeTool.type === 'fin-gst' ? gstOutput.total : vatOutput.total }}
Margin metrics
Gross Profit:
${{ marginOutput.profit }}
Profit Margin:
{{ marginOutput.margin }}%
Markup Percentage:
{{ marginOutput.markup }}%
Discount Savings
Total Discount Savings:
${{ discountOutput.savings }}
Final Net Price:
${{ discountOutput.total }}
Evaluated Result:
{{ percentOutput }}
Break-even Thresholds
Break-even volume:
{{ breakEvenOutput.units }} units
Required sales revenue:
${{ breakEvenOutput.revenue }}
Calculated Campaign CPM:
${{ cpmOutput }}
Calculated Cost Per Click (CPC):
${{ cpcOutput }}
Click-Through Rate (CTR):
{{ ctrOutput }}
Campaign ROAS Index
ROAS multiplier ratio:
{{ roasOutput.ratio }}
Return Percentage:
{{ roasOutput.percent }}
Calculated Output Results
Extracted Keyword Density
| Keyword | Count | Density |
|---|---|---|
| {{ item.word }} | {{ item.count }} | {{ item.percent }}% |
| No significant keywords extracted. | ||
Google SERP Snippet Preview
{{ seoUrl || 'https://example.com/' }}
{{ seoTitle || 'My Page Title' }}
{{ seoDesc || 'This is a description of my web page.' }}
Image preview
{{ seoUrl.replace('https://', '') }}
{{ seoTitle }}
{{ seoDesc }}
Image preview
{{ seoUrl.replace('https://', '') }}
{{ seoTitle }}
{{ seoDesc }}
Markdown Rendered View
Compiled CSS Rule snippet
Color Code Formats
HEX:
{{ activeTool.type === 'color-convert' ? devColorConverterOutput.hex : pickerColorHex.toUpperCase() }}
RGB:
{{ activeTool.type === 'color-convert' ? devColorConverterOutput.rgb : `rgb(${parseInt(pickerColorHex.slice(1,3),16)}, ${parseInt(pickerColorHex.slice(3,5),16)}, ${parseInt(pickerColorHex.slice(5,7),16)})` }}
HSL:
{{ devColorConverterOutput.hsl }}
Generated Link address
HTML Heading Tree Hierarchy
H{{ h.level }}
{{ h.text }}
No HTML headings identified. Paste complete HTML syntax tags.
SEO & Marketing workflow
Processed locallyZero file uploads to Beginware
How to use Robots.txt Generator
Prepare robots.txt rules and review the sitemap address before publishing. Runs locally in your browser.
-
Choose crawl directives
Define the user agent and the paths that should be allowed or disallowed.
Step 1 of 3 -
Add the sitemap location
Use the absolute HTTPS URL of the sitemap you want crawlers to discover.
Step 2 of 3 -
Review before publishing
Copy the result to /robots.txt and test important URLs with the tools supplied by your search platform.
Step 3 of 3
No account required
Works instantly in browser
Always review important output
- Output
- Plain-text robots directives
- Location
- Site-root /robots.txt
- Purpose
- Crawler access guidance
Example: block a private utility path
- Input Sample
- User-agent: * and Disallow: /private/
- Generated Result
- Compliant crawlers are asked not to crawl URLs beginning with /private/.
Limits and Considerations
- robots.txt controls crawling; it is not access control and cannot protect confidential content.
- A disallowed URL can still be discovered or indexed from external links in some circumstances.
- Directive support varies by crawler, so verify rules with each important search platform.
Robots.txt Generator FAQs
Where should robots.txt be uploaded?
Place it at the root of the exact host, such as https://example.com/robots.txt.
Does Disallow remove a page from search?
Not reliably. Use appropriate authentication or noindex handling for content that must not appear in search.
Can robots.txt contain more than one user-agent group?
Yes. Separate groups can provide different rules for different crawlers.