WP Content Crawler

WP Content Crawler is a versatile and robust plugin designed to automate the process of scraping and collecting content from virtually any website. Ideal for users who want to aggregate information for personal use, business analysis, or content curation, this plugin offers an array of powerful features to streamline content collection.

With WP Content Crawler, users can effortlessly gather news, blog posts, products, and other content types from their favorite sites. Whether you’re building a site to aggregate the latest news, collect product listings from e-commerce sites, or gather affiliate products to drive revenue, WP Content Crawler provides a comprehensive solution. It seamlessly integrates with WooCommerce, allowing you to import products directly into your online store.

The plugin supports a broad range of content types, including plugins, themes, apps, and images. This makes it an excellent tool for creating curated collections or setting up test environments for plugins and themes. Additionally, WP Content Crawler is useful for competitive analysis, enabling you to monitor and track competitors’ activities and strategies.

Key Features:

• Easy to Use: Intuitive interface for setting up and managing content scraping tasks.
• Broad Compatibility: Works with most websites to scrape various types of content.
• Automated Content Collection: Efficiently gathers news, posts, products, and more.
• WooCommerce Integration: Import products directly into your online store.
• Affiliate Program Support: Collect affiliate products and track potential earnings.
• Test Environment Creation: Use the plugin to create a testing environment for plugins or themes.
• Diverse Content Types: Collect plugins, themes, apps, images, and more.
• Competitor Tracking: Monitor competitors to gain insights into their strategies.
• Endless Possibilities: Flexible content collection and curation to meet various needs.

What’s New (Changelog) in WP Content Crawler v1.14.0

v1.14.0
New

• Adds Config Helper
• Adds Make command to Request subject. This command is used to make requests and insert their responses into the page.
• Adds Convert JSON to HTML and Convert JSON to HTML automatically? settings to Manipulate HTML Section of Category and Post tabs.
• Adds Embed social media posts and other media setting to Quick Fixes Section of Templates tab. This setting is automatically checked when a new site is created.
• Adds Text as JSON and Attribute value as JSON properties to Element subject.
• Adds Convert to HTML and Convert to HTML automatically commands for properties that output parsed JSON.
• Adds Move command to Element subject.
• Adds JSON attribute’s text value, JSON attribute’s numeric value, and JSON attribute’s date value properties to Element subject for condition commands.
• Adds Translate command to the Post subject.
• Adds Translate element attributes command to Page subject.

Improvement

• Turns URLs shown in the test results into clickable links
• Adds gpt-3.5-turbo-16k and gpt-3.5-turbo-instruct models to OpenAI GPT Short Code creator
• Adds Updated, Deleted and Other URL types to the Clear URLs Tool

Fix

• WooCommerce Section is not shown in the multi-site environment when WooCommerce is not activated for the entire network but only for a single site.
• Certain prompts used in [openai-gpt] short code cause an infinite loop, making PHP stop execution
• Decode HTML entities of the JSON values found via Options Box
• Contents found by Post Content Selectors must not be wrapped with a p element
• Values of “0” found by CSS selectors must not be ignored
• Remove empty HTML elements and comments setting causes a PHP fatal error for HTML elements containing too many nodes

Other

• Tested and works with WordPress 6.3, 6.2, 6.1, 6.0, 5.9, 5.8, 5.6, 5.5, 5.4, 5.3, 5.2, with PHP 8.2, 8.1, 8.0, 7.4, 7.3, with Chrome, Firefox, Opera, with WooCommerce 8.2, 8.1, 7.9, 7.8, 7.2, 7.1, 7.0, 6.9, 6.1, 5.2, 5.1, 4.9, 4.5
• Updates third party libraries
• Minor fixes and improvements
• Code quality improvements

Sales Page and Live Demo of WP Content Crawler Plugin

https://codecanyon.net/item/wp-content-crawler-get-content-from-almost-any-site-automatically/15983018