Simon
							
						 
					 | 
					
						
						
						
						
							
						
						
							fe1d29aaea
							
						
					 | 
					
						
						
							
							Crawl tasks are now fetched by the crawlers instead of pushed by the server
						
						
						
						
						
						
					 | 
					
						2018-07-14 17:31:18 -04:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Simon
							
						 
					 | 
					
						
						
						
						
							
						
						
							5fd00f22af
							
						
					 | 
					
						
						
							
							Task logs now stored on main server
						
						
						
						
						
						
					 | 
					
						2018-06-24 20:32:02 -04:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Simon
							
						 
					 | 
					
						
						
						
						
							
						
						
							059d9fd366
							
						
					 | 
					
						
						
							
							Added button to queue empty websites
						
						
						
						
						
						
					 | 
					
						2018-06-24 19:33:15 -04:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Simon
							
						 
					 | 
					
						
						
						
						
							
						
						
							a6d753c6ee
							
						
					 | 
					
						
						
							
							Added redispatch button and fixed typo in load balancing code
						
						
						
						
						
						
					 | 
					
						2018-06-24 10:07:46 -04:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Simon
							
						 
					 | 
					
						
						
						
						
							
						
						
							1ac510ff53
							
						
					 | 
					
						
						
							
							Slots can be updated without removing & adding
						
						
						
						
						
						
					 | 
					
						2018-06-24 09:39:44 -04:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Simon
							
						 
					 | 
					
						
						
						
						
							
						
						
							14d384e366
							
						
					 | 
					
						
						
							
							Decentralised crawling should work in theory + temporary fix for going further than the maximum 10k results elasticsearch allows by default
						
						
						
						
						
						
					 | 
					
						2018-06-21 19:44:27 -04:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Simon
							
						 
					 | 
					
						
						
						
						
							
						
						
							7400bdc2a9
							
						
					 | 
					
						
						
							
							Added admin blacklist control in dashboard
						
						
						
						
						
						
					 | 
					
						2018-06-20 11:28:06 -04:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Simon
							
						 
					 | 
					
						
						
						
						
							
						
						
							35837463cd
							
						
					 | 
					
						
						
							
							Added admin clear & delete buttons for websites
						
						
						
						
						
						
					 | 
					
						2018-06-20 10:48:51 -04:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Simon
							
						 
					 | 
					
						
						
						
						
							
						
						
							a25976d24a
							
						
					 | 
					
						
						
							
							Generate and delete API tokens
						
						
						
						
						
						
					 | 
					
						2018-06-09 12:41:28 -04:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Simon
							
						 
					 | 
					
						
						
						
						
							
						
						
							20d0f97ffb
							
						
					 | 
					
						
						
							
							Logout button
						
						
						
						
						
						
					 | 
					
						2018-06-08 11:48:11 -04:00 | 
					
					
						
						
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Simon
							
						 
					 | 
					
						
						
						
						
							
						
						
							dc0cde61a0
							
						
					 | 
					
						
						
							
							Basic admin page
						
						
						
						
						
						
					 | 
					
						2018-06-08 11:40:54 -04:00 | 
					
					
						
						
							
							
							
						
					 |