[ComfyUI]Hidream E1 VS Step1X-Edit 在ComfyUI中使用图像编辑模型，效果测评安装测试
啦啦啦的小黄瓜
[{'start': '21.366', 'end': '23.333', 'text': "Okay, let's get started. In"}, {'start': '23.333', 'end': '23.966', 'text': 'the past two days, we have'}, {'start': '23.966', 'end': '24.933', 'text': 'open-sourced two'}, {'start': '24.933', 'end': '27.133', 'text': 'image editing models similar to GPT4o.'}, {'start': '27.166', 'end': '28.933', 'text': 'One is our HiDream E1'}, {'start': '28.933', 'end': '31.666', 'text': 'and the other is our Step1X Edit.'}, {'start': '31.700', 'end': '32.066', 'text': 'Now,'}, {'start': '32.066', 'end': '33.966', 'text': 'both of them can be used in ComfyUI. That is to say,'}, {'start': '33.966', 'end': '35.933', 'text': 'during the use process, there'}, {'start': '35.933', 'end': '37.400', 'text': 'may be some precautions in the workflow'}, {'start': '37.400', 'end': '39.766', 'text': 'or the installation of some environment packages is more complicated. So'}, {'start': '39.766', 'end': '41.333', 'text': 'today I will tell you'}, {'start': '41.333', 'end': '42.533', 'text': 'how to install'}, {'start': '42.533', 'end': '44.000', 'text': 'and use these two models.'}, {'start': '44.133', 'end': '45.766', 'text': 'First of all, the first one is our ComfyUI'}, {'start': '45.766', 'end': '46.766', 'text': 'HiDream E1 model. It has been'}, {'start': '46.766', 'end': '49.433', 'text': 'officially supported by ComfyUI.'}, {'start': '49.433', 'end': '50.933', 'text': 'So we can'}, {'start': '50.933', 'end': '52.566', 'text': 'directly update our ComfyUI in the Manager.'}, {'start': '52.566', 'end': '54.233', 'text': 'After updating your ComfyUI to the new version,'}, {'start': '54.233', 'end': '55.266', 'text': 'we can use it.'}, {'start': '55.266', 'end': '55.766', 'text': 'But'}, {'start': '55.766', 'end': '57.900', 'text': 'we have to pay attention to the placement of some models,'}, {'start': '57.900', 'end': '58.833', 'text': 'including model downloads'}, {'start': '58.833', 'end': '61.133', 'text': 'and some parameter selections in our workflow.'}, {'start': '61.133', 'end': '63.366', 'text': 'First, you can go to the video introduction area,'}, {'start': '63.366', 'end': '65.600', 'text': 'and then there is our B station data sharing. Then there'}, {'start': '65.600', 'end': '67.033', 'text': 'is a folder'}, {'start': '67.033', 'end': '70.433', 'text': 'called HiDream E1 and Step1X Edit model folder.'}, {'start': '70.433', 'end': '71.700', 'text': 'Then when we open it, there'}, {'start': '71.700', 'end': '73.266', 'text': 'is a HiDream E1 model in it.'}, {'start': '73.266', 'end': '73.766', 'text': 'After entering,'}, {'start': '73.766', 'end': '75.000', 'text': 'it provides you with'}, {'start': '75.000', 'end': '75.833', 'text': 'our corresponding model'}, {'start': '75.833', 'end': '76.800', 'text': 'text encoders'}, {'start': '76.800', 'end': '78.566', 'text': 'and our VAE model.'}, {'start': '78.566', 'end': '80.166', 'text': 'Then, our diffusion model.'}, {'start': '81.200', 'end': '82.533', 'text': 'After you download these three, put them'}, {'start': '82.533', 'end': '84.033', 'text': 'directly into the'}, {'start': '84.033', 'end': '85.433', 'text': 'models folder of your ComfyUI. You'}, {'start': '85.433', 'end': '87.766', 'text': 'can put the whole file into the'}, {'start': '87.766', 'end': '88.600', 'text': 'folder.'}, {'start': '88.600', 'end': '89.033', 'text': 'Then, the'}, {'start': '89.033', 'end': '90.733', 'text': 'rest is our HiDream text image,'}, {'start': '90.733', 'end': '92.066', 'text': 'which is a JSON file.'}, {'start': '92.066', 'end': '93.533', 'text': 'In this workflow, the'}, {'start': '93.533', 'end': '95.466', 'text': 'first thing we need to pay attention to is that the'}, {'start': '95.466', 'end': '96.566', 'text': 'image we upload'}, {'start': '96.566', 'end': '99.000', 'text': 'must have a resolution of 768 by 768. That'}, {'start': '99.000', 'end': '99.400', 'text': 'is to say,'}, {'start': '99.400', 'end': '101.500', 'text': 'you can change the size of the image'}, {'start': '101.500', 'end': '103.533', 'text': 'before entering our HiDream.'}, {'start': '103.533', 'end': '103.966', 'text': 'So, it is'}, {'start': '103.966', 'end': '105.900', 'text': 'recommended to upload a square image here.'}, {'start': '105.933', 'end': '108.566', 'text': 'If it is 1024 or less than 768,'}, {'start': '108.566', 'end': '109.766', 'text': 'it may cause the'}, {'start': '109.766', 'end': '111.566', 'text': 'final image you generate to be offset, that'}, {'start': '111.566', 'end': '111.800', 'text': 'is,'}, {'start': '111.800', 'end': '114.033', 'text': 'it is not in the center of our image. In addition,'}, {'start': '114.933', 'end': '116.900', 'text': 'in Clip Text Encode, which'}, {'start': '116.900', 'end': '118.666', 'text': 'is our positive prompt word, try to'}, {'start': '118.666', 'end': '120.733', 'text': 'give it in this form.'}, {'start': '120.733', 'end': '121.600', 'text': 'Our prompt word'}, {'start': '121.666', 'end': '122.633', 'text': 'is first of all an'}, {'start': '122.633', 'end': '124.033', 'text': 'editing instruction, which'}, {'start': '124.033', 'end': '125.400', 'text': 'is our editing instruction.'}, {'start': '125.400', 'end': '129.033', 'text': 'For example, I asked him to convert the text SVIE'}, {'start': '129.033', 'end': '131.933', 'text': 'SVQ Quant into ComfyUI Success.'}, {'start': '131.933', 'end': '135.233', 'text': 'Then, there is a target image description, which is'}, {'start': '135.233', 'end': '137.466', 'text': 'a description of our target image.'}, {'start': '137.466', 'end': '139.000', 'text': 'Here, I wrote a kitten'}, {'start': '139.000', 'end': '140.300', 'text': 'holding a sign.  That'}, {'start': '141.233', 'end': '143.866', 'text': 'is, convert the text into ComfyUI success.'}, {'start': '144.000', 'end': '144.433', 'text': 'Then, the'}, {'start': '144.433', 'end': '146.966', 'text': 'final output effect is as shown in the figure.'}, {'start': '147.033', 'end': '149.333', 'text': 'It only changes the area of \u200b\u200bour screen, that'}, {'start': '149.333', 'end': '151.133', 'text': 'is, the area described by our text.'}, {'start': '151.933', 'end': '153.466', 'text': 'Only the text is changed.'}, {'start': '153.466', 'end': '154.200', 'text': 'Apart from this, the'}, {'start': '154.200', 'end': '155.400', 'text': 'other contents basically'}, {'start': '155.400', 'end': '157.066', 'text': 'do not change much.'}, {'start': '157.066', 'end': '158.800', 'text': 'One of its disadvantages is that it'}, {'start': '158.800', 'end': '160.366', 'text': 'can only accept'}, {'start': '160.366', 'end': '162.600', 'text': 'an input size of 768 times 768.'}, {'start': '162.600', 'end': '163.966', 'text': 'In addition, the video memory usage is about'}, {'start': '163.966', 'end': '165.933', 'text': '40g.'}, {'start': '165.966', 'end': '168.933', 'text': 'Compared with Step1X Edit,'}, {'start': '168.933', 'end': '171.333', 'text': 'the resolution of Step1X Edit is'}, {'start': '171.333', 'end': '172.933', 'text': 'easier to adjust.'}, {'start': '172.933', 'end': '173.333', 'text': 'Okay,'}, {'start': '173.333', 'end': '174.933', 'text': 'so this is'}, {'start': '174.933', 'end': '175.800', 'text': 'a usage of HiDream.'}, {'start': '175.800', 'end': '176.500', 'text': 'In addition,'}, {'start': '176.500', 'end': '178.900', 'text': "let's talk about a usage of Step1X Edit. For"}, {'start': '178.900', 'end': '179.500', 'text': 'this,'}, {'start': '179.500', 'end': '181.400', 'text': 'we need to install a plug-in,'}, {'start': '181.466', 'end': '183.633', 'text': 'which is the plug-in in our ComfyUI.'}, {'start': '183.700', 'end': '187.000', 'text': 'You can search ComfyUI Step1X Edit directly on GitHub,'}, {'start': '187.000', 'end': '188.300', 'text': 'or you can paste the corresponding address in the introduction area of \u200b\u200bour video.'}, {'start': '189.533', 'end': '190.133', 'text': 'So correspondingly,'}, {'start': '190.133', 'end': '192.200', 'text': 'we first download the entire project'}, {'start': '192.200', 'end': '194.766', 'text': 'to our ComfyUI custom nodes, that'}, {'start': '194.766', 'end': '196.166', 'text': 'is, our plug-in directory.'}, {'start': '196.166', 'end': '196.866', 'text': 'In addition,'}, {'start': '196.866', 'end': '199.566', 'text': 'we need to focus on processing two environment packages.'}, {'start': '199.566', 'end': '201.666', 'text': 'One is our Flash Attn environment package,'}, {'start': '201.666', 'end': '202.400', 'text': 'and the other is'}, {'start': '202.400', 'end': '204.000', 'text': "It's our Triton environment package."}, {'start': '204.000', 'end': '205.866', 'text': 'These two are relatively difficult to install.'}, {'start': '205.866', 'end': '206.933', 'text': 'Triton is a little easier.'}, {'start': '206.933', 'end': '208.866', 'text': 'We have the Triton-Windows installation package.'}, {'start': '208.866', 'end': '211.433', 'text': 'We can go directly to our virtual environment,'}, {'start': '211.433', 'end': '212.300', 'text': 'for example, in this location.'}, {'start': '212.300', 'end': '214.800', 'text': 'Then every time we start ComfyUI,'}, {'start': '214.800', 'end': '217.300', 'text': 'you can see your local Python version,'}, {'start': '217.333', 'end': '218.600', 'text': 'including our torch version.'}, {'start': '218.633', 'end': '221.866', 'text': 'For example, here I am Python 3.12.9,'}, {'start': '221.866', 'end': '223.366', 'text': 'and my torch here'}, {'start': '223.366', 'end': '226.366', 'text': 'is a version of 2.6.0 plus cu126.'}, {'start': '226.400', 'end': '228.866', 'text': 'So when we install our Triton'}, {'start': '228.866', 'end': '230.366', 'text': '-Windows environment package,'}, {'start': '230.366', 'end': '232.166', 'text': 'we'}, {'start': '232.166', 'end': '234.166', 'text': 'can scroll down at the GitHub address and see a sentence like this, that'}, {'start': '234.233', 'end': '234.733', 'text': 'is,'}, {'start': '234.733', 'end': '238.466', 'text': 'Triton version 3.2 is compatible with Pytorch greater than or equal to 2.6, and'}, {'start': '238.466', 'end': '239.700', 'text': 'Triton version 3.3 is'}, {'start': '239.700', 'end': '241.533', 'text': 'compatible with Pytorch greater than or equal to 2.7.'}, {'start': '241.633', 'end': '244.566', 'text': 'So Triton 3.3 cannot be installed on my Pytorch version 2.6,'}, {'start': '245.500', 'end': '247.400', 'text': 'so I can only install Triton 3.2.'}, {'start': '247.400', 'end': '248.733', 'text': 'So when we install,'}, {'start': '248.733', 'end': '250.933', 'text': 'you have to install the Triton-Windows environment package, that'}, {'start': '251.266', 'end': '251.933', 'text': 'is, for example,'}, {'start': '251.933', 'end': '253.100', 'text': 'in the location of our current virtual environment,'}, {'start': '253.100', 'end': '254.866', 'text': 'we enter python -m'}, {'start': '254.866', 'end': '256.166', 'text': 'and then pip install,'}, {'start': '256.166', 'end': '257.866', 'text': 'and then we have to install Triton'}, {'start': '257.933', 'end': '260.200', 'text': '-Windows environment package. You'}, {'start': '260.200', 'end': '261.900', 'text': 'can see that it says that I already have it locally.'}, {'start': '261.900', 'end': '263.200', 'text': 'So we can show'}, {'start': '263.200', 'end': '264.533', 'text': 'my local environment package version.'}, {'start': '264.566', 'end': '265.966', 'text': 'We use the pip show command and you'}, {'start': '266.700', 'end': '267.066', 'text': 'can see that'}, {'start': '267.066', 'end': '269.433', 'text': 'mine is 3.2.0POST 11.'}, {'start': '269.433', 'end': '271.066', 'text': 'This is my current Triton version.'}, {'start': '271.066', 'end': '273.000', 'text': 'So everyone looks at their own torch version and'}, {'start': '273.000', 'end': '274.233', 'text': 'installs it accordingly.'}, {'start': '274.233', 'end': '274.633', 'text': 'Okay,'}, {'start': '274.633', 'end': '276.966', 'text': 'so after we install Triton, what'}, {'start': '276.966', 'end': '279.233', 'text': 'we need to install is our flash attn.'}, {'start': '279.233', 'end': '280.466', 'text': 'So the flash attn environment package.'}, {'start': '280.466', 'end': '283.533', 'text': 'We can search for Flash directly in HuggingFace,'}, {'start': '283.533', 'end': '285.866', 'text': 'and then there is a Flash attn Windows wheel.'}, {'start': '285.866', 'end': '288.133', 'text': 'This is our precompiled package in Windows.'}, {'start': '288.133', 'end': '290.166', 'text': 'We click on files and versions, and there'}, {'start': '290.166', 'end': '291.333', 'text': 'are many of them.'}, {'start': '291.333', 'end': '291.733', 'text': 'Then'}, {'start': '291.733', 'end': '294.900', 'text': 'we have to find the one that matches our environment.'}, {'start': '294.900', 'end': '296.200', 'text': 'For example,'}, {'start': '296.200', 'end': '296.933', 'text': 'my current Python'}, {'start': '296.933', 'end': '298.933', 'text': 'is version 3.12, right?'}, {'start': '299.000', 'end': '300.966', 'text': 'So 3.12, and our torch'}, {'start': '300.966', 'end': '303.166', 'text': 'is version 2.6.0 plus cu126.'}, {'start': '303.166', 'end': '304.433', 'text': 'I can find it here.'}, {'start': '304.500', 'end': '305.566', 'text': 'For example, at this location,'}, {'start': '305.566', 'end': '308.166', 'text': "Flash Attn's version is 2.7.4, and"}, {'start': '308.166', 'end': '310.000', 'text': 'CU 126'}, {'start': '310.000', 'end': '311.566', 'text': 'matches my CUDA version,'}, {'start': '311.566', 'end': '313.100', 'text': 'and then torch 2.6.0'}, {'start': '313.100', 'end': '314.866', 'text': 'also matches my torch version, and'}, {'start': '314.900', 'end': '315.633', 'text': 'finally,'}, {'start': '315.633', 'end': '318.333', 'text': 'CP  312 is the version of python 312, which'}, {'start': '318.333', 'end': '320.800', 'text': 'matches my 3.12.9.'}, {'start': '320.800', 'end': '322.300', 'text': 'Then I will download this environment package.'}, {'start': '322.300', 'end': '323.333', 'text': 'After downloading,'}, {'start': '323.333', 'end': '324.566', 'text': 'if it is 312, it'}, {'start': '324.566', 'end': '325.466', 'text': 'may not be installed'}, {'start': '325.500', 'end': '327.566', 'text': 'because its name does not meet our requirements.'}, {'start': '327.566', 'end': '328.400', 'text': 'You need to change its name to'}, {'start': '328.400', 'end': '330.666', 'text': 'a name that meets the requirements.'}, {'start': '330.666', 'end': '331.300', 'text': 'For example,'}, {'start': '331.300', 'end': '332.166', 'text': 'I'}, {'start': '332.166', 'end': '334.966', 'text': 'changed the name of Flash Attn here to Flash Attn 1-2.7.4'}, {'start': '334.966', 'end': '338.166', 'text': 'cp312 and win amd 64.'}, {'start': '338.166', 'end': '339.166', 'text': 'This is too long,'}, {'start': '339.166', 'end': '339.500', 'text': 'or'}, {'start': '339.500', 'end': '341.333', 'text': 'its name does not meet the PIP specification, which'}, {'start': '341.333', 'end': '342.766', 'text': 'may cause our installation to fail.'}, {'start': '342.766', 'end': '343.433', 'text': 'So this'}, {'start': '343.433', 'end': '345.566', 'text': 'is the installation of our flash attn environment package.'}, {'start': '345.600', 'end': '347.033', 'text': 'After these two are installed, the'}, {'start': '347.033', 'end': '349.900', 'text': 'remaining is the requirements .text corresponding to Step1X Edit.'}, {'start': '350.466', 'end': '352.100', 'text': 'In its requirements,'}, {'start': '352.100', 'end': '353.433', 'text': 'after these environment packages are installed,'}, {'start': '353.433', 'end': '355.133', 'text': 'we can start our ComfyUI'}, {'start': '355.200', 'end': '356.533', 'text': 'and drag this workflow in.'}, {'start': '356.533', 'end': '357.166', 'text': 'Correspondingly,'}, {'start': '357.166', 'end': '358.833', 'text': 'we also need to install the corresponding model.'}, {'start': '358.833', 'end': '360.800', 'text': 'I still provide it to you in the network disk. It is'}, {'start': '360.800', 'end': '361.700', 'text': 'still in this folder.'}, {'start': '361.700', 'end': '364.133', 'text': 'We have a Step1X Edit model,'}, {'start': '364.133', 'end': '366.166', 'text': 'and here there is a Step1X Edit,'}, {'start': '366.166', 'end': '368.600', 'text': 'and there is also our MLLM.'}, {'start': '368.600', 'end': '370.666', 'text': 'Still download these two folders and'}, {'start': '370.666', 'end': '373.066', 'text': 'put them in our ComfyUI  models folder, and then'}, {'start': '373.100', 'end': '374.266', 'text': 'put it in,'}, {'start': '374.266', 'end': '375.200', 'text': 'we start it,'}, {'start': '375.200', 'end': '377.033', 'text': 'and then we can choose our corresponding model'}, {'start': '377.033', 'end': '379.000', 'text': 'here. Here we are asked to select Edit model, so'}, {'start': '379.000', 'end': '381.200', 'text': 'we choose our step1x model,'}, {'start': '381.200', 'end': '383.033', 'text': 'and here is Edit model VAE, so'}, {'start': '383.033', 'end': '384.433', 'text': 'we choose the corresponding VAE model, and'}, {'start': '384.433', 'end': '386.166', 'text': 'here is MLLM model, so'}, {'start': '386.166', 'end': '387.833', 'text': 'we choose the Qwen2.5'}, {'start': '387.866', 'end': '388.500', 'text': 'model.'}, {'start': '388.500', 'end': '389.066', 'text': 'After selecting,'}, {'start': '389.066', 'end': '389.900', 'text': 'our prompt words'}, {'start': '389.900', 'end': '391.933', 'text': 'can directly give it editing prompts,'}, {'start': '391.933', 'end': '392.233', 'text': 'for example,'}, {'start': '392.233', 'end': '394.400', 'text': 'change some text in the image to some text,'}, {'start': '394.400', 'end': '397.000', 'text': "we don't need to give two paragraphs like HiDream."}, {'start': '397.000', 'end': '397.966', 'text': 'Okay, then in addition to this, there is'}, {'start': '397.966', 'end': '400.000', 'text': 'another important parameter, which is the size level.'}, {'start': '400.000', 'end': '400.966', 'text': 'Through my test,'}, {'start': '400.966', 'end': '402.866', 'text': 'if the resolution is low,'}, {'start': '402.866', 'end': '404.933', 'text': 'it will cause the content outside the redrawn area'}, {'start': '404.933', 'end': '405.733', 'text': 'to become blurred.'}, {'start': '405.733', 'end': '406.266', 'text': 'But if'}, {'start': '406.266', 'end': '407.933', 'text': 'this value is 1024,'}, {'start': '407.933', 'end': '410.100', 'text': 'then the corresponding change is not big, that'}, {'start': '410.100', 'end': '411.766', 'text': 'is, except for the content outside the redrawn area, it will'}, {'start': '411.766', 'end': '412.933', 'text': 'not become blurred,'}, {'start': '412.933', 'end': '414.666', 'text': 'or some additional special cases.'}, {'start': '414.700', 'end': '415.866', 'text': 'So'}, {'start': '415.866', 'end': '417.000', 'text': "we'll stop here for the installation method, and"}, {'start': '417.000', 'end': '419.400', 'text': 'you can test more content by yourself.'}, {'start': '419.400', 'end': '420.666', 'text': 'From the current use,'}, {'start': '420.666', 'end': '422.766', 'text': 'I personally feel that Step1X Edit'}, {'start': '422.766', 'end': '423.466', 'text': 'has a'}, {'start': '423.466', 'end': '425.033', 'text': 'better effect than HiDream.'}, {'start': '425.033', 'end': '426.633', 'text': 'In the display of the title, that is, in the'}, {'start': '426.633', 'end': '428.066', 'text': 'comparison of the title,'}, {'start': '428.066', 'end': '429.566', 'text': 'you can also see the difference between them.'}, {'start': '429.566', 'end': '431.933', 'text': "Okay, so today we'll stop here,"}, {'start': '431.933', 'end': '432.433', 'text': 'thank you everyone'}]